Aug 26 19:02:41 user nova-compute[73917]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 26 19:02:44 user nova-compute[73917]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73917) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73917) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73917) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 19:02:44 user nova-compute[73917]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:02:44 user nova-compute[73917]: INFO nova.virt.driver [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 26 19:02:44 user nova-compute[73917]: INFO nova.compute.provider_config [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] Acquiring lock "singleton_lock" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] Acquired lock "singleton_lock" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] Releasing lock "singleton_lock" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] Full set of CONF: {{(pid=73917) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ******************************************************************************** {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] Configuration options gathered from: {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ================================================================================ {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] allow_resize_to_same_host      = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] arq_binding_timeout            = 300 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] backdoor_port                  = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] backdoor_socket                = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] block_device_allocate_retries  = 300 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] block_device_allocate_retries_interval = 5 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cert                           = self.pem {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] compute_monitors               = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] config_dir                     = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] config_drive_format            = iso9660 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] config_source                  = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] console_host                   = user {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] control_exchange               = nova {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cpu_allocation_ratio           = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] daemon                         = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] debug                          = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] default_access_ip_network_name = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] default_availability_zone      = nova {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] default_ephemeral_format       = ext4 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] default_green_pool_size        = 1000 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] default_schedule_zone          = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] disk_allocation_ratio          = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] enable_new_services            = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] enabled_ssl_apis               = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] flat_injected                  = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] force_config_drive             = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] force_raw_images               = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] graceful_shutdown_timeout      = 5 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] heal_instance_info_cache_interval = 60 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] host                           = user {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] instance_build_timeout         = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] instance_delete_interval       = 300 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] instance_name_template         = instance-%08x {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] instance_usage_audit           = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] instance_usage_audit_period    = month {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] internal_service_availability_zone = internal {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] key                            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] live_migration_retry_count     = 30 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] log_config_append              = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] log_dir                        = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] log_file                       = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] log_options                    = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] log_rotate_interval            = 1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] log_rotate_interval_type       = days {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] log_rotation_type              = none {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] long_rpc_timeout               = 1800 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] max_concurrent_builds          = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] max_concurrent_live_migrations = 1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] max_concurrent_snapshots       = 5 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] max_local_block_devices        = 3 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] max_logfile_count              = 30 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] max_logfile_size_mb            = 200 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] maximum_instance_delete_attempts = 5 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] metadata_listen                = 0.0.0.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] metadata_listen_port           = 8775 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] metadata_workers               = 3 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] migrate_max_retries            = -1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] mkisofs_cmd                    = genisoimage {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] my_ip                          = 10.0.0.210 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] network_allocate_retries       = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] osapi_compute_listen_port      = 8774 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] osapi_compute_unique_server_name_scope =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] osapi_compute_workers          = 3 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] password_length                = 12 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] periodic_enable                = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] periodic_fuzzy_delay           = 60 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] pointer_model                  = ps2mouse {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] preallocate_images             = none {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] publish_errors                 = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] pybasedir                      = /opt/stack/nova {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ram_allocation_ratio           = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] rate_limit_burst               = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] rate_limit_except_level        = CRITICAL {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] rate_limit_interval            = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] reboot_timeout                 = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] reclaim_instance_interval      = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] record                         = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] reimage_timeout_per_gb         = 60 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] report_interval                = 120 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] rescue_timeout                 = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] reserved_host_cpus             = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] reserved_host_disk_mb          = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] reserved_host_memory_mb        = 512 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] reserved_huge_pages            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] resize_confirm_window          = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] resize_fs_using_block_device   = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] resume_guests_state_on_host_boot = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] rpc_response_timeout           = 60 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] run_external_periodic_tasks    = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] running_deleted_instance_action = reap {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] running_deleted_instance_timeout = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] scheduler_instance_sync_interval = 120 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] service_down_time              = 720 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] servicegroup_driver            = db {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] shelved_offload_time           = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] shelved_poll_interval          = 3600 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] shutdown_timeout               = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] source_is_ipv6                 = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ssl_only                       = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] state_path                     = /opt/stack/data/nova {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] sync_power_state_interval      = 600 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] sync_power_state_pool_size     = 1000 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] syslog_log_facility            = LOG_USER {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] tempdir                        = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] timeout_nbd                    = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] transport_url                  = **** {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] update_resources_interval      = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] use_cow_images                 = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] use_eventlog                   = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] use_journal                    = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] use_json                       = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] use_rootwrap_daemon            = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] use_stderr                     = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] use_syslog                     = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vcpu_pin_set                   = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vif_plugging_is_fatal          = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vif_plugging_timeout           = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] virt_mkfs                      = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] volume_usage_poll_interval     = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] watch_log_file                 = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] web                            = /usr/share/spice-html5 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_concurrency.disable_process_locking = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.auth_strategy              = keystone {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.compute_link_prefix        = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.dhcp_domain                = novalocal {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.enable_instance_password   = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.glance_link_prefix         = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.instance_list_per_project_cells = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.list_records_by_skipping_down_cells = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.local_metadata_per_cell    = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.max_limit                  = 1000 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.metadata_cache_expiration  = 15 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.neutron_default_tenant_id  = default {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.use_forwarded_for          = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.use_neutron_default_nets   = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.vendordata_dynamic_targets = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.vendordata_jsonfile_path   = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.backend_argument         = **** {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.config_prefix            = cache.oslo {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.dead_timeout             = 60.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.debug_cache_backend      = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.enable_retry_client      = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.enable_socket_keepalive  = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.enabled                  = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.expiration_time          = 600 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.hashclient_retry_attempts = 2 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.memcache_dead_retry      = 300 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.memcache_password        =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.memcache_sasl_enabled    = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.memcache_username        =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.proxies                  = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.retry_attempts           = 2 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.retry_delay              = 0.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.socket_keepalive_count   = 1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.socket_keepalive_idle    = 1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.socket_keepalive_interval = 1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.tls_allowed_ciphers      = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.tls_cafile               = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.tls_certfile             = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.tls_enabled              = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cache.tls_keyfile              = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cinder.auth_section            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cinder.auth_type               = password {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cinder.cafile                  = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cinder.certfile                = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cinder.collect_timing          = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cinder.cross_az_attach         = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cinder.debug                   = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cinder.endpoint_template       = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cinder.http_retries            = 3 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cinder.insecure                = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cinder.keyfile                 = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cinder.os_region_name          = RegionOne {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cinder.split_loggers           = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cinder.timeout                 = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] compute.cpu_dedicated_set      = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] compute.cpu_shared_set         = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] compute.image_type_exclude_list = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] compute.resource_provider_association_refresh = 300 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] compute.shutdown_retry_interval = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] conductor.workers              = 3 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] console.allowed_origins        = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] console.ssl_ciphers            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] console.ssl_minimum_version    = default {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] consoleauth.token_ttl          = 600 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cyborg.cafile                  = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cyborg.certfile                = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cyborg.collect_timing          = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cyborg.connect_retries         = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cyborg.connect_retry_delay     = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cyborg.endpoint_override       = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cyborg.insecure                = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cyborg.keyfile                 = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cyborg.max_version             = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cyborg.min_version             = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cyborg.region_name             = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cyborg.service_name            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cyborg.service_type            = accelerator {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cyborg.split_loggers           = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cyborg.status_code_retries     = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cyborg.status_code_retry_delay = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cyborg.timeout                 = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] cyborg.version                 = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] database.backend               = sqlalchemy {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] database.connection            = **** {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] database.connection_debug      = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] database.connection_parameters =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] database.connection_recycle_time = 3600 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] database.connection_trace      = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] database.db_inc_retry_interval = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] database.db_max_retries        = 20 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] database.db_max_retry_interval = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] database.db_retry_interval     = 1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] database.max_overflow          = 50 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] database.max_pool_size         = 5 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] database.max_retries           = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] database.mysql_enable_ndb      = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] database.mysql_wsrep_sync_wait = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] database.pool_timeout          = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] database.retry_interval        = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] database.slave_connection      = **** {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] database.sqlite_synchronous    = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api_database.backend           = sqlalchemy {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api_database.connection        = **** {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api_database.connection_debug  = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api_database.connection_parameters =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api_database.connection_recycle_time = 3600 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api_database.connection_trace  = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api_database.db_inc_retry_interval = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api_database.db_max_retries    = 20 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api_database.db_max_retry_interval = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api_database.db_retry_interval = 1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api_database.max_overflow      = 50 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api_database.max_pool_size     = 5 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api_database.max_retries       = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api_database.mysql_enable_ndb  = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api_database.pool_timeout      = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api_database.retry_interval    = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api_database.slave_connection  = **** {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] api_database.sqlite_synchronous = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] devices.enabled_mdev_types     = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ephemeral_storage_encryption.enabled = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.api_servers             = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.cafile                  = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.certfile                = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.collect_timing          = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.connect_retries         = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.connect_retry_delay     = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.debug                   = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.default_trusted_certificate_ids = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.enable_certificate_validation = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.enable_rbd_download     = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.endpoint_override       = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.insecure                = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.keyfile                 = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.max_version             = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.min_version             = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.num_retries             = 3 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.rbd_ceph_conf           =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.rbd_connect_timeout     = 5 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.rbd_pool                =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.rbd_user                =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.region_name             = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.service_name            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.service_type            = image {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.split_loggers           = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.status_code_retries     = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.status_code_retry_delay = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.timeout                 = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.verify_glance_signatures = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] glance.version                 = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] guestfs.debug                  = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] hyperv.config_drive_cdrom      = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] hyperv.config_drive_inject_password = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] hyperv.enable_remotefx         = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] hyperv.instances_path_share    =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] hyperv.limit_cpu_features      = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] hyperv.use_multipath_io        = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] hyperv.vswitch_name            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] mks.enabled                    = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] image_cache.manager_interval   = 2400 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] image_cache.precache_concurrency = 1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] image_cache.remove_unused_base_images = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] image_cache.subdirectory_name  = _base {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.api_max_retries         = 60 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.api_retry_interval      = 2 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.auth_section            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.auth_type               = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.cafile                  = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.certfile                = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.collect_timing          = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.connect_retries         = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.connect_retry_delay     = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.endpoint_override       = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.insecure                = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.keyfile                 = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.max_version             = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.min_version             = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.partition_key           = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.peer_list               = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.region_name             = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.serial_console_state_timeout = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.service_name            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.service_type            = baremetal {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.split_loggers           = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.status_code_retries     = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.status_code_retry_delay = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.timeout                 = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ironic.version                 = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] key_manager.fixed_key          = **** {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican.barbican_api_version  = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican.barbican_endpoint     = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican.barbican_endpoint_type = public {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican.barbican_region_name  = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican.cafile                = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican.certfile              = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican.collect_timing        = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican.insecure              = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican.keyfile               = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican.number_of_retries     = 60 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican.retry_delay           = 1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican.send_service_user_token = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican.split_loggers         = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican.timeout               = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican.verify_ssl            = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican.verify_ssl_path       = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican_service_user.auth_section = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican_service_user.auth_type = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican_service_user.cafile   = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican_service_user.certfile = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican_service_user.collect_timing = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican_service_user.insecure = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican_service_user.keyfile  = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican_service_user.split_loggers = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] barbican_service_user.timeout  = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vault.approle_role_id          = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vault.approle_secret_id        = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vault.cafile                   = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vault.certfile                 = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vault.collect_timing           = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vault.insecure                 = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vault.keyfile                  = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vault.kv_mountpoint            = secret {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vault.kv_version               = 2 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vault.namespace                = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vault.root_token_id            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vault.split_loggers            = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vault.ssl_ca_crt_file          = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vault.timeout                  = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vault.use_ssl                  = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] keystone.cafile                = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] keystone.certfile              = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] keystone.collect_timing        = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] keystone.connect_retries       = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] keystone.connect_retry_delay   = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] keystone.endpoint_override     = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] keystone.insecure              = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] keystone.keyfile               = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] keystone.max_version           = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] keystone.min_version           = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] keystone.region_name           = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] keystone.service_name          = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] keystone.service_type          = identity {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] keystone.split_loggers         = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] keystone.status_code_retries   = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] keystone.status_code_retry_delay = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] keystone.timeout               = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] keystone.version               = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.connection_uri         =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.cpu_mode               = custom {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: WARNING oslo_config.cfg [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.cpu_power_governor_high = performance {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.cpu_power_management   = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.device_detach_attempts = 8 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.device_detach_timeout  = 20 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.disk_cachemodes        = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.disk_prefix            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.enabled_perf_events    = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.file_backed_memory     = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.gid_maps               = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.hw_disk_discard        = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.hw_machine_type        = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.images_rbd_pool        = rbd {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.images_type            = default {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.images_volume_group    = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.inject_key             = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.inject_partition       = -2 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.inject_password        = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.iscsi_iface            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.iser_use_multipath     = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.live_migration_downtime = 500 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.live_migration_inbound_addr = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.live_migration_scheme  = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.live_migration_timeout_action = abort {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.live_migration_tunnelled = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: WARNING oslo_config.cfg [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 26 19:02:44 user nova-compute[73917]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 26 19:02:44 user nova-compute[73917]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 26 19:02:44 user nova-compute[73917]: and ``live_migration_inbound_addr`` respectively.
Aug 26 19:02:44 user nova-compute[73917]: ).  Its value may be silently ignored in the future.
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.live_migration_with_native_tls = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.max_queues             = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.nfs_mount_options      = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.num_pcie_ports         = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.pmem_namespaces        = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.quobyte_client_cfg     = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.rbd_secret_uuid        = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.rbd_user               = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.rescue_image_id        = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.rescue_kernel_id       = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.rx_queue_size          = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.smbfs_mount_options    =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.snapshot_compression   = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.snapshot_image_format  = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.sparse_logical_volumes = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.swtpm_enabled          = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.swtpm_group            = tss {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.swtpm_user             = tss {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.sysinfo_serial         = unique {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.tb_cache_size          = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.tx_queue_size          = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.uid_maps               = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.use_virtio_for_bridges = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.virt_type              = kvm {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.volume_clear           = zero {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.volume_clear_size      = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.volume_use_multipath   = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.vzstorage_cache_path   = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.auth_section           = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.auth_type              = password {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.cafile                 = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.certfile               = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.collect_timing         = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.connect_retries        = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.connect_retry_delay    = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.default_floating_pool  = public {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.endpoint_override      = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.extension_sync_interval = 600 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.http_retries           = 3 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.insecure               = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.keyfile                = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.max_version            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.min_version            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.ovs_bridge             = br-int {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.physnets               = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.region_name            = RegionOne {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.service_metadata_proxy = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.service_name           = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.service_type           = network {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.split_loggers          = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.status_code_retries    = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.status_code_retry_delay = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.timeout                = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] neutron.version                = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] notifications.bdms_in_notifications = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] notifications.default_level    = INFO {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] notifications.notification_format = unversioned {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] notifications.notify_on_state_change = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] pci.alias                      = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] pci.device_spec                = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] pci.report_in_placement        = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.auth_section         = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.auth_type            = password {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.cafile               = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.certfile             = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.collect_timing       = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.connect_retries      = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.connect_retry_delay  = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.default_domain_id    = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.default_domain_name  = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.domain_id            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.domain_name          = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.endpoint_override    = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.insecure             = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.keyfile              = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.max_version          = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.min_version          = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.password             = **** {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.project_domain_id    = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.project_domain_name  = Default {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.project_id           = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.project_name         = service {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.region_name          = RegionOne {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.service_name         = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.service_type         = placement {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.split_loggers        = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.status_code_retries  = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.status_code_retry_delay = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.system_scope         = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.timeout              = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.trust_id             = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.user_domain_id       = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.user_domain_name     = Default {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.user_id              = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.username             = placement {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] placement.version              = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] quota.cores                    = 20 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] quota.count_usage_from_placement = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] quota.injected_file_content_bytes = 10240 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] quota.injected_file_path_length = 255 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] quota.injected_files           = 5 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] quota.instances                = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] quota.key_pairs                = 100 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] quota.metadata_items           = 128 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] quota.ram                      = 51200 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] quota.recheck_quota            = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] quota.server_group_members     = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] quota.server_groups            = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] rdp.enabled                    = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] scheduler.image_metadata_prefilter = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] scheduler.max_attempts         = 3 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] scheduler.max_placement_results = 1000 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] scheduler.workers              = 3 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.host_subset_size = 1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.isolated_hosts = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.isolated_images = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.pci_in_placement = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.track_instance_changes = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] metrics.required               = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] metrics.weight_multiplier      = 1.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] metrics.weight_setting         = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] serial_console.enabled         = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] serial_console.port_range      = 10000:20000 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] serial_console.serialproxy_port = 6083 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] service_user.auth_section      = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] service_user.auth_type         = password {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] service_user.cafile            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] service_user.certfile          = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] service_user.collect_timing    = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] service_user.insecure          = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] service_user.keyfile           = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] service_user.send_service_user_token = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] service_user.split_loggers     = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] service_user.timeout           = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] spice.agent_enabled            = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] spice.enabled                  = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] spice.html5proxy_port          = 6082 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] spice.image_compression        = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] spice.jpeg_compression         = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] spice.playback_compression     = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] spice.server_listen            = 127.0.0.1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] spice.streaming_mode           = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] spice.zlib_compression         = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] upgrade_levels.baseapi         = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] upgrade_levels.cert            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] upgrade_levels.compute         = auto {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] upgrade_levels.conductor       = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] upgrade_levels.scheduler       = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vendordata_dynamic_auth.cafile = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vendordata_dynamic_auth.certfile = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vendordata_dynamic_auth.insecure = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vendordata_dynamic_auth.timeout = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.api_retry_count         = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.ca_file                 = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.cache_prefix            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.cluster_name            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.connection_pool_size    = 10 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.console_delay_seconds   = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.datastore_regex         = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.host_ip                 = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.host_password           = **** {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.host_port               = 443 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.host_username           = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.insecure                = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.integration_bridge      = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.maximum_objects         = 100 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.pbm_default_policy      = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.pbm_enabled             = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.pbm_wsdl_location       = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.serial_port_proxy_uri   = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.serial_port_service_uri = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.task_poll_interval      = 0.5 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.use_linked_clone        = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.vnc_keymap              = en-us {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.vnc_port                = 5900 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vmware.vnc_port_total          = 10000 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vnc.auth_schemes               = ['none'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vnc.enabled                    = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vnc.novncproxy_port            = 6080 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vnc.vencrypt_ca_certs          = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vnc.vencrypt_client_cert       = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vnc.vencrypt_client_key        = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] workarounds.disable_rootwrap   = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] workarounds.enable_numa_live_migration = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] workarounds.libvirt_disable_apic = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] wsgi.client_socket_timeout     = 900 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] wsgi.default_pool_size         = 1000 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] wsgi.keep_alive                = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] wsgi.max_header_line           = 16384 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] wsgi.ssl_ca_file               = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] wsgi.ssl_cert_file             = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] wsgi.ssl_key_file              = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] wsgi.tcp_keepidle              = 600 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] zvm.ca_file                    = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] zvm.cloud_connector_url        = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] zvm.reachable_timeout          = 300 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_policy.enforce_new_defaults = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_policy.enforce_scope      = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_policy.policy_default_rule = default {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] profiler.connection_string     = messaging:// {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] profiler.enabled               = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] profiler.es_doc_type           = notification {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] profiler.es_scroll_size        = 10000 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] profiler.es_scroll_time        = 2m {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] profiler.filter_error_trace    = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] profiler.hmac_keys             = **** {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] profiler.sentinel_service_name = mymaster {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] profiler.socket_timeout        = 0.1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] profiler.trace_requests        = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] profiler.trace_sqlalchemy      = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] profiler_jaeger.process_tags   = {} {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] profiler_jaeger.service_name_prefix = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] profiler_otlp.service_name_prefix = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] remote_debug.host              = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] remote_debug.port              = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_notifications.retry = -1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.auth_section        = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.auth_type           = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.cafile              = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.certfile            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.collect_timing      = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.connect_retries     = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.connect_retry_delay = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.endpoint_id         = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.endpoint_override   = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.insecure            = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.keyfile             = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.max_version         = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.min_version         = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.region_name         = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.service_name        = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.service_type        = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.split_loggers       = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.status_code_retries = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.status_code_retry_delay = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.timeout             = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.valid_interfaces    = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_limit.version             = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_reports.file_event_handler = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] oslo_reports.log_dir           = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vif_plug_ovs_privileged.group  = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] vif_plug_ovs_privileged.user   = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] os_vif_ovs.isolate_vif         = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] os_brick.lock_path             = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] privsep_osbrick.capabilities   = [21] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] privsep_osbrick.group          = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] privsep_osbrick.helper_command = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] privsep_osbrick.user           = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] nova_sys_admin.group           = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] nova_sys_admin.helper_command  = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] nova_sys_admin.user            = None {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG oslo_service.service [None req-76006f69-01eb-4027-bba1-b194dd134702 None None] ******************************************************************************** {{(pid=73917) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 26 19:02:44 user nova-compute[73917]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 26 19:02:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Starting native event thread {{(pid=73917) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Starting green dispatch thread {{(pid=73917) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Starting connection event dispatch thread {{(pid=73917) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Connecting to libvirt: qemu:///system {{(pid=73917) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f6ba9e3e7a0> {{(pid=73917) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Aug 26 19:02:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f6ba9e3e7a0> {{(pid=73917) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Aug 26 19:02:44 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Connection event '1' reason 'None'
Aug 26 19:02:44 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 19:02:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.mount [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Initialising _HostMountState generation 0 {{(pid=73917) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 26 19:02:52 user nova-compute[73917]: INFO nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Libvirt host capabilities <capabilities>
Aug 26 19:02:52 user nova-compute[73917]:   <host>
Aug 26 19:02:52 user nova-compute[73917]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 26 19:02:52 user nova-compute[73917]:     <cpu>
Aug 26 19:02:52 user nova-compute[73917]:       <arch>x86_64</arch>
Aug 26 19:02:52 user nova-compute[73917]:       <model>IvyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <vendor>Intel</vendor>
Aug 26 19:02:52 user nova-compute[73917]:       <microcode version='1070'/>
Aug 26 19:02:52 user nova-compute[73917]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 26 19:02:52 user nova-compute[73917]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature name='ss'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature name='vmx'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature name='pcid'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature name='osxsave'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature name='hypervisor'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature name='arat'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature name='tsc_adjust'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature name='md-clear'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature name='stibp'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature name='arch-capabilities'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature name='ssbd'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature name='invtsc'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature name='rsba'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature name='skip-l1dfl-vmentry'/>
Aug 26 19:02:52 user nova-compute[73917]:       <pages unit='KiB' size='4'/>
Aug 26 19:02:52 user nova-compute[73917]:       <pages unit='KiB' size='2048'/>
Aug 26 19:02:52 user nova-compute[73917]:     </cpu>
Aug 26 19:02:52 user nova-compute[73917]:     <power_management>
Aug 26 19:02:52 user nova-compute[73917]:       <suspend_mem/>
Aug 26 19:02:52 user nova-compute[73917]:       <suspend_disk/>
Aug 26 19:02:52 user nova-compute[73917]:       <suspend_hybrid/>
Aug 26 19:02:52 user nova-compute[73917]:     </power_management>
Aug 26 19:02:52 user nova-compute[73917]:     <iommu support='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     <migration_features>
Aug 26 19:02:52 user nova-compute[73917]:       <live/>
Aug 26 19:02:52 user nova-compute[73917]:       <uri_transports>
Aug 26 19:02:52 user nova-compute[73917]:         <uri_transport>tcp</uri_transport>
Aug 26 19:02:52 user nova-compute[73917]:         <uri_transport>rdma</uri_transport>
Aug 26 19:02:52 user nova-compute[73917]:       </uri_transports>
Aug 26 19:02:52 user nova-compute[73917]:     </migration_features>
Aug 26 19:02:52 user nova-compute[73917]:     <topology>
Aug 26 19:02:52 user nova-compute[73917]:       <cells num='2'>
Aug 26 19:02:52 user nova-compute[73917]:         <cell id='0'>
Aug 26 19:02:52 user nova-compute[73917]:           <memory unit='KiB'>8189224</memory>
Aug 26 19:02:52 user nova-compute[73917]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 26 19:02:52 user nova-compute[73917]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 19:02:52 user nova-compute[73917]:           <distances>
Aug 26 19:02:52 user nova-compute[73917]:             <sibling id='0' value='10'/>
Aug 26 19:02:52 user nova-compute[73917]:             <sibling id='1' value='20'/>
Aug 26 19:02:52 user nova-compute[73917]:           </distances>
Aug 26 19:02:52 user nova-compute[73917]:           <cpus num='6'>
Aug 26 19:02:52 user nova-compute[73917]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 26 19:02:52 user nova-compute[73917]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 26 19:02:52 user nova-compute[73917]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 26 19:02:52 user nova-compute[73917]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 26 19:02:52 user nova-compute[73917]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 26 19:02:52 user nova-compute[73917]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 26 19:02:52 user nova-compute[73917]:           </cpus>
Aug 26 19:02:52 user nova-compute[73917]:         </cell>
Aug 26 19:02:52 user nova-compute[73917]:         <cell id='1'>
Aug 26 19:02:52 user nova-compute[73917]:           <memory unit='KiB'>8206460</memory>
Aug 26 19:02:52 user nova-compute[73917]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 26 19:02:52 user nova-compute[73917]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 19:02:52 user nova-compute[73917]:           <distances>
Aug 26 19:02:52 user nova-compute[73917]:             <sibling id='0' value='20'/>
Aug 26 19:02:52 user nova-compute[73917]:             <sibling id='1' value='10'/>
Aug 26 19:02:52 user nova-compute[73917]:           </distances>
Aug 26 19:02:52 user nova-compute[73917]:           <cpus num='6'>
Aug 26 19:02:52 user nova-compute[73917]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 26 19:02:52 user nova-compute[73917]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 26 19:02:52 user nova-compute[73917]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 26 19:02:52 user nova-compute[73917]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 26 19:02:52 user nova-compute[73917]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 26 19:02:52 user nova-compute[73917]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 26 19:02:52 user nova-compute[73917]:           </cpus>
Aug 26 19:02:52 user nova-compute[73917]:         </cell>
Aug 26 19:02:52 user nova-compute[73917]:       </cells>
Aug 26 19:02:52 user nova-compute[73917]:     </topology>
Aug 26 19:02:52 user nova-compute[73917]:     <cache>
Aug 26 19:02:52 user nova-compute[73917]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 26 19:02:52 user nova-compute[73917]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 26 19:02:52 user nova-compute[73917]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 26 19:02:52 user nova-compute[73917]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 26 19:02:52 user nova-compute[73917]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 26 19:02:52 user nova-compute[73917]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 26 19:02:52 user nova-compute[73917]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 26 19:02:52 user nova-compute[73917]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 26 19:02:52 user nova-compute[73917]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 26 19:02:52 user nova-compute[73917]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 26 19:02:52 user nova-compute[73917]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 26 19:02:52 user nova-compute[73917]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 26 19:02:52 user nova-compute[73917]:     </cache>
Aug 26 19:02:52 user nova-compute[73917]:     <secmodel>
Aug 26 19:02:52 user nova-compute[73917]:       <model>apparmor</model>
Aug 26 19:02:52 user nova-compute[73917]:       <doi>0</doi>
Aug 26 19:02:52 user nova-compute[73917]:     </secmodel>
Aug 26 19:02:52 user nova-compute[73917]:     <secmodel>
Aug 26 19:02:52 user nova-compute[73917]:       <model>dac</model>
Aug 26 19:02:52 user nova-compute[73917]:       <doi>0</doi>
Aug 26 19:02:52 user nova-compute[73917]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 26 19:02:52 user nova-compute[73917]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 26 19:02:52 user nova-compute[73917]:     </secmodel>
Aug 26 19:02:52 user nova-compute[73917]:   </host>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='alpha'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>64</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>clipper</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='armv6l'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>32</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>spitz</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>nuri</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>kzm</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>sx1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>z2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>tosa</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>n810</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>n800</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>terrier</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>midway</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>microbit</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>verdex</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>highbank</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>akita</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>connex</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>collie</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='armv7l'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>32</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>spitz</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>nuri</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>kzm</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>sx1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>z2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>tosa</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>n810</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>n800</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>terrier</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>midway</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>microbit</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>verdex</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>highbank</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>akita</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>connex</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>collie</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='aarch64'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>64</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>spitz</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>nuri</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>kzm</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>sx1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>z2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>tosa</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>n810</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>n800</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>terrier</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>midway</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>microbit</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>verdex</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>raspi3b</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>highbank</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>akita</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>connex</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>collie</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <acpi default='on' toggle='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='cris'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>32</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='i686'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>32</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>isapc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>microvm</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='kvm'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <pae/>
Aug 26 19:02:52 user nova-compute[73917]:       <nonpae/>
Aug 26 19:02:52 user nova-compute[73917]:       <acpi default='on' toggle='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:       <apic default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='m68k'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>32</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>an5206</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>q800</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>next-cube</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='microblaze'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>32</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='microblazeel'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>32</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='mips'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>32</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='16'>malta</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='mipsel'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>32</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='16'>malta</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='mips64'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>64</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='16'>malta</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>pica61</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>magnum</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='mips64el'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>64</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='16'>malta</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>pica61</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>magnum</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='16'>boston</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='ppc'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>32</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mac99</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>40p</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>taihu</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='ppc64'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>64</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>taihu</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>40p</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mac99</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='ppc64le'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>64</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>taihu</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>40p</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>mac99</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='riscv32'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>32</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='8'>spike</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>opentitan</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='8'>virt</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='riscv64'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>64</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='8'>spike</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>shakti_c</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='8'>virt</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='s390x'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>64</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='sh4'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>32</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>shix</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>r2d</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='sh4eb'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>64</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>shix</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>r2d</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='sparc'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>32</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>SS-5</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>SS-20</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>LX</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>SS-4</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>SS-10</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>Voyager</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='sparc64'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>64</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>sun4u</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>niagara</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>sun4v</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='x86_64'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>64</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='1'>isapc</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>microvm</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='kvm'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <acpi default='on' toggle='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:       <apic default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='xtensa'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>32</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>sim</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>kc705</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>ml605</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>virt</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>lx200</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>lx60</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]:   <guest>
Aug 26 19:02:52 user nova-compute[73917]:     <os_type>hvm</os_type>
Aug 26 19:02:52 user nova-compute[73917]:     <arch name='xtensaeb'>
Aug 26 19:02:52 user nova-compute[73917]:       <wordsize>32</wordsize>
Aug 26 19:02:52 user nova-compute[73917]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='4'>sim</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>kc705</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>ml605</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>virt</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>lx200</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>lx60</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 19:02:52 user nova-compute[73917]:       <domain type='qemu'/>
Aug 26 19:02:52 user nova-compute[73917]:     </arch>
Aug 26 19:02:52 user nova-compute[73917]:     <features>
Aug 26 19:02:52 user nova-compute[73917]:       <cpuselection/>
Aug 26 19:02:52 user nova-compute[73917]:       <deviceboot/>
Aug 26 19:02:52 user nova-compute[73917]:       <disksnapshot default='on' toggle='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     </features>
Aug 26 19:02:52 user nova-compute[73917]:   </guest>
Aug 26 19:02:52 user nova-compute[73917]: </capabilities>
Aug 26 19:02:52 user nova-compute[73917]: 
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 26 19:02:52 user nova-compute[73917]: <domainCapabilities>
Aug 26 19:02:52 user nova-compute[73917]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 19:02:52 user nova-compute[73917]:   <domain>kvm</domain>
Aug 26 19:02:52 user nova-compute[73917]:   <machine>pc-q35-jammy</machine>
Aug 26 19:02:52 user nova-compute[73917]:   <arch>i686</arch>
Aug 26 19:02:52 user nova-compute[73917]:   <vcpu max='288'/>
Aug 26 19:02:52 user nova-compute[73917]:   <iothreads supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:   <os supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:     <enum name='firmware'/>
Aug 26 19:02:52 user nova-compute[73917]:     <loader supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='type'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>rom</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>pflash</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='readonly'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>yes</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>no</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='secure'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>no</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </loader>
Aug 26 19:02:52 user nova-compute[73917]:   </os>
Aug 26 19:02:52 user nova-compute[73917]:   <cpu>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='host-passthrough' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='hostPassthroughMigratable'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>off</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='maximum' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='maximumMigratable'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>on</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>off</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='host-model' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <vendor>Intel</vendor>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ss'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='vmx'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='pcid'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='hypervisor'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='arat'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='umip'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='md-clear'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='stibp'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ssbd'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ibpb'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ibrs'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='amd-stibp'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='disable' name='erms'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='disable' name='lm'/>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='custom' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>qemu64</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>qemu32</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>phenom</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium3</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium2</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>n270</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>kvm64</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>kvm32</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>coreduo</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>core2duo</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>athlon</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Westmere</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Snowridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>SandyBridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Penryn</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G5</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G4</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G3</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G2</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G1</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Nehalem</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>IvyBridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Icelake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-Rome</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-Milan</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Dhyana</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cooperlake</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Conroe</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>486</model>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:   </cpu>
Aug 26 19:02:52 user nova-compute[73917]:   <memoryBacking supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:     <enum name='sourceType'>
Aug 26 19:02:52 user nova-compute[73917]:       <value>file</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>anonymous</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>memfd</value>
Aug 26 19:02:52 user nova-compute[73917]:     </enum>
Aug 26 19:02:52 user nova-compute[73917]:   </memoryBacking>
Aug 26 19:02:52 user nova-compute[73917]:   <devices>
Aug 26 19:02:52 user nova-compute[73917]:     <disk supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='diskDevice'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>disk</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>cdrom</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>floppy</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>lun</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='bus'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>fdc</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>scsi</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>usb</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>sata</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-non-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </disk>
Aug 26 19:02:52 user nova-compute[73917]:     <graphics supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='type'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>sdl</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vnc</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>spice</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>egl-headless</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </graphics>
Aug 26 19:02:52 user nova-compute[73917]:     <video supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='modelType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vga</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>cirrus</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vmvga</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>qxl</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>none</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>bochs</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>ramfb</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </video>
Aug 26 19:02:52 user nova-compute[73917]:     <hostdev supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='mode'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>subsystem</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='startupPolicy'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>default</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>mandatory</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>requisite</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>optional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='subsysType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>usb</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>pci</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>scsi</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='capsType'/>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='pciBackend'/>
Aug 26 19:02:52 user nova-compute[73917]:     </hostdev>
Aug 26 19:02:52 user nova-compute[73917]:     <rng supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-non-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='backendModel'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>random</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>egd</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>builtin</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </rng>
Aug 26 19:02:52 user nova-compute[73917]:     <filesystem supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='driverType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>path</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>handle</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtiofs</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </filesystem>
Aug 26 19:02:52 user nova-compute[73917]:     <tpm supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>tpm-tis</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>tpm-crb</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='backendModel'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>passthrough</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>emulator</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </tpm>
Aug 26 19:02:52 user nova-compute[73917]:   </devices>
Aug 26 19:02:52 user nova-compute[73917]:   <features>
Aug 26 19:02:52 user nova-compute[73917]:     <gic supported='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     <vmcoreinfo supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <genid supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <backingStoreInput supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <backup supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <sev supported='no'/>
Aug 26 19:02:52 user nova-compute[73917]:   </features>
Aug 26 19:02:52 user nova-compute[73917]: </domainCapabilities>
Aug 26 19:02:52 user nova-compute[73917]:  {{(pid=73917) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 26 19:02:52 user nova-compute[73917]: <domainCapabilities>
Aug 26 19:02:52 user nova-compute[73917]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 19:02:52 user nova-compute[73917]:   <domain>kvm</domain>
Aug 26 19:02:52 user nova-compute[73917]:   <machine>pc-i440fx-6.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:   <arch>i686</arch>
Aug 26 19:02:52 user nova-compute[73917]:   <vcpu max='255'/>
Aug 26 19:02:52 user nova-compute[73917]:   <iothreads supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:   <os supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:     <enum name='firmware'/>
Aug 26 19:02:52 user nova-compute[73917]:     <loader supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='type'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>rom</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>pflash</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='readonly'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>yes</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>no</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='secure'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>no</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </loader>
Aug 26 19:02:52 user nova-compute[73917]:   </os>
Aug 26 19:02:52 user nova-compute[73917]:   <cpu>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='host-passthrough' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='hostPassthroughMigratable'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>off</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='maximum' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='maximumMigratable'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>on</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>off</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='host-model' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <vendor>Intel</vendor>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ss'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='vmx'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='pcid'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='hypervisor'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='arat'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='umip'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='md-clear'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='stibp'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ssbd'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ibpb'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ibrs'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='amd-stibp'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='disable' name='erms'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='disable' name='lm'/>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='custom' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>qemu64</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>qemu32</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>phenom</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium3</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium2</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>n270</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>kvm64</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>kvm32</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>coreduo</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>core2duo</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>athlon</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Westmere</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Snowridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>SandyBridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Penryn</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G5</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G4</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G3</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G2</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G1</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Nehalem</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>IvyBridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Icelake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-Rome</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-Milan</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Dhyana</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cooperlake</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Conroe</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>486</model>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:   </cpu>
Aug 26 19:02:52 user nova-compute[73917]:   <memoryBacking supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:     <enum name='sourceType'>
Aug 26 19:02:52 user nova-compute[73917]:       <value>file</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>anonymous</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>memfd</value>
Aug 26 19:02:52 user nova-compute[73917]:     </enum>
Aug 26 19:02:52 user nova-compute[73917]:   </memoryBacking>
Aug 26 19:02:52 user nova-compute[73917]:   <devices>
Aug 26 19:02:52 user nova-compute[73917]:     <disk supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='diskDevice'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>disk</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>cdrom</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>floppy</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>lun</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='bus'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>ide</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>fdc</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>scsi</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>usb</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>sata</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-non-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </disk>
Aug 26 19:02:52 user nova-compute[73917]:     <graphics supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='type'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>sdl</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vnc</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>spice</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>egl-headless</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </graphics>
Aug 26 19:02:52 user nova-compute[73917]:     <video supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='modelType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vga</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>cirrus</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vmvga</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>qxl</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>none</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>bochs</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>ramfb</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </video>
Aug 26 19:02:52 user nova-compute[73917]:     <hostdev supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='mode'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>subsystem</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='startupPolicy'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>default</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>mandatory</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>requisite</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>optional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='subsysType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>usb</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>pci</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>scsi</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='capsType'/>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='pciBackend'/>
Aug 26 19:02:52 user nova-compute[73917]:     </hostdev>
Aug 26 19:02:52 user nova-compute[73917]:     <rng supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-non-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='backendModel'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>random</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>egd</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>builtin</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </rng>
Aug 26 19:02:52 user nova-compute[73917]:     <filesystem supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='driverType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>path</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>handle</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtiofs</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </filesystem>
Aug 26 19:02:52 user nova-compute[73917]:     <tpm supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>tpm-tis</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>tpm-crb</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='backendModel'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>passthrough</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>emulator</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </tpm>
Aug 26 19:02:52 user nova-compute[73917]:   </devices>
Aug 26 19:02:52 user nova-compute[73917]:   <features>
Aug 26 19:02:52 user nova-compute[73917]:     <gic supported='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     <vmcoreinfo supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <genid supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <backingStoreInput supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <backup supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <sev supported='no'/>
Aug 26 19:02:52 user nova-compute[73917]:   </features>
Aug 26 19:02:52 user nova-compute[73917]: </domainCapabilities>
Aug 26 19:02:52 user nova-compute[73917]:  {{(pid=73917) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 26 19:02:52 user nova-compute[73917]: <domainCapabilities>
Aug 26 19:02:52 user nova-compute[73917]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 19:02:52 user nova-compute[73917]:   <domain>kvm</domain>
Aug 26 19:02:52 user nova-compute[73917]:   <machine>pc-i440fx-jammy</machine>
Aug 26 19:02:52 user nova-compute[73917]:   <arch>i686</arch>
Aug 26 19:02:52 user nova-compute[73917]:   <vcpu max='255'/>
Aug 26 19:02:52 user nova-compute[73917]:   <iothreads supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:   <os supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:     <enum name='firmware'/>
Aug 26 19:02:52 user nova-compute[73917]:     <loader supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='type'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>rom</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>pflash</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='readonly'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>yes</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>no</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='secure'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>no</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </loader>
Aug 26 19:02:52 user nova-compute[73917]:   </os>
Aug 26 19:02:52 user nova-compute[73917]:   <cpu>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='host-passthrough' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='hostPassthroughMigratable'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>off</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='maximum' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='maximumMigratable'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>on</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>off</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='host-model' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <vendor>Intel</vendor>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ss'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='vmx'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='pcid'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='hypervisor'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='arat'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='umip'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='md-clear'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='stibp'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ssbd'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ibpb'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ibrs'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='amd-stibp'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='disable' name='erms'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='disable' name='lm'/>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='custom' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>qemu64</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>qemu32</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>phenom</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium3</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium2</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>n270</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>kvm64</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>kvm32</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>coreduo</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>core2duo</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>athlon</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Westmere</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Snowridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>SandyBridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Penryn</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G5</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G4</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G3</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G2</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G1</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Nehalem</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>IvyBridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Icelake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-Rome</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-Milan</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Dhyana</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cooperlake</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Conroe</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>486</model>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:   </cpu>
Aug 26 19:02:52 user nova-compute[73917]:   <memoryBacking supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:     <enum name='sourceType'>
Aug 26 19:02:52 user nova-compute[73917]:       <value>file</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>anonymous</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>memfd</value>
Aug 26 19:02:52 user nova-compute[73917]:     </enum>
Aug 26 19:02:52 user nova-compute[73917]:   </memoryBacking>
Aug 26 19:02:52 user nova-compute[73917]:   <devices>
Aug 26 19:02:52 user nova-compute[73917]:     <disk supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='diskDevice'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>disk</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>cdrom</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>floppy</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>lun</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='bus'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>ide</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>fdc</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>scsi</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>usb</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>sata</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-non-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </disk>
Aug 26 19:02:52 user nova-compute[73917]:     <graphics supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='type'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>sdl</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vnc</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>spice</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>egl-headless</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </graphics>
Aug 26 19:02:52 user nova-compute[73917]:     <video supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='modelType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vga</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>cirrus</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vmvga</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>qxl</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>none</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>bochs</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>ramfb</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </video>
Aug 26 19:02:52 user nova-compute[73917]:     <hostdev supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='mode'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>subsystem</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='startupPolicy'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>default</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>mandatory</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>requisite</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>optional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='subsysType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>usb</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>pci</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>scsi</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='capsType'/>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='pciBackend'/>
Aug 26 19:02:52 user nova-compute[73917]:     </hostdev>
Aug 26 19:02:52 user nova-compute[73917]:     <rng supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-non-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='backendModel'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>random</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>egd</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>builtin</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </rng>
Aug 26 19:02:52 user nova-compute[73917]:     <filesystem supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='driverType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>path</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>handle</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtiofs</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </filesystem>
Aug 26 19:02:52 user nova-compute[73917]:     <tpm supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>tpm-tis</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>tpm-crb</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='backendModel'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>passthrough</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>emulator</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </tpm>
Aug 26 19:02:52 user nova-compute[73917]:   </devices>
Aug 26 19:02:52 user nova-compute[73917]:   <features>
Aug 26 19:02:52 user nova-compute[73917]:     <gic supported='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     <vmcoreinfo supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <genid supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <backingStoreInput supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <backup supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <sev supported='no'/>
Aug 26 19:02:52 user nova-compute[73917]:   </features>
Aug 26 19:02:52 user nova-compute[73917]: </domainCapabilities>
Aug 26 19:02:52 user nova-compute[73917]:  {{(pid=73917) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 26 19:02:52 user nova-compute[73917]: <domainCapabilities>
Aug 26 19:02:52 user nova-compute[73917]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 19:02:52 user nova-compute[73917]:   <domain>kvm</domain>
Aug 26 19:02:52 user nova-compute[73917]:   <machine>pc-q35-6.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:   <arch>i686</arch>
Aug 26 19:02:52 user nova-compute[73917]:   <vcpu max='288'/>
Aug 26 19:02:52 user nova-compute[73917]:   <iothreads supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:   <os supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:     <enum name='firmware'/>
Aug 26 19:02:52 user nova-compute[73917]:     <loader supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='type'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>rom</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>pflash</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='readonly'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>yes</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>no</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='secure'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>no</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </loader>
Aug 26 19:02:52 user nova-compute[73917]:   </os>
Aug 26 19:02:52 user nova-compute[73917]:   <cpu>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='host-passthrough' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='hostPassthroughMigratable'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>off</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='maximum' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='maximumMigratable'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>on</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>off</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='host-model' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <vendor>Intel</vendor>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ss'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='vmx'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='pcid'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='hypervisor'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='arat'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='umip'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='md-clear'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='stibp'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ssbd'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ibpb'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ibrs'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='amd-stibp'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='disable' name='erms'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='disable' name='lm'/>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='custom' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>qemu64</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>qemu32</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>phenom</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium3</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium2</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>n270</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>kvm64</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>kvm32</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>coreduo</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>core2duo</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>athlon</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Westmere</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Snowridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>SandyBridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Penryn</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G5</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G4</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G3</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G2</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G1</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Nehalem</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>IvyBridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Icelake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-Rome</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-Milan</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Dhyana</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cooperlake</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Conroe</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>486</model>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:   </cpu>
Aug 26 19:02:52 user nova-compute[73917]:   <memoryBacking supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:     <enum name='sourceType'>
Aug 26 19:02:52 user nova-compute[73917]:       <value>file</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>anonymous</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>memfd</value>
Aug 26 19:02:52 user nova-compute[73917]:     </enum>
Aug 26 19:02:52 user nova-compute[73917]:   </memoryBacking>
Aug 26 19:02:52 user nova-compute[73917]:   <devices>
Aug 26 19:02:52 user nova-compute[73917]:     <disk supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='diskDevice'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>disk</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>cdrom</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>floppy</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>lun</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='bus'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>fdc</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>scsi</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>usb</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>sata</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-non-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </disk>
Aug 26 19:02:52 user nova-compute[73917]:     <graphics supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='type'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>sdl</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vnc</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>spice</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>egl-headless</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </graphics>
Aug 26 19:02:52 user nova-compute[73917]:     <video supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='modelType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vga</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>cirrus</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vmvga</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>qxl</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>none</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>bochs</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>ramfb</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </video>
Aug 26 19:02:52 user nova-compute[73917]:     <hostdev supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='mode'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>subsystem</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='startupPolicy'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>default</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>mandatory</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>requisite</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>optional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='subsysType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>usb</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>pci</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>scsi</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='capsType'/>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='pciBackend'/>
Aug 26 19:02:52 user nova-compute[73917]:     </hostdev>
Aug 26 19:02:52 user nova-compute[73917]:     <rng supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-non-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='backendModel'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>random</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>egd</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>builtin</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </rng>
Aug 26 19:02:52 user nova-compute[73917]:     <filesystem supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='driverType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>path</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>handle</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtiofs</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </filesystem>
Aug 26 19:02:52 user nova-compute[73917]:     <tpm supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>tpm-tis</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>tpm-crb</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='backendModel'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>passthrough</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>emulator</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </tpm>
Aug 26 19:02:52 user nova-compute[73917]:   </devices>
Aug 26 19:02:52 user nova-compute[73917]:   <features>
Aug 26 19:02:52 user nova-compute[73917]:     <gic supported='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     <vmcoreinfo supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <genid supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <backingStoreInput supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <backup supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <sev supported='no'/>
Aug 26 19:02:52 user nova-compute[73917]:   </features>
Aug 26 19:02:52 user nova-compute[73917]: </domainCapabilities>
Aug 26 19:02:52 user nova-compute[73917]:  {{(pid=73917) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 26 19:02:52 user nova-compute[73917]: <domainCapabilities>
Aug 26 19:02:52 user nova-compute[73917]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 19:02:52 user nova-compute[73917]:   <domain>kvm</domain>
Aug 26 19:02:52 user nova-compute[73917]:   <machine>pc-q35-jammy</machine>
Aug 26 19:02:52 user nova-compute[73917]:   <arch>x86_64</arch>
Aug 26 19:02:52 user nova-compute[73917]:   <vcpu max='288'/>
Aug 26 19:02:52 user nova-compute[73917]:   <iothreads supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:   <os supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:     <enum name='firmware'>
Aug 26 19:02:52 user nova-compute[73917]:       <value>efi</value>
Aug 26 19:02:52 user nova-compute[73917]:     </enum>
Aug 26 19:02:52 user nova-compute[73917]:     <loader supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='type'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>rom</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>pflash</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='readonly'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>yes</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>no</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='secure'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>yes</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>no</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </loader>
Aug 26 19:02:52 user nova-compute[73917]:   </os>
Aug 26 19:02:52 user nova-compute[73917]:   <cpu>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='host-passthrough' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='hostPassthroughMigratable'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>on</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>off</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='maximum' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='maximumMigratable'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>on</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>off</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='host-model' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <vendor>Intel</vendor>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ss'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='vmx'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='pcid'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='hypervisor'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='arat'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='umip'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='md-clear'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='stibp'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ssbd'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='invtsc'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ibpb'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ibrs'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='amd-stibp'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='rsba'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='disable' name='erms'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='custom' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>qemu64</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>qemu32</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>phenom</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium3</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium2</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>n270</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>kvm64</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>kvm32</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>coreduo</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>core2duo</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>athlon</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Westmere</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Snowridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>SandyBridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Penryn</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G5</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G4</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G3</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G2</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Opteron_G1</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Nehalem</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>IvyBridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Icelake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-Rome</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-Milan</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Dhyana</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cooperlake</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Conroe</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>486</model>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:   </cpu>
Aug 26 19:02:52 user nova-compute[73917]:   <memoryBacking supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:     <enum name='sourceType'>
Aug 26 19:02:52 user nova-compute[73917]:       <value>file</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>anonymous</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>memfd</value>
Aug 26 19:02:52 user nova-compute[73917]:     </enum>
Aug 26 19:02:52 user nova-compute[73917]:   </memoryBacking>
Aug 26 19:02:52 user nova-compute[73917]:   <devices>
Aug 26 19:02:52 user nova-compute[73917]:     <disk supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='diskDevice'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>disk</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>cdrom</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>floppy</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>lun</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='bus'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>fdc</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>scsi</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>usb</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>sata</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-non-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </disk>
Aug 26 19:02:52 user nova-compute[73917]:     <graphics supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='type'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>sdl</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vnc</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>spice</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>egl-headless</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </graphics>
Aug 26 19:02:52 user nova-compute[73917]:     <video supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='modelType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vga</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>cirrus</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vmvga</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>qxl</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>none</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>bochs</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>ramfb</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </video>
Aug 26 19:02:52 user nova-compute[73917]:     <hostdev supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='mode'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>subsystem</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='startupPolicy'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>default</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>mandatory</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>requisite</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>optional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='subsysType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>usb</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>pci</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>scsi</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='capsType'/>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='pciBackend'/>
Aug 26 19:02:52 user nova-compute[73917]:     </hostdev>
Aug 26 19:02:52 user nova-compute[73917]:     <rng supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-non-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='backendModel'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>random</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>egd</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>builtin</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </rng>
Aug 26 19:02:52 user nova-compute[73917]:     <filesystem supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='driverType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>path</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>handle</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtiofs</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </filesystem>
Aug 26 19:02:52 user nova-compute[73917]:     <tpm supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>tpm-tis</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>tpm-crb</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='backendModel'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>passthrough</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>emulator</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </tpm>
Aug 26 19:02:52 user nova-compute[73917]:   </devices>
Aug 26 19:02:52 user nova-compute[73917]:   <features>
Aug 26 19:02:52 user nova-compute[73917]:     <gic supported='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     <vmcoreinfo supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <genid supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <backingStoreInput supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <backup supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <sev supported='no'/>
Aug 26 19:02:52 user nova-compute[73917]:   </features>
Aug 26 19:02:52 user nova-compute[73917]: </domainCapabilities>
Aug 26 19:02:52 user nova-compute[73917]:  {{(pid=73917) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 26 19:02:52 user nova-compute[73917]: <domainCapabilities>
Aug 26 19:02:52 user nova-compute[73917]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 19:02:52 user nova-compute[73917]:   <domain>kvm</domain>
Aug 26 19:02:52 user nova-compute[73917]:   <machine>pc-i440fx-6.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:   <arch>x86_64</arch>
Aug 26 19:02:52 user nova-compute[73917]:   <vcpu max='255'/>
Aug 26 19:02:52 user nova-compute[73917]:   <iothreads supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:   <os supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:     <enum name='firmware'>
Aug 26 19:02:52 user nova-compute[73917]:       <value>efi</value>
Aug 26 19:02:52 user nova-compute[73917]:     </enum>
Aug 26 19:02:52 user nova-compute[73917]:     <loader supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='type'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>rom</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>pflash</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='readonly'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>yes</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>no</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='secure'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>no</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </loader>
Aug 26 19:02:52 user nova-compute[73917]:   </os>
Aug 26 19:02:52 user nova-compute[73917]:   <cpu>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='host-passthrough' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='hostPassthroughMigratable'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>on</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>off</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='maximum' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='maximumMigratable'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>on</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>off</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='host-model' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <vendor>Intel</vendor>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ss'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='vmx'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='pcid'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='hypervisor'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='arat'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='umip'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='md-clear'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='stibp'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ssbd'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='invtsc'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ibpb'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ibrs'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='amd-stibp'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='rsba'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='disable' name='erms'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='custom' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>qemu64</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>qemu32</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>phenom</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium3</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium2</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>n270</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>kvm64</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>kvm32</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>coreduo</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>core2duo</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>athlon</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Westmere</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Snowridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>SandyBridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Penryn</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G5</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G4</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G3</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G2</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Opteron_G1</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Nehalem</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>IvyBridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Icelake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-Rome</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-Milan</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Dhyana</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cooperlake</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Conroe</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>486</model>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:   </cpu>
Aug 26 19:02:52 user nova-compute[73917]:   <memoryBacking supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:     <enum name='sourceType'>
Aug 26 19:02:52 user nova-compute[73917]:       <value>file</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>anonymous</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>memfd</value>
Aug 26 19:02:52 user nova-compute[73917]:     </enum>
Aug 26 19:02:52 user nova-compute[73917]:   </memoryBacking>
Aug 26 19:02:52 user nova-compute[73917]:   <devices>
Aug 26 19:02:52 user nova-compute[73917]:     <disk supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='diskDevice'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>disk</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>cdrom</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>floppy</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>lun</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='bus'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>ide</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>fdc</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>scsi</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>usb</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>sata</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-non-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </disk>
Aug 26 19:02:52 user nova-compute[73917]:     <graphics supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='type'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>sdl</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vnc</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>spice</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>egl-headless</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </graphics>
Aug 26 19:02:52 user nova-compute[73917]:     <video supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='modelType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vga</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>cirrus</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vmvga</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>qxl</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>none</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>bochs</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>ramfb</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </video>
Aug 26 19:02:52 user nova-compute[73917]:     <hostdev supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='mode'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>subsystem</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='startupPolicy'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>default</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>mandatory</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>requisite</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>optional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='subsysType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>usb</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>pci</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>scsi</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='capsType'/>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='pciBackend'/>
Aug 26 19:02:52 user nova-compute[73917]:     </hostdev>
Aug 26 19:02:52 user nova-compute[73917]:     <rng supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-non-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='backendModel'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>random</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>egd</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>builtin</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </rng>
Aug 26 19:02:52 user nova-compute[73917]:     <filesystem supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='driverType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>path</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>handle</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtiofs</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </filesystem>
Aug 26 19:02:52 user nova-compute[73917]:     <tpm supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>tpm-tis</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>tpm-crb</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='backendModel'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>passthrough</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>emulator</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </tpm>
Aug 26 19:02:52 user nova-compute[73917]:   </devices>
Aug 26 19:02:52 user nova-compute[73917]:   <features>
Aug 26 19:02:52 user nova-compute[73917]:     <gic supported='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     <vmcoreinfo supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <genid supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <backingStoreInput supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <backup supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <sev supported='no'/>
Aug 26 19:02:52 user nova-compute[73917]:   </features>
Aug 26 19:02:52 user nova-compute[73917]: </domainCapabilities>
Aug 26 19:02:52 user nova-compute[73917]:  {{(pid=73917) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 26 19:02:52 user nova-compute[73917]: <domainCapabilities>
Aug 26 19:02:52 user nova-compute[73917]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 19:02:52 user nova-compute[73917]:   <domain>kvm</domain>
Aug 26 19:02:52 user nova-compute[73917]:   <machine>pc-i440fx-jammy</machine>
Aug 26 19:02:52 user nova-compute[73917]:   <arch>x86_64</arch>
Aug 26 19:02:52 user nova-compute[73917]:   <vcpu max='255'/>
Aug 26 19:02:52 user nova-compute[73917]:   <iothreads supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:   <os supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:     <enum name='firmware'>
Aug 26 19:02:52 user nova-compute[73917]:       <value>efi</value>
Aug 26 19:02:52 user nova-compute[73917]:     </enum>
Aug 26 19:02:52 user nova-compute[73917]:     <loader supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='type'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>rom</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>pflash</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='readonly'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>yes</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>no</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='secure'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>no</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </loader>
Aug 26 19:02:52 user nova-compute[73917]:   </os>
Aug 26 19:02:52 user nova-compute[73917]:   <cpu>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='host-passthrough' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='hostPassthroughMigratable'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>on</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>off</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='maximum' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='maximumMigratable'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>on</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>off</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='host-model' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <vendor>Intel</vendor>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ss'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='vmx'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='pcid'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='hypervisor'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='arat'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='umip'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='md-clear'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='stibp'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ssbd'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='invtsc'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ibpb'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ibrs'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='amd-stibp'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='rsba'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='disable' name='erms'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='custom' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>qemu64</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>qemu32</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>phenom</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium3</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium2</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>n270</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>kvm64</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>kvm32</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>coreduo</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>core2duo</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>athlon</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Westmere</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Snowridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>SandyBridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Penryn</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G5</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G4</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G3</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G2</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Opteron_G1</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Nehalem</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>IvyBridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Icelake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-Rome</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-Milan</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Dhyana</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cooperlake</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Conroe</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>486</model>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:   </cpu>
Aug 26 19:02:52 user nova-compute[73917]:   <memoryBacking supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:     <enum name='sourceType'>
Aug 26 19:02:52 user nova-compute[73917]:       <value>file</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>anonymous</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>memfd</value>
Aug 26 19:02:52 user nova-compute[73917]:     </enum>
Aug 26 19:02:52 user nova-compute[73917]:   </memoryBacking>
Aug 26 19:02:52 user nova-compute[73917]:   <devices>
Aug 26 19:02:52 user nova-compute[73917]:     <disk supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='diskDevice'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>disk</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>cdrom</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>floppy</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>lun</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='bus'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>ide</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>fdc</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>scsi</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>usb</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>sata</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-non-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </disk>
Aug 26 19:02:52 user nova-compute[73917]:     <graphics supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='type'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>sdl</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vnc</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>spice</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>egl-headless</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </graphics>
Aug 26 19:02:52 user nova-compute[73917]:     <video supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='modelType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vga</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>cirrus</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vmvga</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>qxl</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>none</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>bochs</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>ramfb</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </video>
Aug 26 19:02:52 user nova-compute[73917]:     <hostdev supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='mode'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>subsystem</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='startupPolicy'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>default</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>mandatory</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>requisite</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>optional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='subsysType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>usb</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>pci</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>scsi</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='capsType'/>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='pciBackend'/>
Aug 26 19:02:52 user nova-compute[73917]:     </hostdev>
Aug 26 19:02:52 user nova-compute[73917]:     <rng supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-non-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='backendModel'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>random</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>egd</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>builtin</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </rng>
Aug 26 19:02:52 user nova-compute[73917]:     <filesystem supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='driverType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>path</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>handle</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtiofs</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </filesystem>
Aug 26 19:02:52 user nova-compute[73917]:     <tpm supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>tpm-tis</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>tpm-crb</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='backendModel'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>passthrough</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>emulator</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </tpm>
Aug 26 19:02:52 user nova-compute[73917]:   </devices>
Aug 26 19:02:52 user nova-compute[73917]:   <features>
Aug 26 19:02:52 user nova-compute[73917]:     <gic supported='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     <vmcoreinfo supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <genid supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <backingStoreInput supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <backup supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <sev supported='no'/>
Aug 26 19:02:52 user nova-compute[73917]:   </features>
Aug 26 19:02:52 user nova-compute[73917]: </domainCapabilities>
Aug 26 19:02:52 user nova-compute[73917]:  {{(pid=73917) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 26 19:02:52 user nova-compute[73917]: <domainCapabilities>
Aug 26 19:02:52 user nova-compute[73917]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 19:02:52 user nova-compute[73917]:   <domain>kvm</domain>
Aug 26 19:02:52 user nova-compute[73917]:   <machine>pc-q35-6.2</machine>
Aug 26 19:02:52 user nova-compute[73917]:   <arch>x86_64</arch>
Aug 26 19:02:52 user nova-compute[73917]:   <vcpu max='288'/>
Aug 26 19:02:52 user nova-compute[73917]:   <iothreads supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:   <os supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:     <enum name='firmware'>
Aug 26 19:02:52 user nova-compute[73917]:       <value>efi</value>
Aug 26 19:02:52 user nova-compute[73917]:     </enum>
Aug 26 19:02:52 user nova-compute[73917]:     <loader supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='type'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>rom</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>pflash</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='readonly'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>yes</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>no</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='secure'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>yes</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>no</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </loader>
Aug 26 19:02:52 user nova-compute[73917]:   </os>
Aug 26 19:02:52 user nova-compute[73917]:   <cpu>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='host-passthrough' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='hostPassthroughMigratable'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>on</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>off</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='maximum' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='maximumMigratable'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>on</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>off</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='host-model' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <vendor>Intel</vendor>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ss'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='vmx'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='pcid'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='hypervisor'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='arat'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='umip'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='md-clear'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='stibp'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ssbd'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='invtsc'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ibpb'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='ibrs'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='amd-stibp'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='rsba'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='disable' name='erms'/>
Aug 26 19:02:52 user nova-compute[73917]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:     <mode name='custom' supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>qemu64</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>qemu32</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>phenom</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium3</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium2</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>pentium</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>n270</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>kvm64</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>kvm32</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>coreduo</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>core2duo</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>athlon</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Westmere</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Snowridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Skylake-Client</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>SandyBridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Penryn</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G5</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G4</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G3</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Opteron_G2</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Opteron_G1</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Nehalem</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>IvyBridge</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Icelake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Haswell</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-Rome</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-Milan</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>EPYC</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Dhyana</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cooperlake</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>Conroe</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='no'>Broadwell</model>
Aug 26 19:02:52 user nova-compute[73917]:       <model usable='yes'>486</model>
Aug 26 19:02:52 user nova-compute[73917]:     </mode>
Aug 26 19:02:52 user nova-compute[73917]:   </cpu>
Aug 26 19:02:52 user nova-compute[73917]:   <memoryBacking supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:     <enum name='sourceType'>
Aug 26 19:02:52 user nova-compute[73917]:       <value>file</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>anonymous</value>
Aug 26 19:02:52 user nova-compute[73917]:       <value>memfd</value>
Aug 26 19:02:52 user nova-compute[73917]:     </enum>
Aug 26 19:02:52 user nova-compute[73917]:   </memoryBacking>
Aug 26 19:02:52 user nova-compute[73917]:   <devices>
Aug 26 19:02:52 user nova-compute[73917]:     <disk supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='diskDevice'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>disk</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>cdrom</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>floppy</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>lun</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='bus'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>fdc</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>scsi</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>usb</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>sata</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-non-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </disk>
Aug 26 19:02:52 user nova-compute[73917]:     <graphics supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='type'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>sdl</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vnc</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>spice</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>egl-headless</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </graphics>
Aug 26 19:02:52 user nova-compute[73917]:     <video supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='modelType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vga</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>cirrus</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>vmvga</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>qxl</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>none</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>bochs</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>ramfb</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </video>
Aug 26 19:02:52 user nova-compute[73917]:     <hostdev supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='mode'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>subsystem</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='startupPolicy'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>default</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>mandatory</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>requisite</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>optional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='subsysType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>usb</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>pci</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>scsi</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='capsType'/>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='pciBackend'/>
Aug 26 19:02:52 user nova-compute[73917]:     </hostdev>
Aug 26 19:02:52 user nova-compute[73917]:     <rng supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtio-non-transitional</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='backendModel'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>random</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>egd</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>builtin</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </rng>
Aug 26 19:02:52 user nova-compute[73917]:     <filesystem supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='driverType'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>path</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>handle</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>virtiofs</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </filesystem>
Aug 26 19:02:52 user nova-compute[73917]:     <tpm supported='yes'>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='model'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>tpm-tis</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>tpm-crb</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:       <enum name='backendModel'>
Aug 26 19:02:52 user nova-compute[73917]:         <value>passthrough</value>
Aug 26 19:02:52 user nova-compute[73917]:         <value>emulator</value>
Aug 26 19:02:52 user nova-compute[73917]:       </enum>
Aug 26 19:02:52 user nova-compute[73917]:     </tpm>
Aug 26 19:02:52 user nova-compute[73917]:   </devices>
Aug 26 19:02:52 user nova-compute[73917]:   <features>
Aug 26 19:02:52 user nova-compute[73917]:     <gic supported='no'/>
Aug 26 19:02:52 user nova-compute[73917]:     <vmcoreinfo supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <genid supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <backingStoreInput supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <backup supported='yes'/>
Aug 26 19:02:52 user nova-compute[73917]:     <sev supported='no'/>
Aug 26 19:02:52 user nova-compute[73917]:   </features>
Aug 26 19:02:52 user nova-compute[73917]: </domainCapabilities>
Aug 26 19:02:52 user nova-compute[73917]:  {{(pid=73917) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73917) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73917) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Checking secure boot support for host arch (x86_64) {{(pid=73917) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 19:02:52 user nova-compute[73917]: INFO nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Secure Boot support detected
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] cpu compare xml: <cpu match="exact">
Aug 26 19:02:52 user nova-compute[73917]:   <model>Nehalem</model>
Aug 26 19:02:52 user nova-compute[73917]: </cpu>
Aug 26 19:02:52 user nova-compute[73917]:  {{(pid=73917) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 26 19:02:52 user nova-compute[73917]: INFO nova.virt.node [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Generated node identity d90ad23a-e063-4f0d-8341-c34e0141d16a
Aug 26 19:02:52 user nova-compute[73917]: INFO nova.virt.node [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Wrote node identity d90ad23a-e063-4f0d-8341-c34e0141d16a to /opt/stack/data/nova/compute_id
Aug 26 19:02:52 user nova-compute[73917]: WARNING nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Compute nodes ['d90ad23a-e063-4f0d-8341-c34e0141d16a'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 26 19:02:52 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 26 19:02:52 user nova-compute[73917]: WARNING nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 19:02:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:02:52 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:02:52 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Hypervisor/Node resource view: name=user free_ram=10851MB free_disk=26.25145721435547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:02:52 user nova-compute[73917]: WARNING nova.compute.resource_tracker [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] No compute node record for user:d90ad23a-e063-4f0d-8341-c34e0141d16a: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host d90ad23a-e063-4f0d-8341-c34e0141d16a could not be found.
Aug 26 19:02:52 user nova-compute[73917]: INFO nova.compute.resource_tracker [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Compute node record created for user:user with uuid: d90ad23a-e063-4f0d-8341-c34e0141d16a
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:02:52 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:02:53 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [req-460fbb43-427d-4541-9f10-7c8db674f62f] Created resource provider record via placement API for resource provider with UUID d90ad23a-e063-4f0d-8341-c34e0141d16a and name user.
Aug 26 19:02:53 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73917) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 26 19:02:53 user nova-compute[73917]: INFO nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] kernel doesn't support AMD SEV
Aug 26 19:02:53 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Updating inventory in ProviderTree for provider d90ad23a-e063-4f0d-8341-c34e0141d16a with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 19:02:53 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:02:53 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Libvirt baseline CPU <cpu>
Aug 26 19:02:53 user nova-compute[73917]:   <arch>x86_64</arch>
Aug 26 19:02:53 user nova-compute[73917]:   <model>Nehalem</model>
Aug 26 19:02:53 user nova-compute[73917]:   <vendor>Intel</vendor>
Aug 26 19:02:53 user nova-compute[73917]:   <topology sockets="6" cores="1" threads="1"/>
Aug 26 19:02:53 user nova-compute[73917]: </cpu>
Aug 26 19:02:53 user nova-compute[73917]:  {{(pid=73917) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 26 19:02:53 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Updated inventory for provider d90ad23a-e063-4f0d-8341-c34e0141d16a with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 26 19:02:53 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Updating resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a generation from 0 to 1 during operation: update_inventory {{(pid=73917) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 19:02:53 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Updating inventory in ProviderTree for provider d90ad23a-e063-4f0d-8341-c34e0141d16a with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 19:02:53 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Updating resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a generation from 1 to 2 during operation: update_traits {{(pid=73917) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 19:02:53 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:02:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.589s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:02:53 user nova-compute[73917]: DEBUG nova.service [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Creating RPC server for service compute {{(pid=73917) start /opt/stack/nova/nova/service.py:182}}
Aug 26 19:02:53 user nova-compute[73917]: DEBUG nova.service [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Join ServiceGroup membership for this service compute {{(pid=73917) start /opt/stack/nova/nova/service.py:199}}
Aug 26 19:02:53 user nova-compute[73917]: DEBUG nova.servicegroup.drivers.db [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73917) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Didn't find any instances for network info cache update. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:03:49 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:03:49 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:03:49 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=10202MB free_disk=26.155075073242188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:03:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:04:44 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:04:44 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:04:44 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:04:45 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:04:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:04:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:04:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:04:45 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:04:45 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:04:45 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:04:45 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=10173MB free_disk=26.201221466064453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:04:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:04:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:04:45 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:04:45 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:04:45 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:04:45 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:04:45 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:04:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:04:46 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:04:46 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:04:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:04:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:04:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Didn't find any instances for network info cache update. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 19:04:46 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:04:46 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:04:46 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:04:46 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:04:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:05:44 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:05:45 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:05:46 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:05:46 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:05:47 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:05:47 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:05:47 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:05:47 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:05:47 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:05:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:05:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:05:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:05:47 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:05:47 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:05:47 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:05:47 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=10136MB free_disk=25.98542022705078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:05:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:05:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:05:47 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:05:47 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:05:47 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:05:47 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:05:47 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:05:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.122s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:05:48 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:05:48 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:05:48 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:05:48 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Didn't find any instances for network info cache update. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 19:06:46 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:06:46 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:06:47 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:06:47 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:06:47 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:06:48 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:06:48 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:06:48 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:06:48 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:06:48 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Didn't find any instances for network info cache update. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 19:06:48 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:06:48 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:06:48 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:06:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:06:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:06:49 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:06:49 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:06:49 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:06:49 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=9461MB free_disk=26.008251190185547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:06:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:49 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:06:49 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:06:49 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:06:49 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:06:49 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:06:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:06:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:06:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:53 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:06:53 user nova-compute[73917]: INFO nova.compute.claims [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Claim successful on node user
Aug 26 19:06:53 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:06:53 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:06:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:06:53 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:06:53 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:06:53 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:06:53 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:06:53 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:06:54 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:06:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:06:54 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Creating image(s)
Aug 26 19:06:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "/opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "/opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "/opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:06:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2.part --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:54 user nova-compute[73917]: DEBUG nova.policy [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c64a5d226b8b4d60af840d49315bf60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b291bbf9aedc4414a1ab402602849140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:06:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2.part --force-share --output=json" returned: 0 in 0.207s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:54 user nova-compute[73917]: DEBUG nova.virt.images [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] 7a0152a1-b7ea-410d-a483-7d6785711f32 was qcow2, converting to raw {{(pid=73917) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 19:06:54 user nova-compute[73917]: DEBUG nova.privsep.utils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73917) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 19:06:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2.part /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2.converted {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2.part /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2.converted" returned: 0 in 0.258s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2.converted --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.256s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:06:55 user nova-compute[73917]: INFO oslo.privsep.daemon [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpev5__as2/privsep.sock']
Aug 26 19:06:55 user sudo[83139]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpev5__as2/privsep.sock
Aug 26 19:06:55 user sudo[83139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 19:06:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:06:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:06:55 user nova-compute[73917]: INFO nova.compute.claims [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Claim successful on node user
Aug 26 19:06:55 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:06:55 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:06:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:06:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:06:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:06:56 user nova-compute[73917]: DEBUG nova.network.neutron [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:06:56 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:06:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:06:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:06:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:06:56 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Creating image(s)
Aug 26 19:06:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "/opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "/opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:06:56 user nova-compute[73917]: DEBUG nova.policy [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '118080e0f2fe4533a25e002e894b99f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1298aa7a6ca478fb973d5a6d7bea7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:06:56 user sudo[83139]: pam_unix(sudo:session): session closed for user root
Aug 26 19:06:56 user nova-compute[73917]: INFO oslo.privsep.daemon [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Spawned new privsep daemon via rootwrap
Aug 26 19:06:56 user nova-compute[73917]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 19:06:56 user nova-compute[73917]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 19:06:56 user nova-compute[73917]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 26 19:06:56 user nova-compute[73917]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83143
Aug 26 19:06:56 user nova-compute[73917]: WARNING oslo_privsep.priv_context [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] privsep daemon already running
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.211s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.211s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "fd801f18-34b6-4682-8d43-edf82bd216c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk 1073741824" returned: 0 in 0.052s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.243s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG nova.compute.manager [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Acquiring lock "ce383b5a-c726-4d82-b0e3-be6ac6659428" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "ce383b5a-c726-4d82-b0e3-be6ac6659428" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.232s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.243s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:06:57 user nova-compute[73917]: INFO nova.compute.claims [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Claim successful on node user
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk 1073741824" returned: 0 in 0.056s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Successfully created port: 70707344-848e-4e9b-baf4-6cfbb4737fb8 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Cannot resize image /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Ensure instance console log exists: /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.211s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.351s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:06:58 user nova-compute[73917]: INFO nova.compute.claims [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Claim successful on node user
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Cannot resize image /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Ensure instance console log exists: /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.network.neutron [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:06:58 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:06:58 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Creating image(s)
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "/opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "/opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.network.neutron [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:06:58 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.172s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:06:58 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Creating image(s)
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "/opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "/opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.168s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:58 user nova-compute[73917]: DEBUG nova.policy [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '118080e0f2fe4533a25e002e894b99f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1298aa7a6ca478fb973d5a6d7bea7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk 1073741824" returned: 0 in 0.041s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.176s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG nova.policy [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b21184109904699b0077f13cb8709d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d61981dd63e469e8e4c5ecdf13119e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.182s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.167s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428/disk 1073741824" returned: 0 in 0.040s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Cannot resize image /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Ensure instance console log exists: /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG nova.network.neutron [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Successfully created port: 3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.206s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Cannot resize image /opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Ensure instance console log exists: /opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:06:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:01 user nova-compute[73917]: DEBUG nova.network.neutron [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Successfully created port: e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:07:01 user nova-compute[73917]: DEBUG nova.network.neutron [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Successfully created port: a8f8f32c-cf87-43ae-b6db-43da89ab6888 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:07:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:07:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:01 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:07:01 user nova-compute[73917]: INFO nova.compute.claims [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Claim successful on node user
Aug 26 19:07:02 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Successfully updated port: 70707344-848e-4e9b-baf4-6cfbb4737fb8 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "refresh_cache-5dd60c10-f99a-431d-a66f-936a7a7a1c55" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquired lock "refresh_cache-5dd60c10-f99a-431d-a66f-936a7a7a1c55" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG nova.network.neutron [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:07:02 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:07:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:07:02 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Creating image(s)
Aug 26 19:07:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "/opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "/opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "/opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG nova.policy [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a47b6f8fcb8f49dfa2383dfbf37d6c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdcca8609e849618526a8b78385f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG nova.compute.manager [req-81143e1b-b0ab-4ff4-8c08-2ba9daf14aca req-57e8c214-8357-4fcf-ad8f-8cfc53d83aba service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Received event network-changed-70707344-848e-4e9b-baf4-6cfbb4737fb8 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG nova.compute.manager [req-81143e1b-b0ab-4ff4-8c08-2ba9daf14aca req-57e8c214-8357-4fcf-ad8f-8cfc53d83aba service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Refreshing instance network info cache due to event network-changed-70707344-848e-4e9b-baf4-6cfbb4737fb8. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-81143e1b-b0ab-4ff4-8c08-2ba9daf14aca req-57e8c214-8357-4fcf-ad8f-8cfc53d83aba service nova] Acquiring lock "refresh_cache-5dd60c10-f99a-431d-a66f-936a7a7a1c55" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.236s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.164s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk 1073741824" returned: 0 in 0.048s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.159s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:03 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:07:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:03 user nova-compute[73917]: DEBUG nova.network.neutron [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Successfully updated port: 3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:07:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquired lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:03 user nova-compute[73917]: DEBUG nova.network.neutron [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:07:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:03 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Cannot resize image /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:07:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:07:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Ensure instance console log exists: /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:07:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:03 user nova-compute[73917]: DEBUG nova.network.neutron [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:07:03 user nova-compute[73917]: DEBUG nova.compute.manager [req-871bf902-e71f-4e21-beae-68500c3589f4 req-fe8f85a8-ced8-4e1d-b499-8c25c5e16e70 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received event network-changed-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:03 user nova-compute[73917]: DEBUG nova.compute.manager [req-871bf902-e71f-4e21-beae-68500c3589f4 req-fe8f85a8-ced8-4e1d-b499-8c25c5e16e70 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Refreshing instance network info cache due to event network-changed-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:07:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-871bf902-e71f-4e21-beae-68500c3589f4 req-fe8f85a8-ced8-4e1d-b499-8c25c5e16e70 service nova] Acquiring lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.network.neutron [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Updating instance_info_cache with network_info: [{"id": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "address": "fa:16:3e:89:79:8b", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8ac63b-61", "ovs_interfaceid": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Releasing lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.compute.manager [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Instance network_info: |[{"id": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "address": "fa:16:3e:89:79:8b", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8ac63b-61", "ovs_interfaceid": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-871bf902-e71f-4e21-beae-68500c3589f4 req-fe8f85a8-ced8-4e1d-b499-8c25c5e16e70 service nova] Acquired lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.network.neutron [req-871bf902-e71f-4e21-beae-68500c3589f4 req-fe8f85a8-ced8-4e1d-b499-8c25c5e16e70 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Refreshing network info cache for port 3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Start _get_guest_xml network_info=[{"id": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "address": "fa:16:3e:89:79:8b", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8ac63b-61", "ovs_interfaceid": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:07:04 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:04 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.privsep.utils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73917) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1476169522',display_name='tempest-ServerRescueNegativeTestJSON-server-1476169522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1476169522',id=2,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1298aa7a6ca478fb973d5a6d7bea7be',ramdisk_id='',reservation_id='r-0yp9qq21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475026115',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475026115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:06:56Z,user_data=None,user_id='118080e0f2fe4533a25e002e894b99f9',uuid=cc0ae046-2a39-4ab6-9327-2d9452c3035d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "address": "fa:16:3e:89:79:8b", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8ac63b-61", "ovs_interfaceid": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converting VIF {"id": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "address": "fa:16:3e:89:79:8b", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8ac63b-61", "ovs_interfaceid": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:79:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8ac63b-61') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.objects.instance [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'pci_devices' on Instance uuid cc0ae046-2a39-4ab6-9327-2d9452c3035d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Updating instance_info_cache with network_info: [{"id": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "address": "fa:16:3e:5a:c1:dd", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70707344-84", "ovs_interfaceid": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:07:04 user nova-compute[73917]:   <uuid>cc0ae046-2a39-4ab6-9327-2d9452c3035d</uuid>
Aug 26 19:07:04 user nova-compute[73917]:   <name>instance-00000002</name>
Aug 26 19:07:04 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:07:04 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:07:04 user nova-compute[73917]:   <metadata>
Aug 26 19:07:04 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:07:04 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:07:04 user nova-compute[73917]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1476169522</nova:name>
Aug 26 19:07:04 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:07:04</nova:creationTime>
Aug 26 19:07:04 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:07:04 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:07:04 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:07:04 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:07:04 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:07:04 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:07:04 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:07:04 user nova-compute[73917]:       <nova:owner>
Aug 26 19:07:04 user nova-compute[73917]:         <nova:user uuid="118080e0f2fe4533a25e002e894b99f9">tempest-ServerRescueNegativeTestJSON-1475026115-project-member</nova:user>
Aug 26 19:07:04 user nova-compute[73917]:         <nova:project uuid="d1298aa7a6ca478fb973d5a6d7bea7be">tempest-ServerRescueNegativeTestJSON-1475026115</nova:project>
Aug 26 19:07:04 user nova-compute[73917]:       </nova:owner>
Aug 26 19:07:04 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:07:04 user nova-compute[73917]:       <nova:ports>
Aug 26 19:07:04 user nova-compute[73917]:         <nova:port uuid="3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b">
Aug 26 19:07:04 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 19:07:04 user nova-compute[73917]:         </nova:port>
Aug 26 19:07:04 user nova-compute[73917]:       </nova:ports>
Aug 26 19:07:04 user nova-compute[73917]:     </nova:instance>
Aug 26 19:07:04 user nova-compute[73917]:   </metadata>
Aug 26 19:07:04 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:07:04 user nova-compute[73917]:     <system>
Aug 26 19:07:04 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:07:04 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:07:04 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:07:04 user nova-compute[73917]:       <entry name="serial">cc0ae046-2a39-4ab6-9327-2d9452c3035d</entry>
Aug 26 19:07:04 user nova-compute[73917]:       <entry name="uuid">cc0ae046-2a39-4ab6-9327-2d9452c3035d</entry>
Aug 26 19:07:04 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:07:04 user nova-compute[73917]:     </system>
Aug 26 19:07:04 user nova-compute[73917]:   </sysinfo>
Aug 26 19:07:04 user nova-compute[73917]:   <os>
Aug 26 19:07:04 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:07:04 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:07:04 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:07:04 user nova-compute[73917]:   </os>
Aug 26 19:07:04 user nova-compute[73917]:   <features>
Aug 26 19:07:04 user nova-compute[73917]:     <acpi/>
Aug 26 19:07:04 user nova-compute[73917]:     <apic/>
Aug 26 19:07:04 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:07:04 user nova-compute[73917]:   </features>
Aug 26 19:07:04 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:07:04 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:07:04 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:07:04 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:07:04 user nova-compute[73917]:   </clock>
Aug 26 19:07:04 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:07:04 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:07:04 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:07:04 user nova-compute[73917]:   </cpu>
Aug 26 19:07:04 user nova-compute[73917]:   <devices>
Aug 26 19:07:04 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:07:04 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:07:04 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk"/>
Aug 26 19:07:04 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:07:04 user nova-compute[73917]:     </disk>
Aug 26 19:07:04 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:07:04 user nova-compute[73917]:       <mac address="fa:16:3e:89:79:8b"/>
Aug 26 19:07:04 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:04 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:07:04 user nova-compute[73917]:       <target dev="tap3e8ac63b-61"/>
Aug 26 19:07:04 user nova-compute[73917]:     </interface>
Aug 26 19:07:04 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:07:04 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/console.log" append="off"/>
Aug 26 19:07:04 user nova-compute[73917]:     </serial>
Aug 26 19:07:04 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:07:04 user nova-compute[73917]:     <video>
Aug 26 19:07:04 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:04 user nova-compute[73917]:     </video>
Aug 26 19:07:04 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:07:04 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:07:04 user nova-compute[73917]:     </rng>
Aug 26 19:07:04 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:07:04 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:07:04 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:07:04 user nova-compute[73917]:     </memballoon>
Aug 26 19:07:04 user nova-compute[73917]:   </devices>
Aug 26 19:07:04 user nova-compute[73917]: </domain>
Aug 26 19:07:04 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1476169522',display_name='tempest-ServerRescueNegativeTestJSON-server-1476169522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1476169522',id=2,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1298aa7a6ca478fb973d5a6d7bea7be',ramdisk_id='',reservation_id='r-0yp9qq21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475026115',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475026115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:06:56Z,user_data=None,user_id='118080e0f2fe4533a25e002e894b99f9',uuid=cc0ae046-2a39-4ab6-9327-2d9452c3035d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "address": "fa:16:3e:89:79:8b", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8ac63b-61", "ovs_interfaceid": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converting VIF {"id": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "address": "fa:16:3e:89:79:8b", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8ac63b-61", "ovs_interfaceid": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:79:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8ac63b-61') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG os_vif [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:79:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8ac63b-61') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Releasing lock "refresh_cache-5dd60c10-f99a-431d-a66f-936a7a7a1c55" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:04 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Instance network_info: |[{"id": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "address": "fa:16:3e:5a:c1:dd", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70707344-84", "ovs_interfaceid": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Created schema index Interface.name {{(pid=73917) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Created schema index Port.name {{(pid=73917) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Created schema index Bridge.name {{(pid=73917) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-81143e1b-b0ab-4ff4-8c08-2ba9daf14aca req-57e8c214-8357-4fcf-ad8f-8cfc53d83aba service nova] Acquired lock "refresh_cache-5dd60c10-f99a-431d-a66f-936a7a7a1c55" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.network.neutron [req-81143e1b-b0ab-4ff4-8c08-2ba9daf14aca req-57e8c214-8357-4fcf-ad8f-8cfc53d83aba service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Refreshing network info cache for port 70707344-848e-4e9b-baf4-6cfbb4737fb8 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Start _get_guest_xml network_info=[{"id": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "address": "fa:16:3e:5a:c1:dd", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70707344-84", "ovs_interfaceid": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [POLLOUT] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:07:05 user nova-compute[73917]: INFO oslo.privsep.daemon [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpkozqet7c/privsep.sock']
Aug 26 19:07:05 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:05 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:07:05 user sudo[83289]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpkozqet7c/privsep.sock
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:07:05 user sudo[83289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:06:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-168280068',display_name='tempest-AttachVolumeNegativeTest-server-168280068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-168280068',id=1,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLldEmRypfHCkMn/QByyzkXbQJjQQCN4Jn8O6nEo/hOA4e4QYD4ZW7YoCj6G7Pa00QzIruSmgojv4vz/cwFeUpf9waYiM5jIrjW8XKEMUvzzsMPEKyH8kJ9XzZDnGAZ5NA==',key_name='tempest-keypair-1977464775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b291bbf9aedc4414a1ab402602849140',ramdisk_id='',reservation_id='r-bf4li2da',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2066333616',owner_user_name='tempest-AttachVolumeNegativeTest-2066333616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c64a5d226b8b4d60af840d49315bf60f',uuid=5dd60c10-f99a-431d-a66f-936a7a7a1c55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "address": "fa:16:3e:5a:c1:dd", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70707344-84", "ovs_interfaceid": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converting VIF {"id": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "address": "fa:16:3e:5a:c1:dd", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70707344-84", "ovs_interfaceid": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:c1:dd,bridge_name='br-int',has_traffic_filtering=True,id=70707344-848e-4e9b-baf4-6cfbb4737fb8,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70707344-84') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.objects.instance [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lazy-loading 'pci_devices' on Instance uuid 5dd60c10-f99a-431d-a66f-936a7a7a1c55 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:07:05 user nova-compute[73917]:   <uuid>5dd60c10-f99a-431d-a66f-936a7a7a1c55</uuid>
Aug 26 19:07:05 user nova-compute[73917]:   <name>instance-00000001</name>
Aug 26 19:07:05 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:07:05 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:07:05 user nova-compute[73917]:   <metadata>
Aug 26 19:07:05 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:07:05 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:07:05 user nova-compute[73917]:       <nova:name>tempest-AttachVolumeNegativeTest-server-168280068</nova:name>
Aug 26 19:07:05 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:07:05</nova:creationTime>
Aug 26 19:07:05 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:07:05 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:07:05 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:07:05 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:07:05 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:07:05 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:07:05 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:07:05 user nova-compute[73917]:       <nova:owner>
Aug 26 19:07:05 user nova-compute[73917]:         <nova:user uuid="c64a5d226b8b4d60af840d49315bf60f">tempest-AttachVolumeNegativeTest-2066333616-project-member</nova:user>
Aug 26 19:07:05 user nova-compute[73917]:         <nova:project uuid="b291bbf9aedc4414a1ab402602849140">tempest-AttachVolumeNegativeTest-2066333616</nova:project>
Aug 26 19:07:05 user nova-compute[73917]:       </nova:owner>
Aug 26 19:07:05 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:07:05 user nova-compute[73917]:       <nova:ports>
Aug 26 19:07:05 user nova-compute[73917]:         <nova:port uuid="70707344-848e-4e9b-baf4-6cfbb4737fb8">
Aug 26 19:07:05 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 19:07:05 user nova-compute[73917]:         </nova:port>
Aug 26 19:07:05 user nova-compute[73917]:       </nova:ports>
Aug 26 19:07:05 user nova-compute[73917]:     </nova:instance>
Aug 26 19:07:05 user nova-compute[73917]:   </metadata>
Aug 26 19:07:05 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:07:05 user nova-compute[73917]:     <system>
Aug 26 19:07:05 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:07:05 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:07:05 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:07:05 user nova-compute[73917]:       <entry name="serial">5dd60c10-f99a-431d-a66f-936a7a7a1c55</entry>
Aug 26 19:07:05 user nova-compute[73917]:       <entry name="uuid">5dd60c10-f99a-431d-a66f-936a7a7a1c55</entry>
Aug 26 19:07:05 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:07:05 user nova-compute[73917]:     </system>
Aug 26 19:07:05 user nova-compute[73917]:   </sysinfo>
Aug 26 19:07:05 user nova-compute[73917]:   <os>
Aug 26 19:07:05 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:07:05 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:07:05 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:07:05 user nova-compute[73917]:   </os>
Aug 26 19:07:05 user nova-compute[73917]:   <features>
Aug 26 19:07:05 user nova-compute[73917]:     <acpi/>
Aug 26 19:07:05 user nova-compute[73917]:     <apic/>
Aug 26 19:07:05 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:07:05 user nova-compute[73917]:   </features>
Aug 26 19:07:05 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:07:05 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:07:05 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:07:05 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:07:05 user nova-compute[73917]:   </clock>
Aug 26 19:07:05 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:07:05 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:07:05 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:07:05 user nova-compute[73917]:   </cpu>
Aug 26 19:07:05 user nova-compute[73917]:   <devices>
Aug 26 19:07:05 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:07:05 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:07:05 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk"/>
Aug 26 19:07:05 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:07:05 user nova-compute[73917]:     </disk>
Aug 26 19:07:05 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:07:05 user nova-compute[73917]:       <mac address="fa:16:3e:5a:c1:dd"/>
Aug 26 19:07:05 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:05 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:07:05 user nova-compute[73917]:       <target dev="tap70707344-84"/>
Aug 26 19:07:05 user nova-compute[73917]:     </interface>
Aug 26 19:07:05 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:07:05 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/console.log" append="off"/>
Aug 26 19:07:05 user nova-compute[73917]:     </serial>
Aug 26 19:07:05 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:07:05 user nova-compute[73917]:     <video>
Aug 26 19:07:05 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:05 user nova-compute[73917]:     </video>
Aug 26 19:07:05 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:07:05 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:07:05 user nova-compute[73917]:     </rng>
Aug 26 19:07:05 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:07:05 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:07:05 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:07:05 user nova-compute[73917]:     </memballoon>
Aug 26 19:07:05 user nova-compute[73917]:   </devices>
Aug 26 19:07:05 user nova-compute[73917]: </domain>
Aug 26 19:07:05 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:06:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-168280068',display_name='tempest-AttachVolumeNegativeTest-server-168280068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-168280068',id=1,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLldEmRypfHCkMn/QByyzkXbQJjQQCN4Jn8O6nEo/hOA4e4QYD4ZW7YoCj6G7Pa00QzIruSmgojv4vz/cwFeUpf9waYiM5jIrjW8XKEMUvzzsMPEKyH8kJ9XzZDnGAZ5NA==',key_name='tempest-keypair-1977464775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b291bbf9aedc4414a1ab402602849140',ramdisk_id='',reservation_id='r-bf4li2da',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2066333616',owner_user_name='tempest-AttachVolumeNegativeTest-2066333616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c64a5d226b8b4d60af840d49315bf60f',uuid=5dd60c10-f99a-431d-a66f-936a7a7a1c55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "address": "fa:16:3e:5a:c1:dd", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70707344-84", "ovs_interfaceid": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converting VIF {"id": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "address": "fa:16:3e:5a:c1:dd", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70707344-84", "ovs_interfaceid": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:c1:dd,bridge_name='br-int',has_traffic_filtering=True,id=70707344-848e-4e9b-baf4-6cfbb4737fb8,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70707344-84') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG os_vif [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:c1:dd,bridge_name='br-int',has_traffic_filtering=True,id=70707344-848e-4e9b-baf4-6cfbb4737fb8,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70707344-84') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.network.neutron [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Successfully updated port: e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "refresh_cache-fd801f18-34b6-4682-8d43-edf82bd216c2" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquired lock "refresh_cache-fd801f18-34b6-4682-8d43-edf82bd216c2" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.network.neutron [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.network.neutron [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Successfully updated port: a8f8f32c-cf87-43ae-b6db-43da89ab6888 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.network.neutron [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Acquiring lock "refresh_cache-ce383b5a-c726-4d82-b0e3-be6ac6659428" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Acquired lock "refresh_cache-ce383b5a-c726-4d82-b0e3-be6ac6659428" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.network.neutron [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-d476323b-8830-47b4-93c4-75e7ddb759e6 req-8f708797-4c08-4d10-a6f1-457e87493da3 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Received event network-changed-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-d476323b-8830-47b4-93c4-75e7ddb759e6 req-8f708797-4c08-4d10-a6f1-457e87493da3 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Refreshing instance network info cache due to event network-changed-e1b11e5e-5c2a-43b9-bb05-0936cdac7705. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d476323b-8830-47b4-93c4-75e7ddb759e6 req-8f708797-4c08-4d10-a6f1-457e87493da3 service nova] Acquiring lock "refresh_cache-fd801f18-34b6-4682-8d43-edf82bd216c2" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:07:05 user nova-compute[73917]: INFO nova.compute.claims [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Claim successful on node user
Aug 26 19:07:06 user nova-compute[73917]: DEBUG nova.network.neutron [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:07:06 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:07:06 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:07:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:06 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:07:06 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:07:06 user nova-compute[73917]: DEBUG nova.network.neutron [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:07:06 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:07:06 user nova-compute[73917]: DEBUG nova.network.neutron [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Successfully created port: 37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:07:06 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:07:06 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:07:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:07:06 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Creating image(s)
Aug 26 19:07:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "/opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "/opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.158s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:06 user nova-compute[73917]: DEBUG nova.policy [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd1b7d3fe22c4b239cf03235866e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e09fe7b38e4bb991bfaaf5b4ad357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:07:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.230s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:07 user sudo[83289]: pam_unix(sudo:session): session closed for user root
Aug 26 19:07:07 user nova-compute[73917]: INFO oslo.privsep.daemon [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Spawned new privsep daemon via rootwrap
Aug 26 19:07:07 user nova-compute[73917]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 19:07:07 user nova-compute[73917]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 19:07:07 user nova-compute[73917]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 26 19:07:07 user nova-compute[73917]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83293
Aug 26 19:07:07 user nova-compute[73917]: WARNING oslo_privsep.priv_context [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] privsep daemon already running
Aug 26 19:07:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk 1073741824" returned: 0 in 0.054s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.175s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.network.neutron [req-81143e1b-b0ab-4ff4-8c08-2ba9daf14aca req-57e8c214-8357-4fcf-ad8f-8cfc53d83aba service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Updated VIF entry in instance network info cache for port 70707344-848e-4e9b-baf4-6cfbb4737fb8. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.network.neutron [req-81143e1b-b0ab-4ff4-8c08-2ba9daf14aca req-57e8c214-8357-4fcf-ad8f-8cfc53d83aba service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Updating instance_info_cache with network_info: [{"id": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "address": "fa:16:3e:5a:c1:dd", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70707344-84", "ovs_interfaceid": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-81143e1b-b0ab-4ff4-8c08-2ba9daf14aca req-57e8c214-8357-4fcf-ad8f-8cfc53d83aba service nova] Releasing lock "refresh_cache-5dd60c10-f99a-431d-a66f-936a7a7a1c55" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Cannot resize image /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Ensure instance console log exists: /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e8ac63b-61, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e8ac63b-61, col_values=(('external_ids', {'iface-id': '3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:79:8b', 'vm-uuid': 'cc0ae046-2a39-4ab6-9327-2d9452c3035d'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70707344-84, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap70707344-84, col_values=(('external_ids', {'iface-id': '70707344-848e-4e9b-baf4-6cfbb4737fb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:c1:dd', 'vm-uuid': '5dd60c10-f99a-431d-a66f-936a7a7a1c55'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:07 user nova-compute[73917]: INFO os_vif [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:79:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8ac63b-61')
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:07 user nova-compute[73917]: INFO os_vif [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:c1:dd,bridge_name='br-int',has_traffic_filtering=True,id=70707344-848e-4e9b-baf4-6cfbb4737fb8,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70707344-84')
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.network.neutron [req-871bf902-e71f-4e21-beae-68500c3589f4 req-fe8f85a8-ced8-4e1d-b499-8c25c5e16e70 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Updated VIF entry in instance network info cache for port 3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.network.neutron [req-871bf902-e71f-4e21-beae-68500c3589f4 req-fe8f85a8-ced8-4e1d-b499-8c25c5e16e70 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Updating instance_info_cache with network_info: [{"id": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "address": "fa:16:3e:89:79:8b", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8ac63b-61", "ovs_interfaceid": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.network.neutron [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Updating instance_info_cache with network_info: [{"id": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "address": "fa:16:3e:9c:f5:38", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b11e5e-5c", "ovs_interfaceid": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-871bf902-e71f-4e21-beae-68500c3589f4 req-fe8f85a8-ced8-4e1d-b499-8c25c5e16e70 service nova] Releasing lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Releasing lock "refresh_cache-fd801f18-34b6-4682-8d43-edf82bd216c2" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Instance network_info: |[{"id": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "address": "fa:16:3e:9c:f5:38", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b11e5e-5c", "ovs_interfaceid": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d476323b-8830-47b4-93c4-75e7ddb759e6 req-8f708797-4c08-4d10-a6f1-457e87493da3 service nova] Acquired lock "refresh_cache-fd801f18-34b6-4682-8d43-edf82bd216c2" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.network.neutron [req-d476323b-8830-47b4-93c4-75e7ddb759e6 req-8f708797-4c08-4d10-a6f1-457e87493da3 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Refreshing network info cache for port e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Start _get_guest_xml network_info=[{"id": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "address": "fa:16:3e:9c:f5:38", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b11e5e-5c", "ovs_interfaceid": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] No VIF found with MAC fa:16:3e:89:79:8b, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:07:07 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:07 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] No VIF found with MAC fa:16:3e:5a:c1:dd, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:06:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-864264859',display_name='tempest-ServerRescueNegativeTestJSON-server-864264859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-864264859',id=4,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1298aa7a6ca478fb973d5a6d7bea7be',ramdisk_id='',reservation_id='r-yrrbw1ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475026115',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475026115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:06:59Z,user_data=None,user_id='118080e0f2fe4533a25e002e894b99f9',uuid=fd801f18-34b6-4682-8d43-edf82bd216c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "address": "fa:16:3e:9c:f5:38", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b11e5e-5c", "ovs_interfaceid": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converting VIF {"id": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "address": "fa:16:3e:9c:f5:38", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b11e5e-5c", "ovs_interfaceid": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f5:38,bridge_name='br-int',has_traffic_filtering=True,id=e1b11e5e-5c2a-43b9-bb05-0936cdac7705,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b11e5e-5c') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.objects.instance [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'pci_devices' on Instance uuid fd801f18-34b6-4682-8d43-edf82bd216c2 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:07:07 user nova-compute[73917]:   <uuid>fd801f18-34b6-4682-8d43-edf82bd216c2</uuid>
Aug 26 19:07:07 user nova-compute[73917]:   <name>instance-00000004</name>
Aug 26 19:07:07 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:07:07 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:07:07 user nova-compute[73917]:   <metadata>
Aug 26 19:07:07 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:07:07 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:07:07 user nova-compute[73917]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-864264859</nova:name>
Aug 26 19:07:07 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:07:07</nova:creationTime>
Aug 26 19:07:07 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:07:07 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:07:07 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:07:07 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:07:07 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:07:07 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:07:07 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:07:07 user nova-compute[73917]:       <nova:owner>
Aug 26 19:07:07 user nova-compute[73917]:         <nova:user uuid="118080e0f2fe4533a25e002e894b99f9">tempest-ServerRescueNegativeTestJSON-1475026115-project-member</nova:user>
Aug 26 19:07:07 user nova-compute[73917]:         <nova:project uuid="d1298aa7a6ca478fb973d5a6d7bea7be">tempest-ServerRescueNegativeTestJSON-1475026115</nova:project>
Aug 26 19:07:07 user nova-compute[73917]:       </nova:owner>
Aug 26 19:07:07 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:07:07 user nova-compute[73917]:       <nova:ports>
Aug 26 19:07:07 user nova-compute[73917]:         <nova:port uuid="e1b11e5e-5c2a-43b9-bb05-0936cdac7705">
Aug 26 19:07:07 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 19:07:07 user nova-compute[73917]:         </nova:port>
Aug 26 19:07:07 user nova-compute[73917]:       </nova:ports>
Aug 26 19:07:07 user nova-compute[73917]:     </nova:instance>
Aug 26 19:07:07 user nova-compute[73917]:   </metadata>
Aug 26 19:07:07 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:07:07 user nova-compute[73917]:     <system>
Aug 26 19:07:07 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:07:07 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:07:07 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:07:07 user nova-compute[73917]:       <entry name="serial">fd801f18-34b6-4682-8d43-edf82bd216c2</entry>
Aug 26 19:07:07 user nova-compute[73917]:       <entry name="uuid">fd801f18-34b6-4682-8d43-edf82bd216c2</entry>
Aug 26 19:07:07 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:07:07 user nova-compute[73917]:     </system>
Aug 26 19:07:07 user nova-compute[73917]:   </sysinfo>
Aug 26 19:07:07 user nova-compute[73917]:   <os>
Aug 26 19:07:07 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:07:07 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:07:07 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:07:07 user nova-compute[73917]:   </os>
Aug 26 19:07:07 user nova-compute[73917]:   <features>
Aug 26 19:07:07 user nova-compute[73917]:     <acpi/>
Aug 26 19:07:07 user nova-compute[73917]:     <apic/>
Aug 26 19:07:07 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:07:07 user nova-compute[73917]:   </features>
Aug 26 19:07:07 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:07:07 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:07:07 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:07:07 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:07:07 user nova-compute[73917]:   </clock>
Aug 26 19:07:07 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:07:07 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:07:07 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:07:07 user nova-compute[73917]:   </cpu>
Aug 26 19:07:07 user nova-compute[73917]:   <devices>
Aug 26 19:07:07 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:07:07 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:07:07 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk"/>
Aug 26 19:07:07 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:07:07 user nova-compute[73917]:     </disk>
Aug 26 19:07:07 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:07:07 user nova-compute[73917]:       <mac address="fa:16:3e:9c:f5:38"/>
Aug 26 19:07:07 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:07 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:07:07 user nova-compute[73917]:       <target dev="tape1b11e5e-5c"/>
Aug 26 19:07:07 user nova-compute[73917]:     </interface>
Aug 26 19:07:07 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:07:07 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/console.log" append="off"/>
Aug 26 19:07:07 user nova-compute[73917]:     </serial>
Aug 26 19:07:07 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:07:07 user nova-compute[73917]:     <video>
Aug 26 19:07:07 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:07 user nova-compute[73917]:     </video>
Aug 26 19:07:07 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:07:07 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:07:07 user nova-compute[73917]:     </rng>
Aug 26 19:07:07 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:07:07 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:07:07 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:07:07 user nova-compute[73917]:     </memballoon>
Aug 26 19:07:07 user nova-compute[73917]:   </devices>
Aug 26 19:07:07 user nova-compute[73917]: </domain>
Aug 26 19:07:07 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:06:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-864264859',display_name='tempest-ServerRescueNegativeTestJSON-server-864264859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-864264859',id=4,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1298aa7a6ca478fb973d5a6d7bea7be',ramdisk_id='',reservation_id='r-yrrbw1ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475026115',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475026115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:06:59Z,user_data=None,user_id='118080e0f2fe4533a25e002e894b99f9',uuid=fd801f18-34b6-4682-8d43-edf82bd216c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "address": "fa:16:3e:9c:f5:38", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b11e5e-5c", "ovs_interfaceid": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converting VIF {"id": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "address": "fa:16:3e:9c:f5:38", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b11e5e-5c", "ovs_interfaceid": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f5:38,bridge_name='br-int',has_traffic_filtering=True,id=e1b11e5e-5c2a-43b9-bb05-0936cdac7705,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b11e5e-5c') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG os_vif [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f5:38,bridge_name='br-int',has_traffic_filtering=True,id=e1b11e5e-5c2a-43b9-bb05-0936cdac7705,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b11e5e-5c') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.network.neutron [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Updating instance_info_cache with network_info: [{"id": "a8f8f32c-cf87-43ae-b6db-43da89ab6888", "address": "fa:16:3e:5b:58:7f", "network": {"id": "f605ba6b-ba4d-4ab9-b650-c5d0ef2ad199", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979781726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d61981dd63e469e8e4c5ecdf13119e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f8f32c-cf", "ovs_interfaceid": "a8f8f32c-cf87-43ae-b6db-43da89ab6888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1b11e5e-5c, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape1b11e5e-5c, col_values=(('external_ids', {'iface-id': 'e1b11e5e-5c2a-43b9-bb05-0936cdac7705', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:f5:38', 'vm-uuid': 'fd801f18-34b6-4682-8d43-edf82bd216c2'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Releasing lock "refresh_cache-ce383b5a-c726-4d82-b0e3-be6ac6659428" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Instance network_info: |[{"id": "a8f8f32c-cf87-43ae-b6db-43da89ab6888", "address": "fa:16:3e:5b:58:7f", "network": {"id": "f605ba6b-ba4d-4ab9-b650-c5d0ef2ad199", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979781726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d61981dd63e469e8e4c5ecdf13119e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f8f32c-cf", "ovs_interfaceid": "a8f8f32c-cf87-43ae-b6db-43da89ab6888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Start _get_guest_xml network_info=[{"id": "a8f8f32c-cf87-43ae-b6db-43da89ab6888", "address": "fa:16:3e:5b:58:7f", "network": {"id": "f605ba6b-ba4d-4ab9-b650-c5d0ef2ad199", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979781726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d61981dd63e469e8e4c5ecdf13119e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f8f32c-cf", "ovs_interfaceid": "a8f8f32c-cf87-43ae-b6db-43da89ab6888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:07 user nova-compute[73917]: INFO os_vif [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f5:38,bridge_name='br-int',has_traffic_filtering=True,id=e1b11e5e-5c2a-43b9-bb05-0936cdac7705,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b11e5e-5c')
Aug 26 19:07:07 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:07 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:06:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-577121937',display_name='tempest-DeleteServersTestJSON-server-577121937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-577121937',id=3,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d61981dd63e469e8e4c5ecdf13119e0',ramdisk_id='',reservation_id='r-10piorus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1349277273',owner_user_name='tempest-DeleteServersTestJSON-1349277273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:06:59Z,user_data=None,user_id='7b21184109904699b0077f13cb8709d5',uuid=ce383b5a-c726-4d82-b0e3-be6ac6659428,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8f8f32c-cf87-43ae-b6db-43da89ab6888", "address": "fa:16:3e:5b:58:7f", "network": {"id": "f605ba6b-ba4d-4ab9-b650-c5d0ef2ad199", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979781726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d61981dd63e469e8e4c5ecdf13119e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f8f32c-cf", "ovs_interfaceid": "a8f8f32c-cf87-43ae-b6db-43da89ab6888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Converting VIF {"id": "a8f8f32c-cf87-43ae-b6db-43da89ab6888", "address": "fa:16:3e:5b:58:7f", "network": {"id": "f605ba6b-ba4d-4ab9-b650-c5d0ef2ad199", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979781726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d61981dd63e469e8e4c5ecdf13119e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f8f32c-cf", "ovs_interfaceid": "a8f8f32c-cf87-43ae-b6db-43da89ab6888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:58:7f,bridge_name='br-int',has_traffic_filtering=True,id=a8f8f32c-cf87-43ae-b6db-43da89ab6888,network=Network(f605ba6b-ba4d-4ab9-b650-c5d0ef2ad199),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8f8f32c-cf') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.objects.instance [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lazy-loading 'pci_devices' on Instance uuid ce383b5a-c726-4d82-b0e3-be6ac6659428 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:07:07 user nova-compute[73917]:   <uuid>ce383b5a-c726-4d82-b0e3-be6ac6659428</uuid>
Aug 26 19:07:07 user nova-compute[73917]:   <name>instance-00000003</name>
Aug 26 19:07:07 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:07:07 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:07:07 user nova-compute[73917]:   <metadata>
Aug 26 19:07:07 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:07:07 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:07:07 user nova-compute[73917]:       <nova:name>tempest-DeleteServersTestJSON-server-577121937</nova:name>
Aug 26 19:07:07 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:07:07</nova:creationTime>
Aug 26 19:07:07 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:07:07 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:07:07 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:07:07 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:07:07 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:07:07 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:07:07 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:07:07 user nova-compute[73917]:       <nova:owner>
Aug 26 19:07:07 user nova-compute[73917]:         <nova:user uuid="7b21184109904699b0077f13cb8709d5">tempest-DeleteServersTestJSON-1349277273-project-member</nova:user>
Aug 26 19:07:07 user nova-compute[73917]:         <nova:project uuid="9d61981dd63e469e8e4c5ecdf13119e0">tempest-DeleteServersTestJSON-1349277273</nova:project>
Aug 26 19:07:07 user nova-compute[73917]:       </nova:owner>
Aug 26 19:07:07 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:07:07 user nova-compute[73917]:       <nova:ports>
Aug 26 19:07:07 user nova-compute[73917]:         <nova:port uuid="a8f8f32c-cf87-43ae-b6db-43da89ab6888">
Aug 26 19:07:07 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 19:07:07 user nova-compute[73917]:         </nova:port>
Aug 26 19:07:07 user nova-compute[73917]:       </nova:ports>
Aug 26 19:07:07 user nova-compute[73917]:     </nova:instance>
Aug 26 19:07:07 user nova-compute[73917]:   </metadata>
Aug 26 19:07:07 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:07:07 user nova-compute[73917]:     <system>
Aug 26 19:07:07 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:07:07 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:07:07 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:07:07 user nova-compute[73917]:       <entry name="serial">ce383b5a-c726-4d82-b0e3-be6ac6659428</entry>
Aug 26 19:07:07 user nova-compute[73917]:       <entry name="uuid">ce383b5a-c726-4d82-b0e3-be6ac6659428</entry>
Aug 26 19:07:07 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:07:07 user nova-compute[73917]:     </system>
Aug 26 19:07:07 user nova-compute[73917]:   </sysinfo>
Aug 26 19:07:07 user nova-compute[73917]:   <os>
Aug 26 19:07:07 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:07:07 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:07:07 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:07:07 user nova-compute[73917]:   </os>
Aug 26 19:07:07 user nova-compute[73917]:   <features>
Aug 26 19:07:07 user nova-compute[73917]:     <acpi/>
Aug 26 19:07:07 user nova-compute[73917]:     <apic/>
Aug 26 19:07:07 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:07:07 user nova-compute[73917]:   </features>
Aug 26 19:07:07 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:07:07 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:07:07 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:07:07 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:07:07 user nova-compute[73917]:   </clock>
Aug 26 19:07:07 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:07:07 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:07:07 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:07:07 user nova-compute[73917]:   </cpu>
Aug 26 19:07:07 user nova-compute[73917]:   <devices>
Aug 26 19:07:07 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:07:07 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:07:07 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428/disk"/>
Aug 26 19:07:07 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:07:07 user nova-compute[73917]:     </disk>
Aug 26 19:07:07 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:07:07 user nova-compute[73917]:       <mac address="fa:16:3e:5b:58:7f"/>
Aug 26 19:07:07 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:07 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:07:07 user nova-compute[73917]:       <target dev="tapa8f8f32c-cf"/>
Aug 26 19:07:07 user nova-compute[73917]:     </interface>
Aug 26 19:07:07 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:07:07 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428/console.log" append="off"/>
Aug 26 19:07:07 user nova-compute[73917]:     </serial>
Aug 26 19:07:07 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:07:07 user nova-compute[73917]:     <video>
Aug 26 19:07:07 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:07 user nova-compute[73917]:     </video>
Aug 26 19:07:07 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:07:07 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:07:07 user nova-compute[73917]:     </rng>
Aug 26 19:07:07 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:07:07 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:07:07 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:07:07 user nova-compute[73917]:     </memballoon>
Aug 26 19:07:07 user nova-compute[73917]:   </devices>
Aug 26 19:07:07 user nova-compute[73917]: </domain>
Aug 26 19:07:07 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:06:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-577121937',display_name='tempest-DeleteServersTestJSON-server-577121937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-577121937',id=3,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d61981dd63e469e8e4c5ecdf13119e0',ramdisk_id='',reservation_id='r-10piorus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1349277273',owner_user_name='tempest-DeleteServersTestJSON-1349277273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:06:59Z,user_data=None,user_id='7b21184109904699b0077f13cb8709d5',uuid=ce383b5a-c726-4d82-b0e3-be6ac6659428,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8f8f32c-cf87-43ae-b6db-43da89ab6888", "address": "fa:16:3e:5b:58:7f", "network": {"id": "f605ba6b-ba4d-4ab9-b650-c5d0ef2ad199", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979781726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d61981dd63e469e8e4c5ecdf13119e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f8f32c-cf", "ovs_interfaceid": "a8f8f32c-cf87-43ae-b6db-43da89ab6888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Converting VIF {"id": "a8f8f32c-cf87-43ae-b6db-43da89ab6888", "address": "fa:16:3e:5b:58:7f", "network": {"id": "f605ba6b-ba4d-4ab9-b650-c5d0ef2ad199", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979781726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d61981dd63e469e8e4c5ecdf13119e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f8f32c-cf", "ovs_interfaceid": "a8f8f32c-cf87-43ae-b6db-43da89ab6888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:58:7f,bridge_name='br-int',has_traffic_filtering=True,id=a8f8f32c-cf87-43ae-b6db-43da89ab6888,network=Network(f605ba6b-ba4d-4ab9-b650-c5d0ef2ad199),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8f8f32c-cf') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG os_vif [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:58:7f,bridge_name='br-int',has_traffic_filtering=True,id=a8f8f32c-cf87-43ae-b6db-43da89ab6888,network=Network(f605ba6b-ba4d-4ab9-b650-c5d0ef2ad199),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8f8f32c-cf') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8f8f32c-cf, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa8f8f32c-cf, col_values=(('external_ids', {'iface-id': 'a8f8f32c-cf87-43ae-b6db-43da89ab6888', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:58:7f', 'vm-uuid': 'ce383b5a-c726-4d82-b0e3-be6ac6659428'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] No VIF found with MAC fa:16:3e:9c:f5:38, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:07 user nova-compute[73917]: INFO os_vif [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:58:7f,bridge_name='br-int',has_traffic_filtering=True,id=a8f8f32c-cf87-43ae-b6db-43da89ab6888,network=Network(f605ba6b-ba4d-4ab9-b650-c5d0ef2ad199),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8f8f32c-cf')
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:07:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] No VIF found with MAC fa:16:3e:5b:58:7f, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:07:08 user nova-compute[73917]: DEBUG nova.compute.manager [req-b2cd4852-af7e-43ab-95b4-0adc7a24ea46 req-b229af38-bb2e-4ddd-bacc-6bc4c0e8f44a service nova] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Received event network-changed-a8f8f32c-cf87-43ae-b6db-43da89ab6888 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:08 user nova-compute[73917]: DEBUG nova.compute.manager [req-b2cd4852-af7e-43ab-95b4-0adc7a24ea46 req-b229af38-bb2e-4ddd-bacc-6bc4c0e8f44a service nova] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Refreshing instance network info cache due to event network-changed-a8f8f32c-cf87-43ae-b6db-43da89ab6888. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:07:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b2cd4852-af7e-43ab-95b4-0adc7a24ea46 req-b229af38-bb2e-4ddd-bacc-6bc4c0e8f44a service nova] Acquiring lock "refresh_cache-ce383b5a-c726-4d82-b0e3-be6ac6659428" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b2cd4852-af7e-43ab-95b4-0adc7a24ea46 req-b229af38-bb2e-4ddd-bacc-6bc4c0e8f44a service nova] Acquired lock "refresh_cache-ce383b5a-c726-4d82-b0e3-be6ac6659428" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:08 user nova-compute[73917]: DEBUG nova.network.neutron [req-b2cd4852-af7e-43ab-95b4-0adc7a24ea46 req-b229af38-bb2e-4ddd-bacc-6bc4c0e8f44a service nova] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Refreshing network info cache for port a8f8f32c-cf87-43ae-b6db-43da89ab6888 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:07:09 user nova-compute[73917]: DEBUG nova.network.neutron [req-d476323b-8830-47b4-93c4-75e7ddb759e6 req-8f708797-4c08-4d10-a6f1-457e87493da3 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Updated VIF entry in instance network info cache for port e1b11e5e-5c2a-43b9-bb05-0936cdac7705. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:07:09 user nova-compute[73917]: DEBUG nova.network.neutron [req-d476323b-8830-47b4-93c4-75e7ddb759e6 req-8f708797-4c08-4d10-a6f1-457e87493da3 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Updating instance_info_cache with network_info: [{"id": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "address": "fa:16:3e:9c:f5:38", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b11e5e-5c", "ovs_interfaceid": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d476323b-8830-47b4-93c4-75e7ddb759e6 req-8f708797-4c08-4d10-a6f1-457e87493da3 service nova] Releasing lock "refresh_cache-fd801f18-34b6-4682-8d43-edf82bd216c2" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:09 user nova-compute[73917]: DEBUG nova.network.neutron [req-b2cd4852-af7e-43ab-95b4-0adc7a24ea46 req-b229af38-bb2e-4ddd-bacc-6bc4c0e8f44a service nova] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Updated VIF entry in instance network info cache for port a8f8f32c-cf87-43ae-b6db-43da89ab6888. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:07:09 user nova-compute[73917]: DEBUG nova.network.neutron [req-b2cd4852-af7e-43ab-95b4-0adc7a24ea46 req-b229af38-bb2e-4ddd-bacc-6bc4c0e8f44a service nova] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Updating instance_info_cache with network_info: [{"id": "a8f8f32c-cf87-43ae-b6db-43da89ab6888", "address": "fa:16:3e:5b:58:7f", "network": {"id": "f605ba6b-ba4d-4ab9-b650-c5d0ef2ad199", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979781726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d61981dd63e469e8e4c5ecdf13119e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f8f32c-cf", "ovs_interfaceid": "a8f8f32c-cf87-43ae-b6db-43da89ab6888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b2cd4852-af7e-43ab-95b4-0adc7a24ea46 req-b229af38-bb2e-4ddd-bacc-6bc4c0e8f44a service nova] Releasing lock "refresh_cache-ce383b5a-c726-4d82-b0e3-be6ac6659428" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:10 user nova-compute[73917]: DEBUG nova.network.neutron [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Successfully created port: 2738a59b-9109-4fef-8868-920d458dfaa1 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:07:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:11 user nova-compute[73917]: DEBUG nova.network.neutron [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Successfully updated port: 37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:07:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "refresh_cache-fdfb377e-119e-41ce-b9e0-6e21053306cc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquired lock "refresh_cache-fdfb377e-119e-41ce-b9e0-6e21053306cc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:11 user nova-compute[73917]: DEBUG nova.network.neutron [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:07:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-df9a6d2e-a947-48ab-9f2f-c66058d7ed16 req-274cb90a-cb81-4983-9006-fd83df0fcf1e service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received event network-changed-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-df9a6d2e-a947-48ab-9f2f-c66058d7ed16 req-274cb90a-cb81-4983-9006-fd83df0fcf1e service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Refreshing instance network info cache due to event network-changed-37aa792a-c367-4dfd-b814-cb9c32ef373c. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:07:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-df9a6d2e-a947-48ab-9f2f-c66058d7ed16 req-274cb90a-cb81-4983-9006-fd83df0fcf1e service nova] Acquiring lock "refresh_cache-fdfb377e-119e-41ce-b9e0-6e21053306cc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:11 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:07:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:11 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:07:11 user nova-compute[73917]: INFO nova.compute.claims [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Claim successful on node user
Aug 26 19:07:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG nova.network.neutron [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.674s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG nova.network.neutron [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:07:12 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:07:12 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:07:12 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Creating image(s)
Aug 26 19:07:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "/opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "/opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "/opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG nova.policy [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34c97061bd0a4b3897fb03769884043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09772507cd24e329e84aa3b9a3b9b7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:07:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.158s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.179s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk 1073741824" returned: 0 in 0.054s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.191s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Cannot resize image /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Ensure instance console log exists: /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.network.neutron [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Updating instance_info_cache with network_info: [{"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Releasing lock "refresh_cache-fdfb377e-119e-41ce-b9e0-6e21053306cc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Instance network_info: |[{"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-df9a6d2e-a947-48ab-9f2f-c66058d7ed16 req-274cb90a-cb81-4983-9006-fd83df0fcf1e service nova] Acquired lock "refresh_cache-fdfb377e-119e-41ce-b9e0-6e21053306cc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.network.neutron [req-df9a6d2e-a947-48ab-9f2f-c66058d7ed16 req-274cb90a-cb81-4983-9006-fd83df0fcf1e service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Refreshing network info cache for port 37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Start _get_guest_xml network_info=[{"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:07:13 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:13 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-699122116',display_name='tempest-AttachVolumeTestJSON-server-699122116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-699122116',id=5,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHqeZabK3+K4aaugpyX8ly8/1rj5SN4GU9OQYd/thmmFlRmAKDNGqPnSs6iFVbJTbvqYDOtwahR3/8AlpHMnz55bssLgo5XLS59T+WFQ51mc2/usyY8DYb7AasV3fI19A==',key_name='tempest-keypair-67322035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abdcca8609e849618526a8b78385f77b',ramdisk_id='',reservation_id='r-mcpim35c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1084822713',owner_user_name='tempest-AttachVolumeTestJSON-1084822713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:07:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47b6f8fcb8f49dfa2383dfbf37d6c30',uuid=fdfb377e-119e-41ce-b9e0-6e21053306cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converting VIF {"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:13 user nova-compute[73917]: DEBUG nova.objects.instance [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'pci_devices' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:07:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:07:14 user nova-compute[73917]:   <uuid>fdfb377e-119e-41ce-b9e0-6e21053306cc</uuid>
Aug 26 19:07:14 user nova-compute[73917]:   <name>instance-00000005</name>
Aug 26 19:07:14 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:07:14 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:07:14 user nova-compute[73917]:   <metadata>
Aug 26 19:07:14 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:07:14 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:07:14 user nova-compute[73917]:       <nova:name>tempest-AttachVolumeTestJSON-server-699122116</nova:name>
Aug 26 19:07:14 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:07:13</nova:creationTime>
Aug 26 19:07:14 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:07:14 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:07:14 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:07:14 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:07:14 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:07:14 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:07:14 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:07:14 user nova-compute[73917]:       <nova:owner>
Aug 26 19:07:14 user nova-compute[73917]:         <nova:user uuid="a47b6f8fcb8f49dfa2383dfbf37d6c30">tempest-AttachVolumeTestJSON-1084822713-project-member</nova:user>
Aug 26 19:07:14 user nova-compute[73917]:         <nova:project uuid="abdcca8609e849618526a8b78385f77b">tempest-AttachVolumeTestJSON-1084822713</nova:project>
Aug 26 19:07:14 user nova-compute[73917]:       </nova:owner>
Aug 26 19:07:14 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:07:14 user nova-compute[73917]:       <nova:ports>
Aug 26 19:07:14 user nova-compute[73917]:         <nova:port uuid="37aa792a-c367-4dfd-b814-cb9c32ef373c">
Aug 26 19:07:14 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 19:07:14 user nova-compute[73917]:         </nova:port>
Aug 26 19:07:14 user nova-compute[73917]:       </nova:ports>
Aug 26 19:07:14 user nova-compute[73917]:     </nova:instance>
Aug 26 19:07:14 user nova-compute[73917]:   </metadata>
Aug 26 19:07:14 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:07:14 user nova-compute[73917]:     <system>
Aug 26 19:07:14 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:07:14 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:07:14 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:07:14 user nova-compute[73917]:       <entry name="serial">fdfb377e-119e-41ce-b9e0-6e21053306cc</entry>
Aug 26 19:07:14 user nova-compute[73917]:       <entry name="uuid">fdfb377e-119e-41ce-b9e0-6e21053306cc</entry>
Aug 26 19:07:14 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:07:14 user nova-compute[73917]:     </system>
Aug 26 19:07:14 user nova-compute[73917]:   </sysinfo>
Aug 26 19:07:14 user nova-compute[73917]:   <os>
Aug 26 19:07:14 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:07:14 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:07:14 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:07:14 user nova-compute[73917]:   </os>
Aug 26 19:07:14 user nova-compute[73917]:   <features>
Aug 26 19:07:14 user nova-compute[73917]:     <acpi/>
Aug 26 19:07:14 user nova-compute[73917]:     <apic/>
Aug 26 19:07:14 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:07:14 user nova-compute[73917]:   </features>
Aug 26 19:07:14 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:07:14 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:07:14 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:07:14 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:07:14 user nova-compute[73917]:   </clock>
Aug 26 19:07:14 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:07:14 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:07:14 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:07:14 user nova-compute[73917]:   </cpu>
Aug 26 19:07:14 user nova-compute[73917]:   <devices>
Aug 26 19:07:14 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:07:14 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:07:14 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk"/>
Aug 26 19:07:14 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:07:14 user nova-compute[73917]:     </disk>
Aug 26 19:07:14 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:07:14 user nova-compute[73917]:       <mac address="fa:16:3e:ce:ab:20"/>
Aug 26 19:07:14 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:14 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:07:14 user nova-compute[73917]:       <target dev="tap37aa792a-c3"/>
Aug 26 19:07:14 user nova-compute[73917]:     </interface>
Aug 26 19:07:14 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:07:14 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/console.log" append="off"/>
Aug 26 19:07:14 user nova-compute[73917]:     </serial>
Aug 26 19:07:14 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:07:14 user nova-compute[73917]:     <video>
Aug 26 19:07:14 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:14 user nova-compute[73917]:     </video>
Aug 26 19:07:14 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:07:14 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:07:14 user nova-compute[73917]:     </rng>
Aug 26 19:07:14 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:07:14 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:07:14 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:07:14 user nova-compute[73917]:     </memballoon>
Aug 26 19:07:14 user nova-compute[73917]:   </devices>
Aug 26 19:07:14 user nova-compute[73917]: </domain>
Aug 26 19:07:14 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:07:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-699122116',display_name='tempest-AttachVolumeTestJSON-server-699122116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-699122116',id=5,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHqeZabK3+K4aaugpyX8ly8/1rj5SN4GU9OQYd/thmmFlRmAKDNGqPnSs6iFVbJTbvqYDOtwahR3/8AlpHMnz55bssLgo5XLS59T+WFQ51mc2/usyY8DYb7AasV3fI19A==',key_name='tempest-keypair-67322035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abdcca8609e849618526a8b78385f77b',ramdisk_id='',reservation_id='r-mcpim35c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1084822713',owner_user_name='tempest-AttachVolumeTestJSON-1084822713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:07:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47b6f8fcb8f49dfa2383dfbf37d6c30',uuid=fdfb377e-119e-41ce-b9e0-6e21053306cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:07:14 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converting VIF {"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:14 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:14 user nova-compute[73917]: DEBUG os_vif [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:07:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:07:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37aa792a-c3, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37aa792a-c3, col_values=(('external_ids', {'iface-id': '37aa792a-c367-4dfd-b814-cb9c32ef373c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:ab:20', 'vm-uuid': 'fdfb377e-119e-41ce-b9e0-6e21053306cc'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:07:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:14 user nova-compute[73917]: INFO os_vif [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3')
Aug 26 19:07:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:07:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] No VIF found with MAC fa:16:3e:ce:ab:20, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:07:14 user nova-compute[73917]: DEBUG nova.network.neutron [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Successfully created port: 245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076835.5131323, 5dd60c10-f99a-431d-a66f-936a7a7a1c55 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:07:15 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] VM Resumed (Lifecycle Event)
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.compute.manager [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:15 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Instance spawned successfully.
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:07:15 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Instance spawned successfully.
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:07:15 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076835.5286603, 5dd60c10-f99a-431d-a66f-936a7a7a1c55 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:07:15 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] VM Started (Lifecycle Event)
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:15 user nova-compute[73917]: INFO nova.compute.manager [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Took 19.69 seconds to spawn the instance on the hypervisor.
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.compute.manager [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:15 user nova-compute[73917]: INFO nova.compute.manager [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Took 21.89 seconds to spawn the instance on the hypervisor.
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.compute.manager [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:07:15 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Instance spawned successfully.
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:16 user nova-compute[73917]: INFO nova.compute.manager [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Took 20.31 seconds to build instance.
Aug 26 19:07:16 user nova-compute[73917]: INFO nova.compute.manager [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Took 22.97 seconds to build instance.
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:07:16 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076835.5331383, cc0ae046-2a39-4ab6-9327-2d9452c3035d => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:07:16 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] VM Resumed (Lifecycle Event)
Aug 26 19:07:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8a405981-c186-4a5e-8fc5-8803a89ed0cf tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.500s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:16 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Instance spawned successfully.
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ae6d81a4-5542-4586-8e29-db502dabdd4b tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.220s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076835.5616033, cc0ae046-2a39-4ab6-9327-2d9452c3035d => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:07:16 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] VM Started (Lifecycle Event)
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:07:16 user nova-compute[73917]: INFO nova.compute.manager [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Took 17.71 seconds to spawn the instance on the hypervisor.
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076835.8981743, fd801f18-34b6-4682-8d43-edf82bd216c2 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:07:16 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] VM Resumed (Lifecycle Event)
Aug 26 19:07:16 user nova-compute[73917]: INFO nova.compute.manager [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Took 17.54 seconds to spawn the instance on the hypervisor.
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:07:16 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076835.9000783, fd801f18-34b6-4682-8d43-edf82bd216c2 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:07:16 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] VM Started (Lifecycle Event)
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:16 user nova-compute[73917]: INFO nova.compute.manager [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Took 18.86 seconds to build instance.
Aug 26 19:07:16 user nova-compute[73917]: INFO nova.compute.manager [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Took 18.95 seconds to build instance.
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2f795b3d-dbfc-4cb7-8936-1db93ed37068 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "ce383b5a-c726-4d82-b0e3-be6ac6659428" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.087s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-87e77852-2f23-4ed1-865d-d92defe90b8b tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.210s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076836.0839553, ce383b5a-c726-4d82-b0e3-be6ac6659428 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:07:16 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] VM Resumed (Lifecycle Event)
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.network.neutron [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Successfully updated port: 2738a59b-9109-4fef-8868-920d458dfaa1 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:07:16 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076836.084883, ce383b5a-c726-4d82-b0e3-be6ac6659428 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:07:16 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] VM Started (Lifecycle Event)
Aug 26 19:07:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquired lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:17 user nova-compute[73917]: DEBUG nova.network.neutron [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:07:17 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:17 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:07:17 user nova-compute[73917]: DEBUG nova.compute.manager [req-a0a48e0b-a7d1-4729-8420-7dd096d8f577 req-7fff78f5-efe4-4d20-97f3-17e31abeb585 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Received event network-changed-2738a59b-9109-4fef-8868-920d458dfaa1 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:17 user nova-compute[73917]: DEBUG nova.compute.manager [req-a0a48e0b-a7d1-4729-8420-7dd096d8f577 req-7fff78f5-efe4-4d20-97f3-17e31abeb585 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Refreshing instance network info cache due to event network-changed-2738a59b-9109-4fef-8868-920d458dfaa1. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:07:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a0a48e0b-a7d1-4729-8420-7dd096d8f577 req-7fff78f5-efe4-4d20-97f3-17e31abeb585 service nova] Acquiring lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:17 user nova-compute[73917]: DEBUG nova.network.neutron [req-df9a6d2e-a947-48ab-9f2f-c66058d7ed16 req-274cb90a-cb81-4983-9006-fd83df0fcf1e service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Updated VIF entry in instance network info cache for port 37aa792a-c367-4dfd-b814-cb9c32ef373c. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:07:17 user nova-compute[73917]: DEBUG nova.network.neutron [req-df9a6d2e-a947-48ab-9f2f-c66058d7ed16 req-274cb90a-cb81-4983-9006-fd83df0fcf1e service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Updating instance_info_cache with network_info: [{"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-df9a6d2e-a947-48ab-9f2f-c66058d7ed16 req-274cb90a-cb81-4983-9006-fd83df0fcf1e service nova] Releasing lock "refresh_cache-fdfb377e-119e-41ce-b9e0-6e21053306cc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:17 user nova-compute[73917]: DEBUG nova.network.neutron [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:07:18 user nova-compute[73917]: DEBUG nova.network.neutron [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Successfully updated port: 245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:07:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquired lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:18 user nova-compute[73917]: DEBUG nova.network.neutron [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:07:18 user nova-compute[73917]: DEBUG nova.compute.manager [req-ffa7ad15-d73f-4e74-9752-1b3e0e5c88f9 req-c91ba249-704b-4ec4-be69-53f55c4ea56b service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-changed-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:18 user nova-compute[73917]: DEBUG nova.compute.manager [req-ffa7ad15-d73f-4e74-9752-1b3e0e5c88f9 req-c91ba249-704b-4ec4-be69-53f55c4ea56b service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Refreshing instance network info cache due to event network-changed-245e99f5-fb5c-4442-b5f7-c2b05207f2fc. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:07:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ffa7ad15-d73f-4e74-9752-1b3e0e5c88f9 req-c91ba249-704b-4ec4-be69-53f55c4ea56b service nova] Acquiring lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:18 user nova-compute[73917]: DEBUG nova.network.neutron [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:07:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:18 user nova-compute[73917]: DEBUG nova.network.neutron [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Updating instance_info_cache with network_info: [{"id": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "address": "fa:16:3e:c9:58:2d", "network": {"id": "4fb39591-1339-423b-a17d-cec979856e60", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09772507cd24e329e84aa3b9a3b9b7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245e99f5-fb", "ovs_interfaceid": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Releasing lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:18 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Instance network_info: |[{"id": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "address": "fa:16:3e:c9:58:2d", "network": {"id": "4fb39591-1339-423b-a17d-cec979856e60", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09772507cd24e329e84aa3b9a3b9b7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245e99f5-fb", "ovs_interfaceid": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:07:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ffa7ad15-d73f-4e74-9752-1b3e0e5c88f9 req-c91ba249-704b-4ec4-be69-53f55c4ea56b service nova] Acquired lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:18 user nova-compute[73917]: DEBUG nova.network.neutron [req-ffa7ad15-d73f-4e74-9752-1b3e0e5c88f9 req-c91ba249-704b-4ec4-be69-53f55c4ea56b service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Refreshing network info cache for port 245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:07:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Start _get_guest_xml network_info=[{"id": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "address": "fa:16:3e:c9:58:2d", "network": {"id": "4fb39591-1339-423b-a17d-cec979856e60", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09772507cd24e329e84aa3b9a3b9b7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245e99f5-fb", "ovs_interfaceid": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:07:18 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:18 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:07:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-721860260',display_name='tempest-ServerStableDeviceRescueTest-server-721860260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-721860260',id=7,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJtE+qXdGZrkiAdBY0BxQ6ZEJ8XDZAjGtegAJ/SNt0X0lzJfk9WOgXrblFhQIglq06fSfLJPdWq+bnzSfz2VMsXVXqQKheHwQqItW7lqtTaiVh5HoXhBJLL+FVuuWpDjQ==',key_name='tempest-keypair-1387896357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09772507cd24e329e84aa3b9a3b9b7e',ramdisk_id='',reservation_id='r-0swkyi4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1025636115',owner_user_name='tempest-ServerStableDeviceRescueTest-1025636115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34c97061bd0a4b3897fb03769884043c',uuid=9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "address": "fa:16:3e:c9:58:2d", "network": {"id": "4fb39591-1339-423b-a17d-cec979856e60", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09772507cd24e329e84aa3b9a3b9b7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245e99f5-fb", "ovs_interfaceid": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Converting VIF {"id": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "address": "fa:16:3e:c9:58:2d", "network": {"id": "4fb39591-1339-423b-a17d-cec979856e60", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09772507cd24e329e84aa3b9a3b9b7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245e99f5-fb", "ovs_interfaceid": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:58:2d,bridge_name='br-int',has_traffic_filtering=True,id=245e99f5-fb5c-4442-b5f7-c2b05207f2fc,network=Network(4fb39591-1339-423b-a17d-cec979856e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap245e99f5-fb') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.objects.instance [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lazy-loading 'pci_devices' on Instance uuid 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:07:19 user nova-compute[73917]:   <uuid>9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6</uuid>
Aug 26 19:07:19 user nova-compute[73917]:   <name>instance-00000007</name>
Aug 26 19:07:19 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:07:19 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:07:19 user nova-compute[73917]:   <metadata>
Aug 26 19:07:19 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:07:19 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:07:19 user nova-compute[73917]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-721860260</nova:name>
Aug 26 19:07:19 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:07:18</nova:creationTime>
Aug 26 19:07:19 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:07:19 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:07:19 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:07:19 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:07:19 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:07:19 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:07:19 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:07:19 user nova-compute[73917]:       <nova:owner>
Aug 26 19:07:19 user nova-compute[73917]:         <nova:user uuid="34c97061bd0a4b3897fb03769884043c">tempest-ServerStableDeviceRescueTest-1025636115-project-member</nova:user>
Aug 26 19:07:19 user nova-compute[73917]:         <nova:project uuid="f09772507cd24e329e84aa3b9a3b9b7e">tempest-ServerStableDeviceRescueTest-1025636115</nova:project>
Aug 26 19:07:19 user nova-compute[73917]:       </nova:owner>
Aug 26 19:07:19 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:07:19 user nova-compute[73917]:       <nova:ports>
Aug 26 19:07:19 user nova-compute[73917]:         <nova:port uuid="245e99f5-fb5c-4442-b5f7-c2b05207f2fc">
Aug 26 19:07:19 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 19:07:19 user nova-compute[73917]:         </nova:port>
Aug 26 19:07:19 user nova-compute[73917]:       </nova:ports>
Aug 26 19:07:19 user nova-compute[73917]:     </nova:instance>
Aug 26 19:07:19 user nova-compute[73917]:   </metadata>
Aug 26 19:07:19 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:07:19 user nova-compute[73917]:     <system>
Aug 26 19:07:19 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:07:19 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:07:19 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:07:19 user nova-compute[73917]:       <entry name="serial">9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6</entry>
Aug 26 19:07:19 user nova-compute[73917]:       <entry name="uuid">9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6</entry>
Aug 26 19:07:19 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:07:19 user nova-compute[73917]:     </system>
Aug 26 19:07:19 user nova-compute[73917]:   </sysinfo>
Aug 26 19:07:19 user nova-compute[73917]:   <os>
Aug 26 19:07:19 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:07:19 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:07:19 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:07:19 user nova-compute[73917]:   </os>
Aug 26 19:07:19 user nova-compute[73917]:   <features>
Aug 26 19:07:19 user nova-compute[73917]:     <acpi/>
Aug 26 19:07:19 user nova-compute[73917]:     <apic/>
Aug 26 19:07:19 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:07:19 user nova-compute[73917]:   </features>
Aug 26 19:07:19 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:07:19 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:07:19 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:07:19 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:07:19 user nova-compute[73917]:   </clock>
Aug 26 19:07:19 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:07:19 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:07:19 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:07:19 user nova-compute[73917]:   </cpu>
Aug 26 19:07:19 user nova-compute[73917]:   <devices>
Aug 26 19:07:19 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:07:19 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:07:19 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk"/>
Aug 26 19:07:19 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:07:19 user nova-compute[73917]:     </disk>
Aug 26 19:07:19 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:07:19 user nova-compute[73917]:       <mac address="fa:16:3e:c9:58:2d"/>
Aug 26 19:07:19 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:19 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:07:19 user nova-compute[73917]:       <target dev="tap245e99f5-fb"/>
Aug 26 19:07:19 user nova-compute[73917]:     </interface>
Aug 26 19:07:19 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:07:19 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/console.log" append="off"/>
Aug 26 19:07:19 user nova-compute[73917]:     </serial>
Aug 26 19:07:19 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:07:19 user nova-compute[73917]:     <video>
Aug 26 19:07:19 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:19 user nova-compute[73917]:     </video>
Aug 26 19:07:19 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:07:19 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:07:19 user nova-compute[73917]:     </rng>
Aug 26 19:07:19 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:07:19 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:07:19 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:07:19 user nova-compute[73917]:     </memballoon>
Aug 26 19:07:19 user nova-compute[73917]:   </devices>
Aug 26 19:07:19 user nova-compute[73917]: </domain>
Aug 26 19:07:19 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-721860260',display_name='tempest-ServerStableDeviceRescueTest-server-721860260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-721860260',id=7,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJtE+qXdGZrkiAdBY0BxQ6ZEJ8XDZAjGtegAJ/SNt0X0lzJfk9WOgXrblFhQIglq06fSfLJPdWq+bnzSfz2VMsXVXqQKheHwQqItW7lqtTaiVh5HoXhBJLL+FVuuWpDjQ==',key_name='tempest-keypair-1387896357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09772507cd24e329e84aa3b9a3b9b7e',ramdisk_id='',reservation_id='r-0swkyi4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1025636115',owner_user_name='tempest-ServerStableDeviceRescueTest-1025636115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34c97061bd0a4b3897fb03769884043c',uuid=9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "address": "fa:16:3e:c9:58:2d", "network": {"id": "4fb39591-1339-423b-a17d-cec979856e60", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09772507cd24e329e84aa3b9a3b9b7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245e99f5-fb", "ovs_interfaceid": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Converting VIF {"id": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "address": "fa:16:3e:c9:58:2d", "network": {"id": "4fb39591-1339-423b-a17d-cec979856e60", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09772507cd24e329e84aa3b9a3b9b7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245e99f5-fb", "ovs_interfaceid": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:58:2d,bridge_name='br-int',has_traffic_filtering=True,id=245e99f5-fb5c-4442-b5f7-c2b05207f2fc,network=Network(4fb39591-1339-423b-a17d-cec979856e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap245e99f5-fb') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG os_vif [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:58:2d,bridge_name='br-int',has_traffic_filtering=True,id=245e99f5-fb5c-4442-b5f7-c2b05207f2fc,network=Network(4fb39591-1339-423b-a17d-cec979856e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap245e99f5-fb') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap245e99f5-fb, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap245e99f5-fb, col_values=(('external_ids', {'iface-id': '245e99f5-fb5c-4442-b5f7-c2b05207f2fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:58:2d', 'vm-uuid': '9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:19 user nova-compute[73917]: INFO os_vif [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:58:2d,bridge_name='br-int',has_traffic_filtering=True,id=245e99f5-fb5c-4442-b5f7-c2b05207f2fc,network=Network(4fb39591-1339-423b-a17d-cec979856e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap245e99f5-fb')
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] No VIF found with MAC fa:16:3e:c9:58:2d, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076839.3604262, fdfb377e-119e-41ce-b9e0-6e21053306cc => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:07:19 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] VM Resumed (Lifecycle Event)
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:19 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Instance spawned successfully.
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:07:19 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076839.362134, fdfb377e-119e-41ce-b9e0-6e21053306cc => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:07:19 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] VM Started (Lifecycle Event)
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:07:19 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:07:19 user nova-compute[73917]: INFO nova.compute.manager [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Took 17.21 seconds to spawn the instance on the hypervisor.
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.network.neutron [req-ffa7ad15-d73f-4e74-9752-1b3e0e5c88f9 req-c91ba249-704b-4ec4-be69-53f55c4ea56b service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Updated VIF entry in instance network info cache for port 245e99f5-fb5c-4442-b5f7-c2b05207f2fc. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG nova.network.neutron [req-ffa7ad15-d73f-4e74-9752-1b3e0e5c88f9 req-c91ba249-704b-4ec4-be69-53f55c4ea56b service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Updating instance_info_cache with network_info: [{"id": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "address": "fa:16:3e:c9:58:2d", "network": {"id": "4fb39591-1339-423b-a17d-cec979856e60", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09772507cd24e329e84aa3b9a3b9b7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245e99f5-fb", "ovs_interfaceid": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ffa7ad15-d73f-4e74-9752-1b3e0e5c88f9 req-c91ba249-704b-4ec4-be69-53f55c4ea56b service nova] Releasing lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:19 user nova-compute[73917]: INFO nova.compute.manager [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Took 17.99 seconds to build instance.
Aug 26 19:07:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bbc548ae-bd2f-4ae9-b1fe-79eff7867efd tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.154s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.network.neutron [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Updating instance_info_cache with network_info: [{"id": "2738a59b-9109-4fef-8868-920d458dfaa1", "address": "fa:16:3e:e9:a2:a3", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2738a59b-91", "ovs_interfaceid": "2738a59b-9109-4fef-8868-920d458dfaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Releasing lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Instance network_info: |[{"id": "2738a59b-9109-4fef-8868-920d458dfaa1", "address": "fa:16:3e:e9:a2:a3", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2738a59b-91", "ovs_interfaceid": "2738a59b-9109-4fef-8868-920d458dfaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a0a48e0b-a7d1-4729-8420-7dd096d8f577 req-7fff78f5-efe4-4d20-97f3-17e31abeb585 service nova] Acquired lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.network.neutron [req-a0a48e0b-a7d1-4729-8420-7dd096d8f577 req-7fff78f5-efe4-4d20-97f3-17e31abeb585 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Refreshing network info cache for port 2738a59b-9109-4fef-8868-920d458dfaa1 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Start _get_guest_xml network_info=[{"id": "2738a59b-9109-4fef-8868-920d458dfaa1", "address": "fa:16:3e:e9:a2:a3", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2738a59b-91", "ovs_interfaceid": "2738a59b-9109-4fef-8868-920d458dfaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:07:20 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:20 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1976679095',display_name='tempest-ServerActionsTestOtherA-server-1976679095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1976679095',id=6,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoE8tZDc68JWUNde0nWnasqq1vYa5ON2YNQwHw+xO1EiolhKGRVVBiykxwLyvBezUmZpO4CsEARWWqkHIKpn0pTvCPDPPJIP+G7BbRXcHe4wp+29J3exWEnrrk3yPKzjg==',key_name='tempest-keypair-1254307896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2e09fe7b38e4bb991bfaaf5b4ad357a',ramdisk_id='',reservation_id='r-zcmzv138',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2069094918',owner_user_name='tempest-ServerActionsTestOtherA-2069094918-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:07:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd1b7d3fe22c4b239cf03235866e17d4',uuid=1c12fdf0-17e7-438b-aa6c-729dd67676aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2738a59b-9109-4fef-8868-920d458dfaa1", "address": "fa:16:3e:e9:a2:a3", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2738a59b-91", "ovs_interfaceid": "2738a59b-9109-4fef-8868-920d458dfaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converting VIF {"id": "2738a59b-9109-4fef-8868-920d458dfaa1", "address": "fa:16:3e:e9:a2:a3", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2738a59b-91", "ovs_interfaceid": "2738a59b-9109-4fef-8868-920d458dfaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:a2:a3,bridge_name='br-int',has_traffic_filtering=True,id=2738a59b-9109-4fef-8868-920d458dfaa1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2738a59b-91') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.objects.instance [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c12fdf0-17e7-438b-aa6c-729dd67676aa {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:07:20 user nova-compute[73917]:   <uuid>1c12fdf0-17e7-438b-aa6c-729dd67676aa</uuid>
Aug 26 19:07:20 user nova-compute[73917]:   <name>instance-00000006</name>
Aug 26 19:07:20 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:07:20 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:07:20 user nova-compute[73917]:   <metadata>
Aug 26 19:07:20 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:07:20 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:07:20 user nova-compute[73917]:       <nova:name>tempest-ServerActionsTestOtherA-server-1976679095</nova:name>
Aug 26 19:07:20 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:07:20</nova:creationTime>
Aug 26 19:07:20 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:07:20 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:07:20 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:07:20 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:07:20 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:07:20 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:07:20 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:07:20 user nova-compute[73917]:       <nova:owner>
Aug 26 19:07:20 user nova-compute[73917]:         <nova:user uuid="cd1b7d3fe22c4b239cf03235866e17d4">tempest-ServerActionsTestOtherA-2069094918-project-member</nova:user>
Aug 26 19:07:20 user nova-compute[73917]:         <nova:project uuid="c2e09fe7b38e4bb991bfaaf5b4ad357a">tempest-ServerActionsTestOtherA-2069094918</nova:project>
Aug 26 19:07:20 user nova-compute[73917]:       </nova:owner>
Aug 26 19:07:20 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:07:20 user nova-compute[73917]:       <nova:ports>
Aug 26 19:07:20 user nova-compute[73917]:         <nova:port uuid="2738a59b-9109-4fef-8868-920d458dfaa1">
Aug 26 19:07:20 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 19:07:20 user nova-compute[73917]:         </nova:port>
Aug 26 19:07:20 user nova-compute[73917]:       </nova:ports>
Aug 26 19:07:20 user nova-compute[73917]:     </nova:instance>
Aug 26 19:07:20 user nova-compute[73917]:   </metadata>
Aug 26 19:07:20 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:07:20 user nova-compute[73917]:     <system>
Aug 26 19:07:20 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:07:20 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:07:20 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:07:20 user nova-compute[73917]:       <entry name="serial">1c12fdf0-17e7-438b-aa6c-729dd67676aa</entry>
Aug 26 19:07:20 user nova-compute[73917]:       <entry name="uuid">1c12fdf0-17e7-438b-aa6c-729dd67676aa</entry>
Aug 26 19:07:20 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:07:20 user nova-compute[73917]:     </system>
Aug 26 19:07:20 user nova-compute[73917]:   </sysinfo>
Aug 26 19:07:20 user nova-compute[73917]:   <os>
Aug 26 19:07:20 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:07:20 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:07:20 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:07:20 user nova-compute[73917]:   </os>
Aug 26 19:07:20 user nova-compute[73917]:   <features>
Aug 26 19:07:20 user nova-compute[73917]:     <acpi/>
Aug 26 19:07:20 user nova-compute[73917]:     <apic/>
Aug 26 19:07:20 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:07:20 user nova-compute[73917]:   </features>
Aug 26 19:07:20 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:07:20 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:07:20 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:07:20 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:07:20 user nova-compute[73917]:   </clock>
Aug 26 19:07:20 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:07:20 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:07:20 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:07:20 user nova-compute[73917]:   </cpu>
Aug 26 19:07:20 user nova-compute[73917]:   <devices>
Aug 26 19:07:20 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:07:20 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:07:20 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk"/>
Aug 26 19:07:20 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:07:20 user nova-compute[73917]:     </disk>
Aug 26 19:07:20 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:07:20 user nova-compute[73917]:       <mac address="fa:16:3e:e9:a2:a3"/>
Aug 26 19:07:20 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:20 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:07:20 user nova-compute[73917]:       <target dev="tap2738a59b-91"/>
Aug 26 19:07:20 user nova-compute[73917]:     </interface>
Aug 26 19:07:20 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:07:20 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/console.log" append="off"/>
Aug 26 19:07:20 user nova-compute[73917]:     </serial>
Aug 26 19:07:20 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:07:20 user nova-compute[73917]:     <video>
Aug 26 19:07:20 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:20 user nova-compute[73917]:     </video>
Aug 26 19:07:20 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:07:20 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:07:20 user nova-compute[73917]:     </rng>
Aug 26 19:07:20 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:07:20 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:07:20 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:07:20 user nova-compute[73917]:     </memballoon>
Aug 26 19:07:20 user nova-compute[73917]:   </devices>
Aug 26 19:07:20 user nova-compute[73917]: </domain>
Aug 26 19:07:20 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1976679095',display_name='tempest-ServerActionsTestOtherA-server-1976679095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1976679095',id=6,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoE8tZDc68JWUNde0nWnasqq1vYa5ON2YNQwHw+xO1EiolhKGRVVBiykxwLyvBezUmZpO4CsEARWWqkHIKpn0pTvCPDPPJIP+G7BbRXcHe4wp+29J3exWEnrrk3yPKzjg==',key_name='tempest-keypair-1254307896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2e09fe7b38e4bb991bfaaf5b4ad357a',ramdisk_id='',reservation_id='r-zcmzv138',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2069094918',owner_user_name='tempest-ServerActionsTestOtherA-2069094918-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:07:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd1b7d3fe22c4b239cf03235866e17d4',uuid=1c12fdf0-17e7-438b-aa6c-729dd67676aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2738a59b-9109-4fef-8868-920d458dfaa1", "address": "fa:16:3e:e9:a2:a3", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2738a59b-91", "ovs_interfaceid": "2738a59b-9109-4fef-8868-920d458dfaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converting VIF {"id": "2738a59b-9109-4fef-8868-920d458dfaa1", "address": "fa:16:3e:e9:a2:a3", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2738a59b-91", "ovs_interfaceid": "2738a59b-9109-4fef-8868-920d458dfaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:a2:a3,bridge_name='br-int',has_traffic_filtering=True,id=2738a59b-9109-4fef-8868-920d458dfaa1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2738a59b-91') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG os_vif [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:a2:a3,bridge_name='br-int',has_traffic_filtering=True,id=2738a59b-9109-4fef-8868-920d458dfaa1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2738a59b-91') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2738a59b-91, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2738a59b-91, col_values=(('external_ids', {'iface-id': '2738a59b-9109-4fef-8868-920d458dfaa1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:a2:a3', 'vm-uuid': '1c12fdf0-17e7-438b-aa6c-729dd67676aa'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:20 user nova-compute[73917]: INFO os_vif [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:a2:a3,bridge_name='br-int',has_traffic_filtering=True,id=2738a59b-9109-4fef-8868-920d458dfaa1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2738a59b-91')
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] No VIF found with MAC fa:16:3e:e9:a2:a3, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:21 user nova-compute[73917]: DEBUG nova.network.neutron [req-a0a48e0b-a7d1-4729-8420-7dd096d8f577 req-7fff78f5-efe4-4d20-97f3-17e31abeb585 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Updated VIF entry in instance network info cache for port 2738a59b-9109-4fef-8868-920d458dfaa1. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:07:21 user nova-compute[73917]: DEBUG nova.network.neutron [req-a0a48e0b-a7d1-4729-8420-7dd096d8f577 req-7fff78f5-efe4-4d20-97f3-17e31abeb585 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Updating instance_info_cache with network_info: [{"id": "2738a59b-9109-4fef-8868-920d458dfaa1", "address": "fa:16:3e:e9:a2:a3", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2738a59b-91", "ovs_interfaceid": "2738a59b-9109-4fef-8868-920d458dfaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a0a48e0b-a7d1-4729-8420-7dd096d8f577 req-7fff78f5-efe4-4d20-97f3-17e31abeb585 service nova] Releasing lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:26 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076846.8281908, 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:07:26 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] VM Resumed (Lifecycle Event)
Aug 26 19:07:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:07:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:07:26 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Instance spawned successfully.
Aug 26 19:07:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:07:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:07:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:27 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:07:27 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076846.8319037, 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:07:27 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] VM Started (Lifecycle Event)
Aug 26 19:07:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:07:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:07:27 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Instance spawned successfully.
Aug 26 19:07:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:07:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:07:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:27 user nova-compute[73917]: INFO nova.compute.manager [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Took 14.22 seconds to spawn the instance on the hypervisor.
Aug 26 19:07:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:27 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:07:27 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076847.0418084, 1c12fdf0-17e7-438b-aa6c-729dd67676aa => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:07:27 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] VM Resumed (Lifecycle Event)
Aug 26 19:07:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:07:27 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:07:27 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076847.048138, 1c12fdf0-17e7-438b-aa6c-729dd67676aa => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:07:27 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] VM Started (Lifecycle Event)
Aug 26 19:07:27 user nova-compute[73917]: INFO nova.compute.manager [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Took 15.37 seconds to build instance.
Aug 26 19:07:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:07:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d46ab4c1-d932-40be-bd33-ffe9a72ca3c3 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.469s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:27 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:07:27 user nova-compute[73917]: INFO nova.compute.manager [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Took 20.85 seconds to spawn the instance on the hypervisor.
Aug 26 19:07:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:27 user nova-compute[73917]: INFO nova.compute.manager [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Took 21.90 seconds to build instance.
Aug 26 19:07:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4572865f-5323-4361-a8e9-9f87735448b9 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.050s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-09d1518b-da0f-4aa7-898c-d8c02c010a66 req-c172c9b8-d321-4dd5-bbd2-3146218a4c0f service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-09d1518b-da0f-4aa7-898c-d8c02c010a66 req-c172c9b8-d321-4dd5-bbd2-3146218a4c0f service nova] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-09d1518b-da0f-4aa7-898c-d8c02c010a66 req-c172c9b8-d321-4dd5-bbd2-3146218a4c0f service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-09d1518b-da0f-4aa7-898c-d8c02c010a66 req-c172c9b8-d321-4dd5-bbd2-3146218a4c0f service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-09d1518b-da0f-4aa7-898c-d8c02c010a66 req-c172c9b8-d321-4dd5-bbd2-3146218a4c0f service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] No waiting events found dispatching network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:33 user nova-compute[73917]: WARNING nova.compute.manager [req-09d1518b-da0f-4aa7-898c-d8c02c010a66 req-c172c9b8-d321-4dd5-bbd2-3146218a4c0f service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received unexpected event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc for instance with vm_state active and task_state None.
Aug 26 19:07:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-6ba72079-41e7-489c-93b0-baf536082fad req-1367fd9a-5cb3-4a51-a577-0fe401c2d48a service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6ba72079-41e7-489c-93b0-baf536082fad req-1367fd9a-5cb3-4a51-a577-0fe401c2d48a service nova] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6ba72079-41e7-489c-93b0-baf536082fad req-1367fd9a-5cb3-4a51-a577-0fe401c2d48a service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6ba72079-41e7-489c-93b0-baf536082fad req-1367fd9a-5cb3-4a51-a577-0fe401c2d48a service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-6ba72079-41e7-489c-93b0-baf536082fad req-1367fd9a-5cb3-4a51-a577-0fe401c2d48a service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] No waiting events found dispatching network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:36 user nova-compute[73917]: WARNING nova.compute.manager [req-6ba72079-41e7-489c-93b0-baf536082fad req-1367fd9a-5cb3-4a51-a577-0fe401c2d48a service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received unexpected event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc for instance with vm_state active and task_state None.
Aug 26 19:07:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Acquiring lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:37 user nova-compute[73917]: DEBUG nova.compute.manager [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:07:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:37 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:07:37 user nova-compute[73917]: INFO nova.compute.claims [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Claim successful on node user
Aug 26 19:07:38 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG nova.compute.manager [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG nova.compute.manager [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG nova.network.neutron [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG nova.compute.manager [req-80b17d17-c403-4fd8-9e7b-b408ab353d78 req-aae8f9bf-385c-41e0-9714-2bd756d2006c service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Received event network-vif-plugged-70707344-848e-4e9b-baf4-6cfbb4737fb8 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-80b17d17-c403-4fd8-9e7b-b408ab353d78 req-aae8f9bf-385c-41e0-9714-2bd756d2006c service nova] Acquiring lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-80b17d17-c403-4fd8-9e7b-b408ab353d78 req-aae8f9bf-385c-41e0-9714-2bd756d2006c service nova] Lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-80b17d17-c403-4fd8-9e7b-b408ab353d78 req-aae8f9bf-385c-41e0-9714-2bd756d2006c service nova] Lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG nova.compute.manager [req-80b17d17-c403-4fd8-9e7b-b408ab353d78 req-aae8f9bf-385c-41e0-9714-2bd756d2006c service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] No waiting events found dispatching network-vif-plugged-70707344-848e-4e9b-baf4-6cfbb4737fb8 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:38 user nova-compute[73917]: WARNING nova.compute.manager [req-80b17d17-c403-4fd8-9e7b-b408ab353d78 req-aae8f9bf-385c-41e0-9714-2bd756d2006c service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Received unexpected event network-vif-plugged-70707344-848e-4e9b-baf4-6cfbb4737fb8 for instance with vm_state active and task_state None.
Aug 26 19:07:38 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:07:38 user nova-compute[73917]: DEBUG nova.compute.manager [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Acquiring lock "c8f0be92-c7bf-49cd-a4a4-23e625603081" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "c8f0be92-c7bf-49cd-a4a4-23e625603081" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG nova.compute.manager [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:07:38 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Creating image(s)
Aug 26 19:07:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Acquiring lock "/opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "/opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "/opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG nova.policy [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bea89f8fa9d469d818e732ebd61c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145ef38260474f159e954ecfa742224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:38 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:07:38 user nova-compute[73917]: INFO nova.compute.claims [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Claim successful on node user
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.223s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.231s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk 1073741824" returned: 0 in 0.112s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.668s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.213s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG nova.network.neutron [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:07:39 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 26 19:07:39 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG nova.policy [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f51ff450150246de99a05ea52cacd147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef2cfaaccb74aa1b6754a79dafbbfde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Cannot resize image /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Ensure instance console log exists: /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:07:39 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Creating image(s)
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "/opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "/opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Acquiring lock "09c8603eb9034e42faaee961f1867af3ea726519" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "09c8603eb9034e42faaee961f1867af3ea726519" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09c8603eb9034e42faaee961f1867af3ea726519.part --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:40 user nova-compute[73917]: DEBUG nova.network.neutron [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Successfully created port: c20cdde4-5ebd-4878-8eb2-4c62493255b9 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:07:40 user nova-compute[73917]: DEBUG nova.compute.manager [req-861acd77-0552-4cde-b6ab-f2a527cf8ae0 req-b7c88d77-5bb0-4a20-aa24-2086fca25da0 service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Received event network-vif-plugged-70707344-848e-4e9b-baf4-6cfbb4737fb8 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-861acd77-0552-4cde-b6ab-f2a527cf8ae0 req-b7c88d77-5bb0-4a20-aa24-2086fca25da0 service nova] Acquiring lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-861acd77-0552-4cde-b6ab-f2a527cf8ae0 req-b7c88d77-5bb0-4a20-aa24-2086fca25da0 service nova] Lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-861acd77-0552-4cde-b6ab-f2a527cf8ae0 req-b7c88d77-5bb0-4a20-aa24-2086fca25da0 service nova] Lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:40 user nova-compute[73917]: DEBUG nova.compute.manager [req-861acd77-0552-4cde-b6ab-f2a527cf8ae0 req-b7c88d77-5bb0-4a20-aa24-2086fca25da0 service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] No waiting events found dispatching network-vif-plugged-70707344-848e-4e9b-baf4-6cfbb4737fb8 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:40 user nova-compute[73917]: WARNING nova.compute.manager [req-861acd77-0552-4cde-b6ab-f2a527cf8ae0 req-b7c88d77-5bb0-4a20-aa24-2086fca25da0 service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Received unexpected event network-vif-plugged-70707344-848e-4e9b-baf4-6cfbb4737fb8 for instance with vm_state active and task_state None.
Aug 26 19:07:40 user nova-compute[73917]: DEBUG nova.compute.manager [req-861acd77-0552-4cde-b6ab-f2a527cf8ae0 req-b7c88d77-5bb0-4a20-aa24-2086fca25da0 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Received event network-vif-plugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-861acd77-0552-4cde-b6ab-f2a527cf8ae0 req-b7c88d77-5bb0-4a20-aa24-2086fca25da0 service nova] Acquiring lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-861acd77-0552-4cde-b6ab-f2a527cf8ae0 req-b7c88d77-5bb0-4a20-aa24-2086fca25da0 service nova] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-861acd77-0552-4cde-b6ab-f2a527cf8ae0 req-b7c88d77-5bb0-4a20-aa24-2086fca25da0 service nova] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:40 user nova-compute[73917]: DEBUG nova.compute.manager [req-861acd77-0552-4cde-b6ab-f2a527cf8ae0 req-b7c88d77-5bb0-4a20-aa24-2086fca25da0 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] No waiting events found dispatching network-vif-plugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:40 user nova-compute[73917]: WARNING nova.compute.manager [req-861acd77-0552-4cde-b6ab-f2a527cf8ae0 req-b7c88d77-5bb0-4a20-aa24-2086fca25da0 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Received unexpected event network-vif-plugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 for instance with vm_state active and task_state None.
Aug 26 19:07:40 user nova-compute[73917]: DEBUG nova.network.neutron [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Successfully created port: 2ad6ccc6-cb71-4105-88e4-cb48743f26ad {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:07:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09c8603eb9034e42faaee961f1867af3ea726519.part --force-share --output=json" returned: 0 in 0.287s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:40 user nova-compute[73917]: DEBUG nova.virt.images [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] ab083d8d-3182-45d9-8920-1dd347b48cc6 was qcow2, converting to raw {{(pid=73917) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 19:07:40 user nova-compute[73917]: DEBUG nova.privsep.utils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73917) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 19:07:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/09c8603eb9034e42faaee961f1867af3ea726519.part /opt/stack/data/nova/instances/_base/09c8603eb9034e42faaee961f1867af3ea726519.converted {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/09c8603eb9034e42faaee961f1867af3ea726519.part /opt/stack/data/nova/instances/_base/09c8603eb9034e42faaee961f1867af3ea726519.converted" returned: 0 in 0.171s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09c8603eb9034e42faaee961f1867af3ea726519.converted --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09c8603eb9034e42faaee961f1867af3ea726519.converted --force-share --output=json" returned: 0 in 0.213s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "09c8603eb9034e42faaee961f1867af3ea726519" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.178s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09c8603eb9034e42faaee961f1867af3ea726519 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09c8603eb9034e42faaee961f1867af3ea726519 --force-share --output=json" returned: 0 in 0.260s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Acquiring lock "09c8603eb9034e42faaee961f1867af3ea726519" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "09c8603eb9034e42faaee961f1867af3ea726519" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09c8603eb9034e42faaee961f1867af3ea726519 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG nova.network.neutron [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Successfully updated port: c20cdde4-5ebd-4878-8eb2-4c62493255b9 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Acquiring lock "refresh_cache-c8f0be92-c7bf-49cd-a4a4-23e625603081" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Acquired lock "refresh_cache-c8f0be92-c7bf-49cd-a4a4-23e625603081" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG nova.network.neutron [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG nova.compute.manager [req-18c5b889-e9c7-4ce4-9e01-685cd3feb766 req-e636485d-ceda-4c81-bc45-3ad37e201201 service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Received event network-changed-c20cdde4-5ebd-4878-8eb2-4c62493255b9 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG nova.compute.manager [req-18c5b889-e9c7-4ce4-9e01-685cd3feb766 req-e636485d-ceda-4c81-bc45-3ad37e201201 service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Refreshing instance network info cache due to event network-changed-c20cdde4-5ebd-4878-8eb2-4c62493255b9. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-18c5b889-e9c7-4ce4-9e01-685cd3feb766 req-e636485d-ceda-4c81-bc45-3ad37e201201 service nova] Acquiring lock "refresh_cache-c8f0be92-c7bf-49cd-a4a4-23e625603081" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09c8603eb9034e42faaee961f1867af3ea726519 --force-share --output=json" returned: 0 in 0.231s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09c8603eb9034e42faaee961f1867af3ea726519,backing_fmt=raw /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09c8603eb9034e42faaee961f1867af3ea726519,backing_fmt=raw /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk 1073741824" returned: 0 in 0.072s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "09c8603eb9034e42faaee961f1867af3ea726519" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09c8603eb9034e42faaee961f1867af3ea726519 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG nova.network.neutron [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquiring lock "86937c34-db86-44a9-8196-3cae0d7ce400" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "86937c34-db86-44a9-8196-3cae0d7ce400" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09c8603eb9034e42faaee961f1867af3ea726519 --force-share --output=json" returned: 0 in 0.253s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:07:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.network.neutron [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Successfully updated port: 2ad6ccc6-cb71-4105-88e4-cb48743f26ad {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Acquiring lock "refresh_cache-f019c6c6-e76f-4a75-8ba4-8c566d9f5791" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Acquired lock "refresh_cache-f019c6c6-e76f-4a75-8ba4-8c566d9f5791" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.network.neutron [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:07:42 user nova-compute[73917]: INFO nova.compute.claims [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Claim successful on node user
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.compute.manager [req-4c723b9a-41b3-4739-96b1-f963b326f513 req-951f5206-e1f9-4d0a-9687-ddd9e07d45fd service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Received event network-changed-2ad6ccc6-cb71-4105-88e4-cb48743f26ad {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.compute.manager [req-4c723b9a-41b3-4739-96b1-f963b326f513 req-951f5206-e1f9-4d0a-9687-ddd9e07d45fd service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Refreshing instance network info cache due to event network-changed-2ad6ccc6-cb71-4105-88e4-cb48743f26ad. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4c723b9a-41b3-4739-96b1-f963b326f513 req-951f5206-e1f9-4d0a-9687-ddd9e07d45fd service nova] Acquiring lock "refresh_cache-f019c6c6-e76f-4a75-8ba4-8c566d9f5791" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.network.neutron [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Cannot resize image /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Ensure instance console log exists: /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.network.neutron [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Updating instance_info_cache with network_info: [{"id": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "address": "fa:16:3e:be:0a:78", "network": {"id": "fef455a2-e475-421b-8d21-6ffa2b400885", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-784820277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef2cfaaccb74aa1b6754a79dafbbfde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20cdde4-5e", "ovs_interfaceid": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Releasing lock "refresh_cache-c8f0be92-c7bf-49cd-a4a4-23e625603081" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Instance network_info: |[{"id": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "address": "fa:16:3e:be:0a:78", "network": {"id": "fef455a2-e475-421b-8d21-6ffa2b400885", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-784820277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef2cfaaccb74aa1b6754a79dafbbfde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20cdde4-5e", "ovs_interfaceid": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-18c5b889-e9c7-4ce4-9e01-685cd3feb766 req-e636485d-ceda-4c81-bc45-3ad37e201201 service nova] Acquired lock "refresh_cache-c8f0be92-c7bf-49cd-a4a4-23e625603081" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.network.neutron [req-18c5b889-e9c7-4ce4-9e01-685cd3feb766 req-e636485d-ceda-4c81-bc45-3ad37e201201 service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Refreshing network info cache for port c20cdde4-5ebd-4878-8eb2-4c62493255b9 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Start _get_guest_xml network_info=[{"id": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "address": "fa:16:3e:be:0a:78", "network": {"id": "fef455a2-e475-421b-8d21-6ffa2b400885", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-784820277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef2cfaaccb74aa1b6754a79dafbbfde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20cdde4-5e", "ovs_interfaceid": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:07:30Z,direct_url=<?>,disk_format='qcow2',id=ab083d8d-3182-45d9-8920-1dd347b48cc6,min_disk=0,min_ram=0,name='',owner='f88c59cf64fa4661ae9ff49668c3bee0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': 'ab083d8d-3182-45d9-8920-1dd347b48cc6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:07:42 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:42 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:07:30Z,direct_url=<?>,disk_format='qcow2',id=ab083d8d-3182-45d9-8920-1dd347b48cc6,min_disk=0,min_ram=0,name='',owner='f88c59cf64fa4661ae9ff49668c3bee0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:07:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1997346454',display_name='tempest-AttachSCSIVolumeTestJSON-server-1997346454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1997346454',id=9,image_ref='ab083d8d-3182-45d9-8920-1dd347b48cc6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtjTaeOhyu8EWv2fQ3T3febpsPDq6N+PyebXfl7/hvsL2VUPTa9SI7ckbetaovnCB7kLf1GeMIjYjkCyX4h8LsJ19EHnl2ixE+OKo6y1QBsVTCYHAq6NFvbTHMYhHPUVw==',key_name='tempest-keypair-1697502471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ef2cfaaccb74aa1b6754a79dafbbfde',ramdisk_id='',reservation_id='r-0oflxl38',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ab083d8d-3182-45d9-8920-1dd347b48cc6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-770014971',owner_user_name='tempest-AttachSCSIVolumeTestJSON-770014971-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f51ff450150246de99a05ea52cacd147',uuid=c8f0be92-c7bf-49cd-a4a4-23e625603081,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "address": "fa:16:3e:be:0a:78", "network": {"id": "fef455a2-e475-421b-8d21-6ffa2b400885", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-784820277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef2cfaaccb74aa1b6754a79dafbbfde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20cdde4-5e", "ovs_interfaceid": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Converting VIF {"id": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "address": "fa:16:3e:be:0a:78", "network": {"id": "fef455a2-e475-421b-8d21-6ffa2b400885", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-784820277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef2cfaaccb74aa1b6754a79dafbbfde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20cdde4-5e", "ovs_interfaceid": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:0a:78,bridge_name='br-int',has_traffic_filtering=True,id=c20cdde4-5ebd-4878-8eb2-4c62493255b9,network=Network(fef455a2-e475-421b-8d21-6ffa2b400885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20cdde4-5e') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.objects.instance [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lazy-loading 'pci_devices' on Instance uuid c8f0be92-c7bf-49cd-a4a4-23e625603081 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:07:42 user nova-compute[73917]:   <uuid>c8f0be92-c7bf-49cd-a4a4-23e625603081</uuid>
Aug 26 19:07:42 user nova-compute[73917]:   <name>instance-00000009</name>
Aug 26 19:07:42 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:07:42 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:07:42 user nova-compute[73917]:   <metadata>
Aug 26 19:07:42 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:07:42 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:07:42 user nova-compute[73917]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1997346454</nova:name>
Aug 26 19:07:42 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:07:42</nova:creationTime>
Aug 26 19:07:42 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:07:42 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:07:42 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:07:42 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:07:42 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:07:42 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:07:42 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:07:42 user nova-compute[73917]:       <nova:owner>
Aug 26 19:07:42 user nova-compute[73917]:         <nova:user uuid="f51ff450150246de99a05ea52cacd147">tempest-AttachSCSIVolumeTestJSON-770014971-project-member</nova:user>
Aug 26 19:07:42 user nova-compute[73917]:         <nova:project uuid="5ef2cfaaccb74aa1b6754a79dafbbfde">tempest-AttachSCSIVolumeTestJSON-770014971</nova:project>
Aug 26 19:07:42 user nova-compute[73917]:       </nova:owner>
Aug 26 19:07:42 user nova-compute[73917]:       <nova:root type="image" uuid="ab083d8d-3182-45d9-8920-1dd347b48cc6"/>
Aug 26 19:07:42 user nova-compute[73917]:       <nova:ports>
Aug 26 19:07:42 user nova-compute[73917]:         <nova:port uuid="c20cdde4-5ebd-4878-8eb2-4c62493255b9">
Aug 26 19:07:42 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 19:07:42 user nova-compute[73917]:         </nova:port>
Aug 26 19:07:42 user nova-compute[73917]:       </nova:ports>
Aug 26 19:07:42 user nova-compute[73917]:     </nova:instance>
Aug 26 19:07:42 user nova-compute[73917]:   </metadata>
Aug 26 19:07:42 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:07:42 user nova-compute[73917]:     <system>
Aug 26 19:07:42 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:07:42 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:07:42 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:07:42 user nova-compute[73917]:       <entry name="serial">c8f0be92-c7bf-49cd-a4a4-23e625603081</entry>
Aug 26 19:07:42 user nova-compute[73917]:       <entry name="uuid">c8f0be92-c7bf-49cd-a4a4-23e625603081</entry>
Aug 26 19:07:42 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:07:42 user nova-compute[73917]:     </system>
Aug 26 19:07:42 user nova-compute[73917]:   </sysinfo>
Aug 26 19:07:42 user nova-compute[73917]:   <os>
Aug 26 19:07:42 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:07:42 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:07:42 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:07:42 user nova-compute[73917]:   </os>
Aug 26 19:07:42 user nova-compute[73917]:   <features>
Aug 26 19:07:42 user nova-compute[73917]:     <acpi/>
Aug 26 19:07:42 user nova-compute[73917]:     <apic/>
Aug 26 19:07:42 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:07:42 user nova-compute[73917]:   </features>
Aug 26 19:07:42 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:07:42 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:07:42 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:07:42 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:07:42 user nova-compute[73917]:   </clock>
Aug 26 19:07:42 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:07:42 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:07:42 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:07:42 user nova-compute[73917]:   </cpu>
Aug 26 19:07:42 user nova-compute[73917]:   <devices>
Aug 26 19:07:42 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:07:42 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:07:42 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk"/>
Aug 26 19:07:42 user nova-compute[73917]:       <target dev="sda" bus="scsi"/>
Aug 26 19:07:42 user nova-compute[73917]:       <address type="drive" controller="0" unit="0"/>
Aug 26 19:07:42 user nova-compute[73917]:     </disk>
Aug 26 19:07:42 user nova-compute[73917]:     <disk type="file" device="cdrom">
Aug 26 19:07:42 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 19:07:42 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk.config"/>
Aug 26 19:07:42 user nova-compute[73917]:       <target dev="sdb" bus="scsi"/>
Aug 26 19:07:42 user nova-compute[73917]:       <address type="drive" controller="0" unit="1"/>
Aug 26 19:07:42 user nova-compute[73917]:     </disk>
Aug 26 19:07:42 user nova-compute[73917]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 26 19:07:42 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:07:42 user nova-compute[73917]:       <mac address="fa:16:3e:be:0a:78"/>
Aug 26 19:07:42 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:42 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:07:42 user nova-compute[73917]:       <target dev="tapc20cdde4-5e"/>
Aug 26 19:07:42 user nova-compute[73917]:     </interface>
Aug 26 19:07:42 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:07:42 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/console.log" append="off"/>
Aug 26 19:07:42 user nova-compute[73917]:     </serial>
Aug 26 19:07:42 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:07:42 user nova-compute[73917]:     <video>
Aug 26 19:07:42 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:42 user nova-compute[73917]:     </video>
Aug 26 19:07:42 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:07:42 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:07:42 user nova-compute[73917]:     </rng>
Aug 26 19:07:42 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:07:42 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:07:42 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:07:42 user nova-compute[73917]:     </memballoon>
Aug 26 19:07:42 user nova-compute[73917]:   </devices>
Aug 26 19:07:42 user nova-compute[73917]: </domain>
Aug 26 19:07:42 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:07:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1997346454',display_name='tempest-AttachSCSIVolumeTestJSON-server-1997346454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1997346454',id=9,image_ref='ab083d8d-3182-45d9-8920-1dd347b48cc6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtjTaeOhyu8EWv2fQ3T3febpsPDq6N+PyebXfl7/hvsL2VUPTa9SI7ckbetaovnCB7kLf1GeMIjYjkCyX4h8LsJ19EHnl2ixE+OKo6y1QBsVTCYHAq6NFvbTHMYhHPUVw==',key_name='tempest-keypair-1697502471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ef2cfaaccb74aa1b6754a79dafbbfde',ramdisk_id='',reservation_id='r-0oflxl38',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ab083d8d-3182-45d9-8920-1dd347b48cc6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-770014971',owner_user_name='tempest-AttachSCSIVolumeTestJSON-770014971-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f51ff450150246de99a05ea52cacd147',uuid=c8f0be92-c7bf-49cd-a4a4-23e625603081,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "address": "fa:16:3e:be:0a:78", "network": {"id": "fef455a2-e475-421b-8d21-6ffa2b400885", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-784820277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef2cfaaccb74aa1b6754a79dafbbfde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20cdde4-5e", "ovs_interfaceid": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Converting VIF {"id": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "address": "fa:16:3e:be:0a:78", "network": {"id": "fef455a2-e475-421b-8d21-6ffa2b400885", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-784820277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef2cfaaccb74aa1b6754a79dafbbfde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20cdde4-5e", "ovs_interfaceid": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:0a:78,bridge_name='br-int',has_traffic_filtering=True,id=c20cdde4-5ebd-4878-8eb2-4c62493255b9,network=Network(fef455a2-e475-421b-8d21-6ffa2b400885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20cdde4-5e') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG os_vif [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0a:78,bridge_name='br-int',has_traffic_filtering=True,id=c20cdde4-5ebd-4878-8eb2-4c62493255b9,network=Network(fef455a2-e475-421b-8d21-6ffa2b400885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20cdde4-5e') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc20cdde4-5e, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc20cdde4-5e, col_values=(('external_ids', {'iface-id': 'c20cdde4-5ebd-4878-8eb2-4c62493255b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:0a:78', 'vm-uuid': 'c8f0be92-c7bf-49cd-a4a4-23e625603081'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:42 user nova-compute[73917]: INFO os_vif [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0a:78,bridge_name='br-int',has_traffic_filtering=True,id=c20cdde4-5ebd-4878-8eb2-4c62493255b9,network=Network(fef455a2-e475-421b-8d21-6ffa2b400885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20cdde4-5e')
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] No BDM found with device name sda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] No VIF found with MAC fa:16:3e:be:0a:78, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:07:42 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Using config drive
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.compute.manager [req-35a190f8-fb5e-4316-85f8-3c48c5b9a568 req-2752e233-c9ba-4a63-976d-c341a07861d3 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Received event network-vif-plugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-35a190f8-fb5e-4316-85f8-3c48c5b9a568 req-2752e233-c9ba-4a63-976d-c341a07861d3 service nova] Acquiring lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-35a190f8-fb5e-4316-85f8-3c48c5b9a568 req-2752e233-c9ba-4a63-976d-c341a07861d3 service nova] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-35a190f8-fb5e-4316-85f8-3c48c5b9a568 req-2752e233-c9ba-4a63-976d-c341a07861d3 service nova] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.compute.manager [req-35a190f8-fb5e-4316-85f8-3c48c5b9a568 req-2752e233-c9ba-4a63-976d-c341a07861d3 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] No waiting events found dispatching network-vif-plugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:42 user nova-compute[73917]: WARNING nova.compute.manager [req-35a190f8-fb5e-4316-85f8-3c48c5b9a568 req-2752e233-c9ba-4a63-976d-c341a07861d3 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Received unexpected event network-vif-plugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 for instance with vm_state active and task_state None.
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.compute.manager [req-35a190f8-fb5e-4316-85f8-3c48c5b9a568 req-2752e233-c9ba-4a63-976d-c341a07861d3 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-35a190f8-fb5e-4316-85f8-3c48c5b9a568 req-2752e233-c9ba-4a63-976d-c341a07861d3 service nova] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-35a190f8-fb5e-4316-85f8-3c48c5b9a568 req-2752e233-c9ba-4a63-976d-c341a07861d3 service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-35a190f8-fb5e-4316-85f8-3c48c5b9a568 req-2752e233-c9ba-4a63-976d-c341a07861d3 service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.compute.manager [req-35a190f8-fb5e-4316-85f8-3c48c5b9a568 req-2752e233-c9ba-4a63-976d-c341a07861d3 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] No waiting events found dispatching network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:42 user nova-compute[73917]: WARNING nova.compute.manager [req-35a190f8-fb5e-4316-85f8-3c48c5b9a568 req-2752e233-c9ba-4a63-976d-c341a07861d3 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received unexpected event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c for instance with vm_state active and task_state None.
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.745s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:07:42 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:07:43 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.network.neutron [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Updating instance_info_cache with network_info: [{"id": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "address": "fa:16:3e:90:3b:ae", "network": {"id": "d7f21c5c-fb69-4df5-aadb-b4712d9368cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-187373287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145ef38260474f159e954ecfa742224d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ad6ccc6-cb", "ovs_interfaceid": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Releasing lock "refresh_cache-f019c6c6-e76f-4a75-8ba4-8c566d9f5791" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.compute.manager [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Instance network_info: |[{"id": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "address": "fa:16:3e:90:3b:ae", "network": {"id": "d7f21c5c-fb69-4df5-aadb-b4712d9368cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-187373287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145ef38260474f159e954ecfa742224d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ad6ccc6-cb", "ovs_interfaceid": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:07:43 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Creating config drive at /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk.config
Aug 26 19:07:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpihadtyn0 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4c723b9a-41b3-4739-96b1-f963b326f513 req-951f5206-e1f9-4d0a-9687-ddd9e07d45fd service nova] Acquired lock "refresh_cache-f019c6c6-e76f-4a75-8ba4-8c566d9f5791" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.network.neutron [req-4c723b9a-41b3-4739-96b1-f963b326f513 req-951f5206-e1f9-4d0a-9687-ddd9e07d45fd service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Refreshing network info cache for port 2ad6ccc6-cb71-4105-88e4-cb48743f26ad {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Start _get_guest_xml network_info=[{"id": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "address": "fa:16:3e:90:3b:ae", "network": {"id": "d7f21c5c-fb69-4df5-aadb-b4712d9368cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-187373287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145ef38260474f159e954ecfa742224d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ad6ccc6-cb", "ovs_interfaceid": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.policy [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e883bb35273c4f9cacdc443695962e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec3e3b818b54192b32d90bb8240515e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:07:43 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:43 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1921623851',display_name='tempest-TestVolumeSwap-server-1921623851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1921623851',id=8,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4DxOeUrsWdoNPKwvW/Fztnax3C20SNZ4GuOmagGZ9rWi0hpw2iK9pfsOOl6n2MJwdLwGjNnl8umrV2gh6KR7RZvxM9RXZEymGUh/B6mB33DYqz/n9ycxSYBdRgxFcinQ==',key_name='tempest-keypair-702211707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='145ef38260474f159e954ecfa742224d',ramdisk_id='',reservation_id='r-abb4ljok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1550182461',owner_user_name='tempest-TestVolumeSwap-1550182461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:07:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bea89f8fa9d469d818e732ebd61c270',uuid=f019c6c6-e76f-4a75-8ba4-8c566d9f5791,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "address": "fa:16:3e:90:3b:ae", "network": {"id": "d7f21c5c-fb69-4df5-aadb-b4712d9368cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-187373287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145ef38260474f159e954ecfa742224d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ad6ccc6-cb", "ovs_interfaceid": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Converting VIF {"id": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "address": "fa:16:3e:90:3b:ae", "network": {"id": "d7f21c5c-fb69-4df5-aadb-b4712d9368cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-187373287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145ef38260474f159e954ecfa742224d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ad6ccc6-cb", "ovs_interfaceid": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:3b:ae,bridge_name='br-int',has_traffic_filtering=True,id=2ad6ccc6-cb71-4105-88e4-cb48743f26ad,network=Network(d7f21c5c-fb69-4df5-aadb-b4712d9368cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ad6ccc6-cb') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.objects.instance [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lazy-loading 'pci_devices' on Instance uuid f019c6c6-e76f-4a75-8ba4-8c566d9f5791 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:07:43 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Creating image(s)
Aug 26 19:07:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquiring lock "/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpihadtyn0" returned: 0 in 0.252s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:07:43 user nova-compute[73917]:   <uuid>f019c6c6-e76f-4a75-8ba4-8c566d9f5791</uuid>
Aug 26 19:07:43 user nova-compute[73917]:   <name>instance-00000008</name>
Aug 26 19:07:43 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:07:43 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:07:43 user nova-compute[73917]:   <metadata>
Aug 26 19:07:43 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:07:43 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:07:43 user nova-compute[73917]:       <nova:name>tempest-TestVolumeSwap-server-1921623851</nova:name>
Aug 26 19:07:43 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:07:43</nova:creationTime>
Aug 26 19:07:43 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:07:43 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:07:43 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:07:43 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:07:43 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:07:43 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:07:43 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:07:43 user nova-compute[73917]:       <nova:owner>
Aug 26 19:07:43 user nova-compute[73917]:         <nova:user uuid="0bea89f8fa9d469d818e732ebd61c270">tempest-TestVolumeSwap-1550182461-project-member</nova:user>
Aug 26 19:07:43 user nova-compute[73917]:         <nova:project uuid="145ef38260474f159e954ecfa742224d">tempest-TestVolumeSwap-1550182461</nova:project>
Aug 26 19:07:43 user nova-compute[73917]:       </nova:owner>
Aug 26 19:07:43 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:07:43 user nova-compute[73917]:       <nova:ports>
Aug 26 19:07:43 user nova-compute[73917]:         <nova:port uuid="2ad6ccc6-cb71-4105-88e4-cb48743f26ad">
Aug 26 19:07:43 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 19:07:43 user nova-compute[73917]:         </nova:port>
Aug 26 19:07:43 user nova-compute[73917]:       </nova:ports>
Aug 26 19:07:43 user nova-compute[73917]:     </nova:instance>
Aug 26 19:07:43 user nova-compute[73917]:   </metadata>
Aug 26 19:07:43 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:07:43 user nova-compute[73917]:     <system>
Aug 26 19:07:43 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:07:43 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:07:43 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:07:43 user nova-compute[73917]:       <entry name="serial">f019c6c6-e76f-4a75-8ba4-8c566d9f5791</entry>
Aug 26 19:07:43 user nova-compute[73917]:       <entry name="uuid">f019c6c6-e76f-4a75-8ba4-8c566d9f5791</entry>
Aug 26 19:07:43 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:07:43 user nova-compute[73917]:     </system>
Aug 26 19:07:43 user nova-compute[73917]:   </sysinfo>
Aug 26 19:07:43 user nova-compute[73917]:   <os>
Aug 26 19:07:43 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:07:43 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:07:43 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:07:43 user nova-compute[73917]:   </os>
Aug 26 19:07:43 user nova-compute[73917]:   <features>
Aug 26 19:07:43 user nova-compute[73917]:     <acpi/>
Aug 26 19:07:43 user nova-compute[73917]:     <apic/>
Aug 26 19:07:43 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:07:43 user nova-compute[73917]:   </features>
Aug 26 19:07:43 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:07:43 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:07:43 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:07:43 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:07:43 user nova-compute[73917]:   </clock>
Aug 26 19:07:43 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:07:43 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:07:43 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:07:43 user nova-compute[73917]:   </cpu>
Aug 26 19:07:43 user nova-compute[73917]:   <devices>
Aug 26 19:07:43 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:07:43 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:07:43 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk"/>
Aug 26 19:07:43 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:07:43 user nova-compute[73917]:     </disk>
Aug 26 19:07:43 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:07:43 user nova-compute[73917]:       <mac address="fa:16:3e:90:3b:ae"/>
Aug 26 19:07:43 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:43 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:07:43 user nova-compute[73917]:       <target dev="tap2ad6ccc6-cb"/>
Aug 26 19:07:43 user nova-compute[73917]:     </interface>
Aug 26 19:07:43 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:07:43 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/console.log" append="off"/>
Aug 26 19:07:43 user nova-compute[73917]:     </serial>
Aug 26 19:07:43 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:07:43 user nova-compute[73917]:     <video>
Aug 26 19:07:43 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:43 user nova-compute[73917]:     </video>
Aug 26 19:07:43 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:07:43 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:07:43 user nova-compute[73917]:     </rng>
Aug 26 19:07:43 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:07:43 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:07:43 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:07:43 user nova-compute[73917]:     </memballoon>
Aug 26 19:07:43 user nova-compute[73917]:   </devices>
Aug 26 19:07:43 user nova-compute[73917]: </domain>
Aug 26 19:07:43 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1921623851',display_name='tempest-TestVolumeSwap-server-1921623851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1921623851',id=8,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4DxOeUrsWdoNPKwvW/Fztnax3C20SNZ4GuOmagGZ9rWi0hpw2iK9pfsOOl6n2MJwdLwGjNnl8umrV2gh6KR7RZvxM9RXZEymGUh/B6mB33DYqz/n9ycxSYBdRgxFcinQ==',key_name='tempest-keypair-702211707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='145ef38260474f159e954ecfa742224d',ramdisk_id='',reservation_id='r-abb4ljok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1550182461',owner_user_name='tempest-TestVolumeSwap-1550182461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:07:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bea89f8fa9d469d818e732ebd61c270',uuid=f019c6c6-e76f-4a75-8ba4-8c566d9f5791,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "address": "fa:16:3e:90:3b:ae", "network": {"id": "d7f21c5c-fb69-4df5-aadb-b4712d9368cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-187373287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145ef38260474f159e954ecfa742224d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ad6ccc6-cb", "ovs_interfaceid": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Converting VIF {"id": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "address": "fa:16:3e:90:3b:ae", "network": {"id": "d7f21c5c-fb69-4df5-aadb-b4712d9368cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-187373287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145ef38260474f159e954ecfa742224d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ad6ccc6-cb", "ovs_interfaceid": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:3b:ae,bridge_name='br-int',has_traffic_filtering=True,id=2ad6ccc6-cb71-4105-88e4-cb48743f26ad,network=Network(d7f21c5c-fb69-4df5-aadb-b4712d9368cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ad6ccc6-cb') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG os_vif [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:3b:ae,bridge_name='br-int',has_traffic_filtering=True,id=2ad6ccc6-cb71-4105-88e4-cb48743f26ad,network=Network(d7f21c5c-fb69-4df5-aadb-b4712d9368cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ad6ccc6-cb') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.network.neutron [req-18c5b889-e9c7-4ce4-9e01-685cd3feb766 req-e636485d-ceda-4c81-bc45-3ad37e201201 service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Updated VIF entry in instance network info cache for port c20cdde4-5ebd-4878-8eb2-4c62493255b9. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.network.neutron [req-18c5b889-e9c7-4ce4-9e01-685cd3feb766 req-e636485d-ceda-4c81-bc45-3ad37e201201 service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Updating instance_info_cache with network_info: [{"id": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "address": "fa:16:3e:be:0a:78", "network": {"id": "fef455a2-e475-421b-8d21-6ffa2b400885", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-784820277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef2cfaaccb74aa1b6754a79dafbbfde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20cdde4-5e", "ovs_interfaceid": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ad6ccc6-cb, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ad6ccc6-cb, col_values=(('external_ids', {'iface-id': '2ad6ccc6-cb71-4105-88e4-cb48743f26ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:3b:ae', 'vm-uuid': 'f019c6c6-e76f-4a75-8ba4-8c566d9f5791'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-18c5b889-e9c7-4ce4-9e01-685cd3feb766 req-e636485d-ceda-4c81-bc45-3ad37e201201 service nova] Releasing lock "refresh_cache-c8f0be92-c7bf-49cd-a4a4-23e625603081" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:43 user nova-compute[73917]: INFO os_vif [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:3b:ae,bridge_name='br-int',has_traffic_filtering=True,id=2ad6ccc6-cb71-4105-88e4-cb48743f26ad,network=Network(d7f21c5c-fb69-4df5-aadb-b4712d9368cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ad6ccc6-cb')
Aug 26 19:07:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.246s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] No VIF found with MAC fa:16:3e:90:3b:ae, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:07:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.352s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk 1073741824" returned: 0 in 0.091s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.449s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG nova.network.neutron [req-4c723b9a-41b3-4739-96b1-f963b326f513 req-951f5206-e1f9-4d0a-9687-ddd9e07d45fd service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Updated VIF entry in instance network info cache for port 2ad6ccc6-cb71-4105-88e4-cb48743f26ad. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG nova.network.neutron [req-4c723b9a-41b3-4739-96b1-f963b326f513 req-951f5206-e1f9-4d0a-9687-ddd9e07d45fd service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Updating instance_info_cache with network_info: [{"id": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "address": "fa:16:3e:90:3b:ae", "network": {"id": "d7f21c5c-fb69-4df5-aadb-b4712d9368cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-187373287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145ef38260474f159e954ecfa742224d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ad6ccc6-cb", "ovs_interfaceid": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4c723b9a-41b3-4739-96b1-f963b326f513 req-951f5206-e1f9-4d0a-9687-ddd9e07d45fd service nova] Releasing lock "refresh_cache-f019c6c6-e76f-4a75-8ba4-8c566d9f5791" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.202s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] There are 0 instances to clean {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73917) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Successfully created port: 0fd58968-f9e8-40f0-acff-8efea741379e {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Cannot resize image /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Ensure instance console log exists: /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG nova.compute.manager [req-66545515-6933-46c2-b8ce-d4bfb5b644de req-1dacf517-c58f-4961-8414-88d666fd1847 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received event network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-66545515-6933-46c2-b8ce-d4bfb5b644de req-1dacf517-c58f-4961-8414-88d666fd1847 service nova] Acquiring lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-66545515-6933-46c2-b8ce-d4bfb5b644de req-1dacf517-c58f-4961-8414-88d666fd1847 service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-66545515-6933-46c2-b8ce-d4bfb5b644de req-1dacf517-c58f-4961-8414-88d666fd1847 service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:44 user nova-compute[73917]: DEBUG nova.compute.manager [req-66545515-6933-46c2-b8ce-d4bfb5b644de req-1dacf517-c58f-4961-8414-88d666fd1847 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] No waiting events found dispatching network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:44 user nova-compute[73917]: WARNING nova.compute.manager [req-66545515-6933-46c2-b8ce-d4bfb5b644de req-1dacf517-c58f-4961-8414-88d666fd1847 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received unexpected event network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b for instance with vm_state active and task_state None.
Aug 26 19:07:45 user nova-compute[73917]: DEBUG nova.compute.manager [req-222e71b9-1073-4db0-a44b-797d98f17512 req-8125ed51-ac6f-4122-9fc4-f2eb51780138 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-222e71b9-1073-4db0-a44b-797d98f17512 req-8125ed51-ac6f-4122-9fc4-f2eb51780138 service nova] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-222e71b9-1073-4db0-a44b-797d98f17512 req-8125ed51-ac6f-4122-9fc4-f2eb51780138 service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-222e71b9-1073-4db0-a44b-797d98f17512 req-8125ed51-ac6f-4122-9fc4-f2eb51780138 service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:45 user nova-compute[73917]: DEBUG nova.compute.manager [req-222e71b9-1073-4db0-a44b-797d98f17512 req-8125ed51-ac6f-4122-9fc4-f2eb51780138 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] No waiting events found dispatching network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:45 user nova-compute[73917]: WARNING nova.compute.manager [req-222e71b9-1073-4db0-a44b-797d98f17512 req-8125ed51-ac6f-4122-9fc4-f2eb51780138 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received unexpected event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c for instance with vm_state active and task_state None.
Aug 26 19:07:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:45 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Successfully updated port: 0fd58968-f9e8-40f0-acff-8efea741379e {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:07:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquiring lock "refresh_cache-86937c34-db86-44a9-8196-3cae0d7ce400" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquired lock "refresh_cache-86937c34-db86-44a9-8196-3cae0d7ce400" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:45 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:07:45 user nova-compute[73917]: DEBUG nova.compute.manager [req-4e88adeb-2e2c-4d14-8583-30f2a2e0b63d req-72d18131-8328-40cb-b60a-1e250da8cc6a service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received event network-changed-0fd58968-f9e8-40f0-acff-8efea741379e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:45 user nova-compute[73917]: DEBUG nova.compute.manager [req-4e88adeb-2e2c-4d14-8583-30f2a2e0b63d req-72d18131-8328-40cb-b60a-1e250da8cc6a service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Refreshing instance network info cache due to event network-changed-0fd58968-f9e8-40f0-acff-8efea741379e. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:07:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4e88adeb-2e2c-4d14-8583-30f2a2e0b63d req-72d18131-8328-40cb-b60a-1e250da8cc6a service nova] Acquiring lock "refresh_cache-86937c34-db86-44a9-8196-3cae0d7ce400" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Updating instance_info_cache with network_info: [{"id": "0fd58968-f9e8-40f0-acff-8efea741379e", "address": "fa:16:3e:b3:2d:13", "network": {"id": "02545642-9a23-4d7d-8ff0-231150ea7ced", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2072904890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd58968-f9", "ovs_interfaceid": "0fd58968-f9e8-40f0-acff-8efea741379e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Releasing lock "refresh_cache-86937c34-db86-44a9-8196-3cae0d7ce400" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Instance network_info: |[{"id": "0fd58968-f9e8-40f0-acff-8efea741379e", "address": "fa:16:3e:b3:2d:13", "network": {"id": "02545642-9a23-4d7d-8ff0-231150ea7ced", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2072904890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd58968-f9", "ovs_interfaceid": "0fd58968-f9e8-40f0-acff-8efea741379e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4e88adeb-2e2c-4d14-8583-30f2a2e0b63d req-72d18131-8328-40cb-b60a-1e250da8cc6a service nova] Acquired lock "refresh_cache-86937c34-db86-44a9-8196-3cae0d7ce400" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.network.neutron [req-4e88adeb-2e2c-4d14-8583-30f2a2e0b63d req-72d18131-8328-40cb-b60a-1e250da8cc6a service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Refreshing network info cache for port 0fd58968-f9e8-40f0-acff-8efea741379e {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Start _get_guest_xml network_info=[{"id": "0fd58968-f9e8-40f0-acff-8efea741379e", "address": "fa:16:3e:b3:2d:13", "network": {"id": "02545642-9a23-4d7d-8ff0-231150ea7ced", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2072904890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd58968-f9", "ovs_interfaceid": "0fd58968-f9e8-40f0-acff-8efea741379e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:07:46 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:46 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152870467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1152870467',id=10,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh0Gq1qVrt69OKjzmbhUuqTEU+L2JyHLQ3aEGP1I2l94+VWUqaxZlu45tMYdws2tmkIV0iudsUfn6jRdBXdutT2e0DfOoTHtyHz97pVCSRiDLTiyRN8NsP3m644FqnDUA==',key_name='tempest-keypair-2122776356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cec3e3b818b54192b32d90bb8240515e',ramdisk_id='',reservation_id='r-8k2gu0ce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1228202789',owner_user_name='tempest-TaggedAttachmentsTest-1228202789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e883bb35273c4f9cacdc443695962e5d',uuid=86937c34-db86-44a9-8196-3cae0d7ce400,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fd58968-f9e8-40f0-acff-8efea741379e", "address": "fa:16:3e:b3:2d:13", "network": {"id": "02545642-9a23-4d7d-8ff0-231150ea7ced", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2072904890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd58968-f9", "ovs_interfaceid": "0fd58968-f9e8-40f0-acff-8efea741379e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Converting VIF {"id": "0fd58968-f9e8-40f0-acff-8efea741379e", "address": "fa:16:3e:b3:2d:13", "network": {"id": "02545642-9a23-4d7d-8ff0-231150ea7ced", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2072904890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd58968-f9", "ovs_interfaceid": "0fd58968-f9e8-40f0-acff-8efea741379e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2d:13,bridge_name='br-int',has_traffic_filtering=True,id=0fd58968-f9e8-40f0-acff-8efea741379e,network=Network(02545642-9a23-4d7d-8ff0-231150ea7ced),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd58968-f9') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lazy-loading 'pci_devices' on Instance uuid 86937c34-db86-44a9-8196-3cae0d7ce400 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:07:46 user nova-compute[73917]:   <uuid>86937c34-db86-44a9-8196-3cae0d7ce400</uuid>
Aug 26 19:07:46 user nova-compute[73917]:   <name>instance-0000000a</name>
Aug 26 19:07:46 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:07:46 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:07:46 user nova-compute[73917]:   <metadata>
Aug 26 19:07:46 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:07:46 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:07:46 user nova-compute[73917]:       <nova:name>tempest-device-tagging-server-1152870467</nova:name>
Aug 26 19:07:46 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:07:46</nova:creationTime>
Aug 26 19:07:46 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:07:46 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:07:46 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:07:46 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:07:46 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:07:46 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:07:46 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:07:46 user nova-compute[73917]:       <nova:owner>
Aug 26 19:07:46 user nova-compute[73917]:         <nova:user uuid="e883bb35273c4f9cacdc443695962e5d">tempest-TaggedAttachmentsTest-1228202789-project-member</nova:user>
Aug 26 19:07:46 user nova-compute[73917]:         <nova:project uuid="cec3e3b818b54192b32d90bb8240515e">tempest-TaggedAttachmentsTest-1228202789</nova:project>
Aug 26 19:07:46 user nova-compute[73917]:       </nova:owner>
Aug 26 19:07:46 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:07:46 user nova-compute[73917]:       <nova:ports>
Aug 26 19:07:46 user nova-compute[73917]:         <nova:port uuid="0fd58968-f9e8-40f0-acff-8efea741379e">
Aug 26 19:07:46 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 19:07:46 user nova-compute[73917]:         </nova:port>
Aug 26 19:07:46 user nova-compute[73917]:       </nova:ports>
Aug 26 19:07:46 user nova-compute[73917]:     </nova:instance>
Aug 26 19:07:46 user nova-compute[73917]:   </metadata>
Aug 26 19:07:46 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:07:46 user nova-compute[73917]:     <system>
Aug 26 19:07:46 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:07:46 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:07:46 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:07:46 user nova-compute[73917]:       <entry name="serial">86937c34-db86-44a9-8196-3cae0d7ce400</entry>
Aug 26 19:07:46 user nova-compute[73917]:       <entry name="uuid">86937c34-db86-44a9-8196-3cae0d7ce400</entry>
Aug 26 19:07:46 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:07:46 user nova-compute[73917]:     </system>
Aug 26 19:07:46 user nova-compute[73917]:   </sysinfo>
Aug 26 19:07:46 user nova-compute[73917]:   <os>
Aug 26 19:07:46 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:07:46 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:07:46 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:07:46 user nova-compute[73917]:   </os>
Aug 26 19:07:46 user nova-compute[73917]:   <features>
Aug 26 19:07:46 user nova-compute[73917]:     <acpi/>
Aug 26 19:07:46 user nova-compute[73917]:     <apic/>
Aug 26 19:07:46 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:07:46 user nova-compute[73917]:   </features>
Aug 26 19:07:46 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:07:46 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:07:46 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:07:46 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:07:46 user nova-compute[73917]:   </clock>
Aug 26 19:07:46 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:07:46 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:07:46 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:07:46 user nova-compute[73917]:   </cpu>
Aug 26 19:07:46 user nova-compute[73917]:   <devices>
Aug 26 19:07:46 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:07:46 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:07:46 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk"/>
Aug 26 19:07:46 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:07:46 user nova-compute[73917]:     </disk>
Aug 26 19:07:46 user nova-compute[73917]:     <disk type="file" device="cdrom">
Aug 26 19:07:46 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 19:07:46 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk.config"/>
Aug 26 19:07:46 user nova-compute[73917]:       <target dev="hda" bus="ide"/>
Aug 26 19:07:46 user nova-compute[73917]:     </disk>
Aug 26 19:07:46 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:07:46 user nova-compute[73917]:       <mac address="fa:16:3e:b3:2d:13"/>
Aug 26 19:07:46 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:46 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:07:46 user nova-compute[73917]:       <target dev="tap0fd58968-f9"/>
Aug 26 19:07:46 user nova-compute[73917]:     </interface>
Aug 26 19:07:46 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:07:46 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/console.log" append="off"/>
Aug 26 19:07:46 user nova-compute[73917]:     </serial>
Aug 26 19:07:46 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:07:46 user nova-compute[73917]:     <video>
Aug 26 19:07:46 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:46 user nova-compute[73917]:     </video>
Aug 26 19:07:46 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:07:46 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:07:46 user nova-compute[73917]:     </rng>
Aug 26 19:07:46 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:07:46 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:07:46 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:07:46 user nova-compute[73917]:     </memballoon>
Aug 26 19:07:46 user nova-compute[73917]:   </devices>
Aug 26 19:07:46 user nova-compute[73917]: </domain>
Aug 26 19:07:46 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152870467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1152870467',id=10,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh0Gq1qVrt69OKjzmbhUuqTEU+L2JyHLQ3aEGP1I2l94+VWUqaxZlu45tMYdws2tmkIV0iudsUfn6jRdBXdutT2e0DfOoTHtyHz97pVCSRiDLTiyRN8NsP3m644FqnDUA==',key_name='tempest-keypair-2122776356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cec3e3b818b54192b32d90bb8240515e',ramdisk_id='',reservation_id='r-8k2gu0ce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1228202789',owner_user_name='tempest-TaggedAttachmentsTest-1228202789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e883bb35273c4f9cacdc443695962e5d',uuid=86937c34-db86-44a9-8196-3cae0d7ce400,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fd58968-f9e8-40f0-acff-8efea741379e", "address": "fa:16:3e:b3:2d:13", "network": {"id": "02545642-9a23-4d7d-8ff0-231150ea7ced", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2072904890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd58968-f9", "ovs_interfaceid": "0fd58968-f9e8-40f0-acff-8efea741379e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Converting VIF {"id": "0fd58968-f9e8-40f0-acff-8efea741379e", "address": "fa:16:3e:b3:2d:13", "network": {"id": "02545642-9a23-4d7d-8ff0-231150ea7ced", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2072904890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd58968-f9", "ovs_interfaceid": "0fd58968-f9e8-40f0-acff-8efea741379e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2d:13,bridge_name='br-int',has_traffic_filtering=True,id=0fd58968-f9e8-40f0-acff-8efea741379e,network=Network(02545642-9a23-4d7d-8ff0-231150ea7ced),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd58968-f9') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG os_vif [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2d:13,bridge_name='br-int',has_traffic_filtering=True,id=0fd58968-f9e8-40f0-acff-8efea741379e,network=Network(02545642-9a23-4d7d-8ff0-231150ea7ced),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd58968-f9') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fd58968-f9, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0fd58968-f9, col_values=(('external_ids', {'iface-id': '0fd58968-f9e8-40f0-acff-8efea741379e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:2d:13', 'vm-uuid': '86937c34-db86-44a9-8196-3cae0d7ce400'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:46 user nova-compute[73917]: INFO os_vif [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2d:13,bridge_name='br-int',has_traffic_filtering=True,id=0fd58968-f9e8-40f0-acff-8efea741379e,network=Network(02545642-9a23-4d7d-8ff0-231150ea7ced),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd58968-f9')
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] No BDM found with device name hda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] No VIF found with MAC fa:16:3e:b3:2d:13, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:07:46 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Using config drive
Aug 26 19:07:46 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Creating config drive at /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk.config
Aug 26 19:07:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb4_xwtds {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb4_xwtds" returned: 0 in 0.067s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.compute.manager [req-626f60a5-15f5-4d42-b8f7-35ddf6819704 req-54e3cedf-4c5b-447f-96c1-79da64c3ee6a service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received event network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-626f60a5-15f5-4d42-b8f7-35ddf6819704 req-54e3cedf-4c5b-447f-96c1-79da64c3ee6a service nova] Acquiring lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-626f60a5-15f5-4d42-b8f7-35ddf6819704 req-54e3cedf-4c5b-447f-96c1-79da64c3ee6a service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-626f60a5-15f5-4d42-b8f7-35ddf6819704 req-54e3cedf-4c5b-447f-96c1-79da64c3ee6a service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.compute.manager [req-626f60a5-15f5-4d42-b8f7-35ddf6819704 req-54e3cedf-4c5b-447f-96c1-79da64c3ee6a service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] No waiting events found dispatching network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:46 user nova-compute[73917]: WARNING nova.compute.manager [req-626f60a5-15f5-4d42-b8f7-35ddf6819704 req-54e3cedf-4c5b-447f-96c1-79da64c3ee6a service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received unexpected event network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b for instance with vm_state active and task_state None.
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.compute.manager [req-626f60a5-15f5-4d42-b8f7-35ddf6819704 req-54e3cedf-4c5b-447f-96c1-79da64c3ee6a service nova] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Received event network-vif-plugged-a8f8f32c-cf87-43ae-b6db-43da89ab6888 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-626f60a5-15f5-4d42-b8f7-35ddf6819704 req-54e3cedf-4c5b-447f-96c1-79da64c3ee6a service nova] Acquiring lock "ce383b5a-c726-4d82-b0e3-be6ac6659428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-626f60a5-15f5-4d42-b8f7-35ddf6819704 req-54e3cedf-4c5b-447f-96c1-79da64c3ee6a service nova] Lock "ce383b5a-c726-4d82-b0e3-be6ac6659428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-626f60a5-15f5-4d42-b8f7-35ddf6819704 req-54e3cedf-4c5b-447f-96c1-79da64c3ee6a service nova] Lock "ce383b5a-c726-4d82-b0e3-be6ac6659428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.compute.manager [req-626f60a5-15f5-4d42-b8f7-35ddf6819704 req-54e3cedf-4c5b-447f-96c1-79da64c3ee6a service nova] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] No waiting events found dispatching network-vif-plugged-a8f8f32c-cf87-43ae-b6db-43da89ab6888 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:46 user nova-compute[73917]: WARNING nova.compute.manager [req-626f60a5-15f5-4d42-b8f7-35ddf6819704 req-54e3cedf-4c5b-447f-96c1-79da64c3ee6a service nova] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Received unexpected event network-vif-plugged-a8f8f32c-cf87-43ae-b6db-43da89ab6888 for instance with vm_state active and task_state None.
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.compute.manager [req-626f60a5-15f5-4d42-b8f7-35ddf6819704 req-54e3cedf-4c5b-447f-96c1-79da64c3ee6a service nova] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Received event network-vif-plugged-a8f8f32c-cf87-43ae-b6db-43da89ab6888 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-626f60a5-15f5-4d42-b8f7-35ddf6819704 req-54e3cedf-4c5b-447f-96c1-79da64c3ee6a service nova] Acquiring lock "ce383b5a-c726-4d82-b0e3-be6ac6659428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-626f60a5-15f5-4d42-b8f7-35ddf6819704 req-54e3cedf-4c5b-447f-96c1-79da64c3ee6a service nova] Lock "ce383b5a-c726-4d82-b0e3-be6ac6659428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-626f60a5-15f5-4d42-b8f7-35ddf6819704 req-54e3cedf-4c5b-447f-96c1-79da64c3ee6a service nova] Lock "ce383b5a-c726-4d82-b0e3-be6ac6659428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG nova.compute.manager [req-626f60a5-15f5-4d42-b8f7-35ddf6819704 req-54e3cedf-4c5b-447f-96c1-79da64c3ee6a service nova] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] No waiting events found dispatching network-vif-plugged-a8f8f32c-cf87-43ae-b6db-43da89ab6888 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:46 user nova-compute[73917]: WARNING nova.compute.manager [req-626f60a5-15f5-4d42-b8f7-35ddf6819704 req-54e3cedf-4c5b-447f-96c1-79da64c3ee6a service nova] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Received unexpected event network-vif-plugged-a8f8f32c-cf87-43ae-b6db-43da89ab6888 for instance with vm_state active and task_state None.
Aug 26 19:07:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:47 user nova-compute[73917]: DEBUG nova.network.neutron [req-4e88adeb-2e2c-4d14-8583-30f2a2e0b63d req-72d18131-8328-40cb-b60a-1e250da8cc6a service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Updated VIF entry in instance network info cache for port 0fd58968-f9e8-40f0-acff-8efea741379e. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:07:47 user nova-compute[73917]: DEBUG nova.network.neutron [req-4e88adeb-2e2c-4d14-8583-30f2a2e0b63d req-72d18131-8328-40cb-b60a-1e250da8cc6a service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Updating instance_info_cache with network_info: [{"id": "0fd58968-f9e8-40f0-acff-8efea741379e", "address": "fa:16:3e:b3:2d:13", "network": {"id": "02545642-9a23-4d7d-8ff0-231150ea7ced", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2072904890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd58968-f9", "ovs_interfaceid": "0fd58968-f9e8-40f0-acff-8efea741379e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4e88adeb-2e2c-4d14-8583-30f2a2e0b63d req-72d18131-8328-40cb-b60a-1e250da8cc6a service nova] Releasing lock "refresh_cache-86937c34-db86-44a9-8196-3cae0d7ce400" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:47 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:07:47 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:07:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:48 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:07:48 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:07:48 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:07:48 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:07:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:48 user nova-compute[73917]: DEBUG nova.compute.manager [req-3361d851-6850-42ec-9113-fef2c53731bc req-8551525a-f726-4cc6-abaf-81229938f3fb service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received event network-vif-plugged-0fd58968-f9e8-40f0-acff-8efea741379e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3361d851-6850-42ec-9113-fef2c53731bc req-8551525a-f726-4cc6-abaf-81229938f3fb service nova] Acquiring lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3361d851-6850-42ec-9113-fef2c53731bc req-8551525a-f726-4cc6-abaf-81229938f3fb service nova] Lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3361d851-6850-42ec-9113-fef2c53731bc req-8551525a-f726-4cc6-abaf-81229938f3fb service nova] Lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:48 user nova-compute[73917]: DEBUG nova.compute.manager [req-3361d851-6850-42ec-9113-fef2c53731bc req-8551525a-f726-4cc6-abaf-81229938f3fb service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] No waiting events found dispatching network-vif-plugged-0fd58968-f9e8-40f0-acff-8efea741379e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:48 user nova-compute[73917]: WARNING nova.compute.manager [req-3361d851-6850-42ec-9113-fef2c53731bc req-8551525a-f726-4cc6-abaf-81229938f3fb service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received unexpected event network-vif-plugged-0fd58968-f9e8-40f0-acff-8efea741379e for instance with vm_state building and task_state spawning.
Aug 26 19:07:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:07:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:07:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:07:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:49 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076870.4909742, c8f0be92-c7bf-49cd-a4a4-23e625603081 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:07:50 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] VM Resumed (Lifecycle Event)
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:07:50 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Instance spawned successfully.
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:07:50 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Instance spawned successfully.
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:07:50 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076870.4922101, f019c6c6-e76f-4a75-8ba4-8c566d9f5791 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:07:50 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] VM Resumed (Lifecycle Event)
Aug 26 19:07:50 user nova-compute[73917]: INFO nova.compute.manager [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Took 10.69 seconds to spawn the instance on the hypervisor.
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:07:50 user nova-compute[73917]: INFO nova.compute.manager [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Took 11.88 seconds to spawn the instance on the hypervisor.
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:50 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076870.4978652, c8f0be92-c7bf-49cd-a4a4-23e625603081 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:07:50 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] VM Started (Lifecycle Event)
Aug 26 19:07:50 user nova-compute[73917]: INFO nova.compute.manager [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Took 11.98 seconds to build instance.
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c66b5126-db2b-42d1-8dad-a3f44f13aa15 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "c8f0be92-c7bf-49cd-a4a4-23e625603081" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.107s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076870.4995635, f019c6c6-e76f-4a75-8ba4-8c566d9f5791 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:07:50 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] VM Started (Lifecycle Event)
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:07:50 user nova-compute[73917]: INFO nova.compute.manager [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Took 13.06 seconds to build instance.
Aug 26 19:07:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-674d81ed-1dea-489c-9b11-05c5c88933c3 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.176s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.compute.manager [req-b1325c6b-4886-40d4-a446-6a60ebbaf699 req-00534163-0d82-45f8-9c67-c7635a099b63 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received event network-vif-plugged-0fd58968-f9e8-40f0-acff-8efea741379e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b1325c6b-4886-40d4-a446-6a60ebbaf699 req-00534163-0d82-45f8-9c67-c7635a099b63 service nova] Acquiring lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b1325c6b-4886-40d4-a446-6a60ebbaf699 req-00534163-0d82-45f8-9c67-c7635a099b63 service nova] Lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b1325c6b-4886-40d4-a446-6a60ebbaf699 req-00534163-0d82-45f8-9c67-c7635a099b63 service nova] Lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG nova.compute.manager [req-b1325c6b-4886-40d4-a446-6a60ebbaf699 req-00534163-0d82-45f8-9c67-c7635a099b63 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] No waiting events found dispatching network-vif-plugged-0fd58968-f9e8-40f0-acff-8efea741379e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:50 user nova-compute[73917]: WARNING nova.compute.manager [req-b1325c6b-4886-40d4-a446-6a60ebbaf699 req-00534163-0d82-45f8-9c67-c7635a099b63 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received unexpected event network-vif-plugged-0fd58968-f9e8-40f0-acff-8efea741379e for instance with vm_state building and task_state spawning.
Aug 26 19:07:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:51 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076871.015443, 86937c34-db86-44a9-8196-3cae0d7ce400 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:07:51 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] VM Resumed (Lifecycle Event)
Aug 26 19:07:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:07:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:07:51 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Instance spawned successfully.
Aug 26 19:07:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:07:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:07:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:07:51 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:07:51 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076871.0237625, 86937c34-db86-44a9-8196-3cae0d7ce400 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:07:51 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] VM Started (Lifecycle Event)
Aug 26 19:07:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:07:51 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:07:51 user nova-compute[73917]: INFO nova.compute.manager [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Took 7.81 seconds to spawn the instance on the hypervisor.
Aug 26 19:07:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:07:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:51 user nova-compute[73917]: INFO nova.compute.manager [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Took 9.19 seconds to build instance.
Aug 26 19:07:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dff653e0-6573-4bfd-b771-6931aea167c3 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "86937c34-db86-44a9-8196-3cae0d7ce400" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.370s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:52 user nova-compute[73917]: DEBUG nova.compute.manager [req-0b8e9678-3b26-4f8c-9321-a1b3311a04cc req-b4dce5e9-0882-4763-a492-cd6d8fab5f01 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Received event network-vif-plugged-2738a59b-9109-4fef-8868-920d458dfaa1 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0b8e9678-3b26-4f8c-9321-a1b3311a04cc req-b4dce5e9-0882-4763-a492-cd6d8fab5f01 service nova] Acquiring lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0b8e9678-3b26-4f8c-9321-a1b3311a04cc req-b4dce5e9-0882-4763-a492-cd6d8fab5f01 service nova] Lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0b8e9678-3b26-4f8c-9321-a1b3311a04cc req-b4dce5e9-0882-4763-a492-cd6d8fab5f01 service nova] Lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:52 user nova-compute[73917]: DEBUG nova.compute.manager [req-0b8e9678-3b26-4f8c-9321-a1b3311a04cc req-b4dce5e9-0882-4763-a492-cd6d8fab5f01 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] No waiting events found dispatching network-vif-plugged-2738a59b-9109-4fef-8868-920d458dfaa1 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:52 user nova-compute[73917]: WARNING nova.compute.manager [req-0b8e9678-3b26-4f8c-9321-a1b3311a04cc req-b4dce5e9-0882-4763-a492-cd6d8fab5f01 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Received unexpected event network-vif-plugged-2738a59b-9109-4fef-8868-920d458dfaa1 for instance with vm_state active and task_state None.
Aug 26 19:07:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Acquiring lock "c5120da8-5837-420f-b472-572a088a4a27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Lock "c5120da8-5837-420f-b472-572a088a4a27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:07:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:52 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:07:52 user nova-compute[73917]: INFO nova.compute.claims [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Claim successful on node user
Aug 26 19:07:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:53 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:07:53 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:07:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.999s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:53 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:07:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:53 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:07:53 user nova-compute[73917]: DEBUG nova.network.neutron [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:07:53 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG nova.policy [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5de04166b4a4eeaba3916c447a6ee69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65039916cc424226be394dcb7abc714e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:07:54 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Creating image(s)
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Lock "/opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Lock "/opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG nova.compute.manager [req-abc67d27-9820-4e2a-9f25-b1482702f8fc req-37557ae3-17c1-4357-8dbb-0b2c54fd357f service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Received event network-vif-plugged-2738a59b-9109-4fef-8868-920d458dfaa1 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-abc67d27-9820-4e2a-9f25-b1482702f8fc req-37557ae3-17c1-4357-8dbb-0b2c54fd357f service nova] Acquiring lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-abc67d27-9820-4e2a-9f25-b1482702f8fc req-37557ae3-17c1-4357-8dbb-0b2c54fd357f service nova] Lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-abc67d27-9820-4e2a-9f25-b1482702f8fc req-37557ae3-17c1-4357-8dbb-0b2c54fd357f service nova] Lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG nova.compute.manager [req-abc67d27-9820-4e2a-9f25-b1482702f8fc req-37557ae3-17c1-4357-8dbb-0b2c54fd357f service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] No waiting events found dispatching network-vif-plugged-2738a59b-9109-4fef-8868-920d458dfaa1 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:54 user nova-compute[73917]: WARNING nova.compute.manager [req-abc67d27-9820-4e2a-9f25-b1482702f8fc req-37557ae3-17c1-4357-8dbb-0b2c54fd357f service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Received unexpected event network-vif-plugged-2738a59b-9109-4fef-8868-920d458dfaa1 for instance with vm_state active and task_state None.
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.199s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.224s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27/disk 1073741824" returned: 0 in 0.066s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG nova.network.neutron [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Successfully created port: 39a5bed1-340d-44b2-9312-9f797f781447 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:07:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.224s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:55 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:07:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:07:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:55 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Cannot resize image /opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:07:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:07:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Ensure instance console log exists: /opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:07:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.network.neutron [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Successfully updated port: 39a5bed1-340d-44b2-9312-9f797f781447 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.compute.manager [req-89e84eee-27f5-44c0-854d-02bf3d6f5d77 req-d3127b48-5fc6-48c5-8e99-7dcd3b422ddc service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Received event network-vif-plugged-c20cdde4-5ebd-4878-8eb2-4c62493255b9 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-89e84eee-27f5-44c0-854d-02bf3d6f5d77 req-d3127b48-5fc6-48c5-8e99-7dcd3b422ddc service nova] Acquiring lock "c8f0be92-c7bf-49cd-a4a4-23e625603081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-89e84eee-27f5-44c0-854d-02bf3d6f5d77 req-d3127b48-5fc6-48c5-8e99-7dcd3b422ddc service nova] Lock "c8f0be92-c7bf-49cd-a4a4-23e625603081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-89e84eee-27f5-44c0-854d-02bf3d6f5d77 req-d3127b48-5fc6-48c5-8e99-7dcd3b422ddc service nova] Lock "c8f0be92-c7bf-49cd-a4a4-23e625603081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.compute.manager [req-89e84eee-27f5-44c0-854d-02bf3d6f5d77 req-d3127b48-5fc6-48c5-8e99-7dcd3b422ddc service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] No waiting events found dispatching network-vif-plugged-c20cdde4-5ebd-4878-8eb2-4c62493255b9 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:56 user nova-compute[73917]: WARNING nova.compute.manager [req-89e84eee-27f5-44c0-854d-02bf3d6f5d77 req-d3127b48-5fc6-48c5-8e99-7dcd3b422ddc service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Received unexpected event network-vif-plugged-c20cdde4-5ebd-4878-8eb2-4c62493255b9 for instance with vm_state active and task_state None.
Aug 26 19:07:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Acquiring lock "refresh_cache-c5120da8-5837-420f-b472-572a088a4a27" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Acquired lock "refresh_cache-c5120da8-5837-420f-b472-572a088a4a27" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.network.neutron [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:07:56 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:56 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=7331MB free_disk=25.66238021850586GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.compute.manager [req-d1e2a386-004b-4095-ba0b-9c5159babb0b req-d0c63a17-43a0-4d3c-8880-8188ede0b034 service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] Received event network-changed-39a5bed1-340d-44b2-9312-9f797f781447 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.compute.manager [req-d1e2a386-004b-4095-ba0b-9c5159babb0b req-d0c63a17-43a0-4d3c-8880-8188ede0b034 service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] Refreshing instance network info cache due to event network-changed-39a5bed1-340d-44b2-9312-9f797f781447. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d1e2a386-004b-4095-ba0b-9c5159babb0b req-d0c63a17-43a0-4d3c-8880-8188ede0b034 service nova] Acquiring lock "refresh_cache-c5120da8-5837-420f-b472-572a088a4a27" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.network.neutron [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 5dd60c10-f99a-431d-a66f-936a7a7a1c55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance cc0ae046-2a39-4ab6-9327-2d9452c3035d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance ce383b5a-c726-4d82-b0e3-be6ac6659428 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fd801f18-34b6-4682-8d43-edf82bd216c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fdfb377e-119e-41ce-b9e0-6e21053306cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f019c6c6-e76f-4a75-8ba4-8c566d9f5791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c8f0be92-c7bf-49cd-a4a4-23e625603081 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 86937c34-db86-44a9-8196-3cae0d7ce400 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c5120da8-5837-420f-b472-572a088a4a27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing inventories for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating ProviderTree inventory for provider d90ad23a-e063-4f0d-8341-c34e0141d16a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating inventory in ProviderTree for provider d90ad23a-e063-4f0d-8341-c34e0141d16a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing aggregate associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, aggregates: None {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing trait associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.network.neutron [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Updating instance_info_cache with network_info: [{"id": "39a5bed1-340d-44b2-9312-9f797f781447", "address": "fa:16:3e:41:f3:a7", "network": {"id": "5d4fd3f9-2b4a-4416-8eaf-b1ee0a23f8f0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-676704280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65039916cc424226be394dcb7abc714e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a5bed1-34", "ovs_interfaceid": "39a5bed1-340d-44b2-9312-9f797f781447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Releasing lock "refresh_cache-c5120da8-5837-420f-b472-572a088a4a27" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Instance network_info: |[{"id": "39a5bed1-340d-44b2-9312-9f797f781447", "address": "fa:16:3e:41:f3:a7", "network": {"id": "5d4fd3f9-2b4a-4416-8eaf-b1ee0a23f8f0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-676704280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65039916cc424226be394dcb7abc714e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a5bed1-34", "ovs_interfaceid": "39a5bed1-340d-44b2-9312-9f797f781447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d1e2a386-004b-4095-ba0b-9c5159babb0b req-d0c63a17-43a0-4d3c-8880-8188ede0b034 service nova] Acquired lock "refresh_cache-c5120da8-5837-420f-b472-572a088a4a27" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.network.neutron [req-d1e2a386-004b-4095-ba0b-9c5159babb0b req-d0c63a17-43a0-4d3c-8880-8188ede0b034 service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] Refreshing network info cache for port 39a5bed1-340d-44b2-9312-9f797f781447 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Start _get_guest_xml network_info=[{"id": "39a5bed1-340d-44b2-9312-9f797f781447", "address": "fa:16:3e:41:f3:a7", "network": {"id": "5d4fd3f9-2b4a-4416-8eaf-b1ee0a23f8f0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-676704280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65039916cc424226be394dcb7abc714e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a5bed1-34", "ovs_interfaceid": "39a5bed1-340d-44b2-9312-9f797f781447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:07:56 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:56 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-290413173',display_name='tempest-VolumesAssistedSnapshotsTest-server-290413173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-290413173',id=11,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAZ0XuwhMYQD20wwnirKMU1msQN99FkCF2Ymk54ImrGX5Tj4XtXEfzcHHlY4ast1i7aG+nSliKRq5CjBiovV6vEM9hWlRge1oYmDpZKElvXLKITmIJc65WfCbY1WGC7lA==',key_name='tempest-keypair-508155102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65039916cc424226be394dcb7abc714e',ramdisk_id='',reservation_id='r-de4rnykx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1979715060',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1979715060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:07:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5de04166b4a4eeaba3916c447a6ee69',uuid=c5120da8-5837-420f-b472-572a088a4a27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39a5bed1-340d-44b2-9312-9f797f781447", "address": "fa:16:3e:41:f3:a7", "network": {"id": "5d4fd3f9-2b4a-4416-8eaf-b1ee0a23f8f0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-676704280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65039916cc424226be394dcb7abc714e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a5bed1-34", "ovs_interfaceid": "39a5bed1-340d-44b2-9312-9f797f781447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Converting VIF {"id": "39a5bed1-340d-44b2-9312-9f797f781447", "address": "fa:16:3e:41:f3:a7", "network": {"id": "5d4fd3f9-2b4a-4416-8eaf-b1ee0a23f8f0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-676704280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65039916cc424226be394dcb7abc714e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a5bed1-34", "ovs_interfaceid": "39a5bed1-340d-44b2-9312-9f797f781447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:f3:a7,bridge_name='br-int',has_traffic_filtering=True,id=39a5bed1-340d-44b2-9312-9f797f781447,network=Network(5d4fd3f9-2b4a-4416-8eaf-b1ee0a23f8f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a5bed1-34') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.objects.instance [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Lazy-loading 'pci_devices' on Instance uuid c5120da8-5837-420f-b472-572a088a4a27 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:07:56 user nova-compute[73917]:   <uuid>c5120da8-5837-420f-b472-572a088a4a27</uuid>
Aug 26 19:07:56 user nova-compute[73917]:   <name>instance-0000000b</name>
Aug 26 19:07:56 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:07:56 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:07:56 user nova-compute[73917]:   <metadata>
Aug 26 19:07:56 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:07:56 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:07:56 user nova-compute[73917]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-290413173</nova:name>
Aug 26 19:07:56 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:07:56</nova:creationTime>
Aug 26 19:07:56 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:07:56 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:07:56 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:07:56 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:07:56 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:07:56 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:07:56 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:07:56 user nova-compute[73917]:       <nova:owner>
Aug 26 19:07:56 user nova-compute[73917]:         <nova:user uuid="b5de04166b4a4eeaba3916c447a6ee69">tempest-VolumesAssistedSnapshotsTest-1979715060-project-member</nova:user>
Aug 26 19:07:56 user nova-compute[73917]:         <nova:project uuid="65039916cc424226be394dcb7abc714e">tempest-VolumesAssistedSnapshotsTest-1979715060</nova:project>
Aug 26 19:07:56 user nova-compute[73917]:       </nova:owner>
Aug 26 19:07:56 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:07:56 user nova-compute[73917]:       <nova:ports>
Aug 26 19:07:56 user nova-compute[73917]:         <nova:port uuid="39a5bed1-340d-44b2-9312-9f797f781447">
Aug 26 19:07:56 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 19:07:56 user nova-compute[73917]:         </nova:port>
Aug 26 19:07:56 user nova-compute[73917]:       </nova:ports>
Aug 26 19:07:56 user nova-compute[73917]:     </nova:instance>
Aug 26 19:07:56 user nova-compute[73917]:   </metadata>
Aug 26 19:07:56 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:07:56 user nova-compute[73917]:     <system>
Aug 26 19:07:56 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:07:56 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:07:56 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:07:56 user nova-compute[73917]:       <entry name="serial">c5120da8-5837-420f-b472-572a088a4a27</entry>
Aug 26 19:07:56 user nova-compute[73917]:       <entry name="uuid">c5120da8-5837-420f-b472-572a088a4a27</entry>
Aug 26 19:07:56 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:07:56 user nova-compute[73917]:     </system>
Aug 26 19:07:56 user nova-compute[73917]:   </sysinfo>
Aug 26 19:07:56 user nova-compute[73917]:   <os>
Aug 26 19:07:56 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:07:56 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:07:56 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:07:56 user nova-compute[73917]:   </os>
Aug 26 19:07:56 user nova-compute[73917]:   <features>
Aug 26 19:07:56 user nova-compute[73917]:     <acpi/>
Aug 26 19:07:56 user nova-compute[73917]:     <apic/>
Aug 26 19:07:56 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:07:56 user nova-compute[73917]:   </features>
Aug 26 19:07:56 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:07:56 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:07:56 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:07:56 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:07:56 user nova-compute[73917]:   </clock>
Aug 26 19:07:56 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:07:56 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:07:56 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:07:56 user nova-compute[73917]:   </cpu>
Aug 26 19:07:56 user nova-compute[73917]:   <devices>
Aug 26 19:07:56 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:07:56 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:07:56 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27/disk"/>
Aug 26 19:07:56 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:07:56 user nova-compute[73917]:     </disk>
Aug 26 19:07:56 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:07:56 user nova-compute[73917]:       <mac address="fa:16:3e:41:f3:a7"/>
Aug 26 19:07:56 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:56 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:07:56 user nova-compute[73917]:       <target dev="tap39a5bed1-34"/>
Aug 26 19:07:56 user nova-compute[73917]:     </interface>
Aug 26 19:07:56 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:07:56 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27/console.log" append="off"/>
Aug 26 19:07:56 user nova-compute[73917]:     </serial>
Aug 26 19:07:56 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:07:56 user nova-compute[73917]:     <video>
Aug 26 19:07:56 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:07:56 user nova-compute[73917]:     </video>
Aug 26 19:07:56 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:07:56 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:07:56 user nova-compute[73917]:     </rng>
Aug 26 19:07:56 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:07:56 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:07:56 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:07:56 user nova-compute[73917]:     </memballoon>
Aug 26 19:07:56 user nova-compute[73917]:   </devices>
Aug 26 19:07:56 user nova-compute[73917]: </domain>
Aug 26 19:07:56 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-290413173',display_name='tempest-VolumesAssistedSnapshotsTest-server-290413173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-290413173',id=11,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAZ0XuwhMYQD20wwnirKMU1msQN99FkCF2Ymk54ImrGX5Tj4XtXEfzcHHlY4ast1i7aG+nSliKRq5CjBiovV6vEM9hWlRge1oYmDpZKElvXLKITmIJc65WfCbY1WGC7lA==',key_name='tempest-keypair-508155102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65039916cc424226be394dcb7abc714e',ramdisk_id='',reservation_id='r-de4rnykx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1979715060',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1979715060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:07:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5de04166b4a4eeaba3916c447a6ee69',uuid=c5120da8-5837-420f-b472-572a088a4a27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39a5bed1-340d-44b2-9312-9f797f781447", "address": "fa:16:3e:41:f3:a7", "network": {"id": "5d4fd3f9-2b4a-4416-8eaf-b1ee0a23f8f0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-676704280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65039916cc424226be394dcb7abc714e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a5bed1-34", "ovs_interfaceid": "39a5bed1-340d-44b2-9312-9f797f781447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Converting VIF {"id": "39a5bed1-340d-44b2-9312-9f797f781447", "address": "fa:16:3e:41:f3:a7", "network": {"id": "5d4fd3f9-2b4a-4416-8eaf-b1ee0a23f8f0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-676704280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65039916cc424226be394dcb7abc714e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a5bed1-34", "ovs_interfaceid": "39a5bed1-340d-44b2-9312-9f797f781447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:f3:a7,bridge_name='br-int',has_traffic_filtering=True,id=39a5bed1-340d-44b2-9312-9f797f781447,network=Network(5d4fd3f9-2b4a-4416-8eaf-b1ee0a23f8f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a5bed1-34') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG os_vif [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f3:a7,bridge_name='br-int',has_traffic_filtering=True,id=39a5bed1-340d-44b2-9312-9f797f781447,network=Network(5d4fd3f9-2b4a-4416-8eaf-b1ee0a23f8f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a5bed1-34') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39a5bed1-34, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap39a5bed1-34, col_values=(('external_ids', {'iface-id': '39a5bed1-340d-44b2-9312-9f797f781447', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:f3:a7', 'vm-uuid': 'c5120da8-5837-420f-b472-572a088a4a27'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:56 user nova-compute[73917]: INFO os_vif [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f3:a7,bridge_name='br-int',has_traffic_filtering=True,id=39a5bed1-340d-44b2-9312-9f797f781447,network=Network(5d4fd3f9-2b4a-4416-8eaf-b1ee0a23f8f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a5bed1-34')
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:07:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] No VIF found with MAC fa:16:3e:41:f3:a7, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG nova.network.neutron [req-d1e2a386-004b-4095-ba0b-9c5159babb0b req-d0c63a17-43a0-4d3c-8880-8188ede0b034 service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] Updated VIF entry in instance network info cache for port 39a5bed1-340d-44b2-9312-9f797f781447. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG nova.network.neutron [req-d1e2a386-004b-4095-ba0b-9c5159babb0b req-d0c63a17-43a0-4d3c-8880-8188ede0b034 service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] Updating instance_info_cache with network_info: [{"id": "39a5bed1-340d-44b2-9312-9f797f781447", "address": "fa:16:3e:41:f3:a7", "network": {"id": "5d4fd3f9-2b4a-4416-8eaf-b1ee0a23f8f0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-676704280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65039916cc424226be394dcb7abc714e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a5bed1-34", "ovs_interfaceid": "39a5bed1-340d-44b2-9312-9f797f781447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d1e2a386-004b-4095-ba0b-9c5159babb0b req-d0c63a17-43a0-4d3c-8880-8188ede0b034 service nova] Releasing lock "refresh_cache-c5120da8-5837-420f-b472-572a088a4a27" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG nova.compute.manager [req-881d3780-5c80-40fd-8b93-3ed765a682de req-567963a0-820b-4bd6-a8db-0c901ec3fa96 service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Received event network-vif-plugged-c20cdde4-5ebd-4878-8eb2-4c62493255b9 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-881d3780-5c80-40fd-8b93-3ed765a682de req-567963a0-820b-4bd6-a8db-0c901ec3fa96 service nova] Acquiring lock "c8f0be92-c7bf-49cd-a4a4-23e625603081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-881d3780-5c80-40fd-8b93-3ed765a682de req-567963a0-820b-4bd6-a8db-0c901ec3fa96 service nova] Lock "c8f0be92-c7bf-49cd-a4a4-23e625603081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-881d3780-5c80-40fd-8b93-3ed765a682de req-567963a0-820b-4bd6-a8db-0c901ec3fa96 service nova] Lock "c8f0be92-c7bf-49cd-a4a4-23e625603081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG nova.compute.manager [req-881d3780-5c80-40fd-8b93-3ed765a682de req-567963a0-820b-4bd6-a8db-0c901ec3fa96 service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] No waiting events found dispatching network-vif-plugged-c20cdde4-5ebd-4878-8eb2-4c62493255b9 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:57 user nova-compute[73917]: WARNING nova.compute.manager [req-881d3780-5c80-40fd-8b93-3ed765a682de req-567963a0-820b-4bd6-a8db-0c901ec3fa96 service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Received unexpected event network-vif-plugged-c20cdde4-5ebd-4878-8eb2-4c62493255b9 for instance with vm_state active and task_state None.
Aug 26 19:07:57 user nova-compute[73917]: DEBUG nova.compute.manager [req-881d3780-5c80-40fd-8b93-3ed765a682de req-567963a0-820b-4bd6-a8db-0c901ec3fa96 service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Received event network-vif-plugged-2ad6ccc6-cb71-4105-88e4-cb48743f26ad {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-881d3780-5c80-40fd-8b93-3ed765a682de req-567963a0-820b-4bd6-a8db-0c901ec3fa96 service nova] Acquiring lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-881d3780-5c80-40fd-8b93-3ed765a682de req-567963a0-820b-4bd6-a8db-0c901ec3fa96 service nova] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-881d3780-5c80-40fd-8b93-3ed765a682de req-567963a0-820b-4bd6-a8db-0c901ec3fa96 service nova] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG nova.compute.manager [req-881d3780-5c80-40fd-8b93-3ed765a682de req-567963a0-820b-4bd6-a8db-0c901ec3fa96 service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] No waiting events found dispatching network-vif-plugged-2ad6ccc6-cb71-4105-88e4-cb48743f26ad {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:57 user nova-compute[73917]: WARNING nova.compute.manager [req-881d3780-5c80-40fd-8b93-3ed765a682de req-567963a0-820b-4bd6-a8db-0c901ec3fa96 service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Received unexpected event network-vif-plugged-2ad6ccc6-cb71-4105-88e4-cb48743f26ad for instance with vm_state active and task_state None.
Aug 26 19:07:57 user nova-compute[73917]: DEBUG nova.compute.manager [req-881d3780-5c80-40fd-8b93-3ed765a682de req-567963a0-820b-4bd6-a8db-0c901ec3fa96 service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Received event network-vif-plugged-2ad6ccc6-cb71-4105-88e4-cb48743f26ad {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-881d3780-5c80-40fd-8b93-3ed765a682de req-567963a0-820b-4bd6-a8db-0c901ec3fa96 service nova] Acquiring lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-881d3780-5c80-40fd-8b93-3ed765a682de req-567963a0-820b-4bd6-a8db-0c901ec3fa96 service nova] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-881d3780-5c80-40fd-8b93-3ed765a682de req-567963a0-820b-4bd6-a8db-0c901ec3fa96 service nova] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:57 user nova-compute[73917]: DEBUG nova.compute.manager [req-881d3780-5c80-40fd-8b93-3ed765a682de req-567963a0-820b-4bd6-a8db-0c901ec3fa96 service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] No waiting events found dispatching network-vif-plugged-2ad6ccc6-cb71-4105-88e4-cb48743f26ad {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:57 user nova-compute[73917]: WARNING nova.compute.manager [req-881d3780-5c80-40fd-8b93-3ed765a682de req-567963a0-820b-4bd6-a8db-0c901ec3fa96 service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Received unexpected event network-vif-plugged-2ad6ccc6-cb71-4105-88e4-cb48743f26ad for instance with vm_state active and task_state None.
Aug 26 19:07:58 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:07:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:07:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:07:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: c5120da8-5837-420f-b472-572a088a4a27] Skipping network cache update for instance because it is Building. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 19:07:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-5dd60c10-f99a-431d-a66f-936a7a7a1c55" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:07:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-5dd60c10-f99a-431d-a66f-936a7a7a1c55" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:07:58 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:07:58 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid 5dd60c10-f99a-431d-a66f-936a7a7a1c55 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:07:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:58 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Updating instance_info_cache with network_info: [{"id": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "address": "fa:16:3e:5a:c1:dd", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70707344-84", "ovs_interfaceid": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:07:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-5dd60c10-f99a-431d-a66f-936a7a7a1c55" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:07:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:07:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:07:59 user nova-compute[73917]: DEBUG nova.compute.manager [req-ef05b8fa-c4cf-4784-8213-b622ccfa4e77 req-7ce0fcd1-39ab-4a25-ad6d-ecd08f5ab3a4 service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] Received event network-vif-plugged-39a5bed1-340d-44b2-9312-9f797f781447 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ef05b8fa-c4cf-4784-8213-b622ccfa4e77 req-7ce0fcd1-39ab-4a25-ad6d-ecd08f5ab3a4 service nova] Acquiring lock "c5120da8-5837-420f-b472-572a088a4a27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ef05b8fa-c4cf-4784-8213-b622ccfa4e77 req-7ce0fcd1-39ab-4a25-ad6d-ecd08f5ab3a4 service nova] Lock "c5120da8-5837-420f-b472-572a088a4a27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ef05b8fa-c4cf-4784-8213-b622ccfa4e77 req-7ce0fcd1-39ab-4a25-ad6d-ecd08f5ab3a4 service nova] Lock "c5120da8-5837-420f-b472-572a088a4a27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:59 user nova-compute[73917]: DEBUG nova.compute.manager [req-ef05b8fa-c4cf-4784-8213-b622ccfa4e77 req-7ce0fcd1-39ab-4a25-ad6d-ecd08f5ab3a4 service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] No waiting events found dispatching network-vif-plugged-39a5bed1-340d-44b2-9312-9f797f781447 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:59 user nova-compute[73917]: WARNING nova.compute.manager [req-ef05b8fa-c4cf-4784-8213-b622ccfa4e77 req-7ce0fcd1-39ab-4a25-ad6d-ecd08f5ab3a4 service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] Received unexpected event network-vif-plugged-39a5bed1-340d-44b2-9312-9f797f781447 for instance with vm_state building and task_state spawning.
Aug 26 19:07:59 user nova-compute[73917]: DEBUG nova.compute.manager [req-ef05b8fa-c4cf-4784-8213-b622ccfa4e77 req-7ce0fcd1-39ab-4a25-ad6d-ecd08f5ab3a4 service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] Received event network-vif-plugged-39a5bed1-340d-44b2-9312-9f797f781447 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:07:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ef05b8fa-c4cf-4784-8213-b622ccfa4e77 req-7ce0fcd1-39ab-4a25-ad6d-ecd08f5ab3a4 service nova] Acquiring lock "c5120da8-5837-420f-b472-572a088a4a27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:07:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ef05b8fa-c4cf-4784-8213-b622ccfa4e77 req-7ce0fcd1-39ab-4a25-ad6d-ecd08f5ab3a4 service nova] Lock "c5120da8-5837-420f-b472-572a088a4a27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:07:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ef05b8fa-c4cf-4784-8213-b622ccfa4e77 req-7ce0fcd1-39ab-4a25-ad6d-ecd08f5ab3a4 service nova] Lock "c5120da8-5837-420f-b472-572a088a4a27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:07:59 user nova-compute[73917]: DEBUG nova.compute.manager [req-ef05b8fa-c4cf-4784-8213-b622ccfa4e77 req-7ce0fcd1-39ab-4a25-ad6d-ecd08f5ab3a4 service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] No waiting events found dispatching network-vif-plugged-39a5bed1-340d-44b2-9312-9f797f781447 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:07:59 user nova-compute[73917]: WARNING nova.compute.manager [req-ef05b8fa-c4cf-4784-8213-b622ccfa4e77 req-7ce0fcd1-39ab-4a25-ad6d-ecd08f5ab3a4 service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] Received unexpected event network-vif-plugged-39a5bed1-340d-44b2-9312-9f797f781447 for instance with vm_state building and task_state spawning.
Aug 26 19:08:00 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:08:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:08:00 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076880.8113177, c5120da8-5837-420f-b472-572a088a4a27 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:08:00 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c5120da8-5837-420f-b472-572a088a4a27] VM Resumed (Lifecycle Event)
Aug 26 19:08:00 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: c5120da8-5837-420f-b472-572a088a4a27] Instance spawned successfully.
Aug 26 19:08:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:08:00 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c5120da8-5837-420f-b472-572a088a4a27] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:08:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:08:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:08:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:08:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:08:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:08:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:08:00 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c5120da8-5837-420f-b472-572a088a4a27] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:08:00 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c5120da8-5837-420f-b472-572a088a4a27] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:08:00 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076880.8114183, c5120da8-5837-420f-b472-572a088a4a27 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:08:00 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c5120da8-5837-420f-b472-572a088a4a27] VM Started (Lifecycle Event)
Aug 26 19:08:00 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c5120da8-5837-420f-b472-572a088a4a27] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:08:00 user nova-compute[73917]: INFO nova.compute.manager [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Took 6.58 seconds to spawn the instance on the hypervisor.
Aug 26 19:08:00 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:08:00 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c5120da8-5837-420f-b472-572a088a4a27] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:08:00 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c5120da8-5837-420f-b472-572a088a4a27] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:08:01 user nova-compute[73917]: INFO nova.compute.manager [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Took 8.26 seconds to build instance.
Aug 26 19:08:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9e403aa2-ffb3-4a3e-a1f3-56dd26748321 tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Lock "c5120da8-5837-420f-b472-572a088a4a27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.413s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:08:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:08:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "54fd570d-421c-4a39-b4ae-772500b24cec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:08:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:08:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:08:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:08:27 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:08:27 user nova-compute[73917]: INFO nova.compute.claims [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Claim successful on node user
Aug 26 19:08:28 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:08:28 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:08:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:08:28 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:08:28 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:08:28 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:08:28 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:08:28 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:08:28 user nova-compute[73917]: INFO nova.virt.block_device [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Booting with volume 6f794151-249c-4191-990d-cee0e30d3a5a at /dev/vda
Aug 26 19:08:28 user nova-compute[73917]: DEBUG os_brick.utils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:08:28 user nova-compute[73917]: INFO oslo.privsep.daemon [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp0hbve1u0/privsep.sock']
Aug 26 19:08:28 user sudo[85464]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp0hbve1u0/privsep.sock
Aug 26 19:08:28 user sudo[85464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 19:08:28 user nova-compute[73917]: DEBUG nova.policy [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ff0ceab2aad4ddcbc5f76ee6a0858bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01f4bc78d87474a8a3027d928dc77e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:08:29 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Successfully created port: 9268e463-2367-4d84-be0e-f432a917b945 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:08:29 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Successfully created port: eec1aa81-34b7-44ea-aa98-57b54a967dcc {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Successfully created port: 2d4bbc97-cf69-4155-8f62-0de77084cbdd {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:08:30 user sudo[85464]: pam_unix(sudo:session): session closed for user root
Aug 26 19:08:30 user nova-compute[73917]: INFO oslo.privsep.daemon [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Spawned new privsep daemon via rootwrap
Aug 26 19:08:30 user nova-compute[73917]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 19:08:30 user nova-compute[73917]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 19:08:30 user nova-compute[73917]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 26 19:08:30 user nova-compute[73917]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85467
Aug 26 19:08:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdfa897-519b-4990-a3c0-cc3b6aca3b77]: (2,) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1ebb85-eeb1-4f27-9edd-54832d531f9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:30 user nova-compute[73917]: WARNING os_brick.initiator.connectors.nvmeof [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 26 19:08:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b3d832-306a-4b17-8d4a-2f35c14fa2d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8825ea31-eb6b-432d-9c5a-f8cfbd1c36f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[488a31fb-f703-4134-acbe-c15a69d4adae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:08:30 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:08:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee59150-be05-44df-948d-01afde9c3963]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG os_brick.utils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] <== get_connector_properties: return (2165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Updating existing volume attachment record: a3a8ea39-07e9-45e0-8986-a46c1feebed1 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:08:30 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Successfully created port: 19a44d0d-f673-49e9-8c62-014aff19769c {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:08:31 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Successfully created port: 472badf6-8de1-4c67-8bfa-7105f672eff0 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:08:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:32 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Successfully updated port: 9268e463-2367-4d84-be0e-f432a917b945 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:08:32 user nova-compute[73917]: DEBUG nova.compute.manager [req-7eb14f2c-e1ce-462e-b67b-2ff61f295dee req-2026ce44-0e8c-4167-97ce-22b6a83a5afe service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-changed-9268e463-2367-4d84-be0e-f432a917b945 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:32 user nova-compute[73917]: DEBUG nova.compute.manager [req-7eb14f2c-e1ce-462e-b67b-2ff61f295dee req-2026ce44-0e8c-4167-97ce-22b6a83a5afe service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Refreshing instance network info cache due to event network-changed-9268e463-2367-4d84-be0e-f432a917b945. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:08:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-7eb14f2c-e1ce-462e-b67b-2ff61f295dee req-2026ce44-0e8c-4167-97ce-22b6a83a5afe service nova] Acquiring lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-7eb14f2c-e1ce-462e-b67b-2ff61f295dee req-2026ce44-0e8c-4167-97ce-22b6a83a5afe service nova] Acquired lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:32 user nova-compute[73917]: DEBUG nova.network.neutron [req-7eb14f2c-e1ce-462e-b67b-2ff61f295dee req-2026ce44-0e8c-4167-97ce-22b6a83a5afe service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Refreshing network info cache for port 9268e463-2367-4d84-be0e-f432a917b945 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:08:32 user nova-compute[73917]: DEBUG nova.network.neutron [req-7eb14f2c-e1ce-462e-b67b-2ff61f295dee req-2026ce44-0e8c-4167-97ce-22b6a83a5afe service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:08:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:32 user nova-compute[73917]: DEBUG nova.network.neutron [req-7eb14f2c-e1ce-462e-b67b-2ff61f295dee req-2026ce44-0e8c-4167-97ce-22b6a83a5afe service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-7eb14f2c-e1ce-462e-b67b-2ff61f295dee req-2026ce44-0e8c-4167-97ce-22b6a83a5afe service nova] Releasing lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:33 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Successfully updated port: dfc09729-80ce-463f-8ad4-4f16f8b304f2 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:08:33 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Successfully updated port: 22c864bd-81de-436b-9745-de2cf3cfffd5 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:08:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:34 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Successfully updated port: eec1aa81-34b7-44ea-aa98-57b54a967dcc {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:08:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-9184bb9e-1517-434a-9abd-85a0381704b1 req-02d22dd8-3ab2-4dad-ab34-96377aac3381 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-changed-dfc09729-80ce-463f-8ad4-4f16f8b304f2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-9184bb9e-1517-434a-9abd-85a0381704b1 req-02d22dd8-3ab2-4dad-ab34-96377aac3381 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Refreshing instance network info cache due to event network-changed-dfc09729-80ce-463f-8ad4-4f16f8b304f2. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:08:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9184bb9e-1517-434a-9abd-85a0381704b1 req-02d22dd8-3ab2-4dad-ab34-96377aac3381 service nova] Acquiring lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9184bb9e-1517-434a-9abd-85a0381704b1 req-02d22dd8-3ab2-4dad-ab34-96377aac3381 service nova] Acquired lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:34 user nova-compute[73917]: DEBUG nova.network.neutron [req-9184bb9e-1517-434a-9abd-85a0381704b1 req-02d22dd8-3ab2-4dad-ab34-96377aac3381 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Refreshing network info cache for port dfc09729-80ce-463f-8ad4-4f16f8b304f2 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:08:34 user nova-compute[73917]: DEBUG nova.network.neutron [req-9184bb9e-1517-434a-9abd-85a0381704b1 req-02d22dd8-3ab2-4dad-ab34-96377aac3381 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:08:34 user nova-compute[73917]: DEBUG nova.network.neutron [req-9184bb9e-1517-434a-9abd-85a0381704b1 req-02d22dd8-3ab2-4dad-ab34-96377aac3381 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9184bb9e-1517-434a-9abd-85a0381704b1 req-02d22dd8-3ab2-4dad-ab34-96377aac3381 service nova] Releasing lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-9184bb9e-1517-434a-9abd-85a0381704b1 req-02d22dd8-3ab2-4dad-ab34-96377aac3381 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-changed-22c864bd-81de-436b-9745-de2cf3cfffd5 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-9184bb9e-1517-434a-9abd-85a0381704b1 req-02d22dd8-3ab2-4dad-ab34-96377aac3381 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Refreshing instance network info cache due to event network-changed-22c864bd-81de-436b-9745-de2cf3cfffd5. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:08:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9184bb9e-1517-434a-9abd-85a0381704b1 req-02d22dd8-3ab2-4dad-ab34-96377aac3381 service nova] Acquiring lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9184bb9e-1517-434a-9abd-85a0381704b1 req-02d22dd8-3ab2-4dad-ab34-96377aac3381 service nova] Acquired lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:34 user nova-compute[73917]: DEBUG nova.network.neutron [req-9184bb9e-1517-434a-9abd-85a0381704b1 req-02d22dd8-3ab2-4dad-ab34-96377aac3381 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Refreshing network info cache for port 22c864bd-81de-436b-9745-de2cf3cfffd5 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:08:34 user nova-compute[73917]: DEBUG nova.network.neutron [req-9184bb9e-1517-434a-9abd-85a0381704b1 req-02d22dd8-3ab2-4dad-ab34-96377aac3381 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:08:35 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Successfully updated port: 2d4bbc97-cf69-4155-8f62-0de77084cbdd {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:08:35 user nova-compute[73917]: DEBUG nova.network.neutron [req-9184bb9e-1517-434a-9abd-85a0381704b1 req-02d22dd8-3ab2-4dad-ab34-96377aac3381 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9184bb9e-1517-434a-9abd-85a0381704b1 req-02d22dd8-3ab2-4dad-ab34-96377aac3381 service nova] Releasing lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:35 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Successfully updated port: 19a44d0d-f673-49e9-8c62-014aff19769c {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:08:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-changed-eec1aa81-34b7-44ea-aa98-57b54a967dcc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Refreshing instance network info cache due to event network-changed-eec1aa81-34b7-44ea-aa98-57b54a967dcc. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:08:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] Acquiring lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] Acquired lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:36 user nova-compute[73917]: DEBUG nova.network.neutron [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Refreshing network info cache for port eec1aa81-34b7-44ea-aa98-57b54a967dcc {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:08:36 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Successfully updated port: 472badf6-8de1-4c67-8bfa-7105f672eff0 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:08:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Acquiring lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:36 user nova-compute[73917]: DEBUG nova.network.neutron [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:08:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:36 user nova-compute[73917]: DEBUG nova.network.neutron [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] Releasing lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-changed-2d4bbc97-cf69-4155-8f62-0de77084cbdd {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Refreshing instance network info cache due to event network-changed-2d4bbc97-cf69-4155-8f62-0de77084cbdd. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:08:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] Acquiring lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] Acquired lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:36 user nova-compute[73917]: DEBUG nova.network.neutron [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Refreshing network info cache for port 2d4bbc97-cf69-4155-8f62-0de77084cbdd {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:08:36 user nova-compute[73917]: DEBUG nova.network.neutron [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:08:37 user nova-compute[73917]: DEBUG nova.network.neutron [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] Releasing lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:37 user nova-compute[73917]: DEBUG nova.compute.manager [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-changed-19a44d0d-f673-49e9-8c62-014aff19769c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:37 user nova-compute[73917]: DEBUG nova.compute.manager [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Refreshing instance network info cache due to event network-changed-19a44d0d-f673-49e9-8c62-014aff19769c. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:08:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] Acquiring lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] Acquired lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:37 user nova-compute[73917]: DEBUG nova.network.neutron [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Refreshing network info cache for port 19a44d0d-f673-49e9-8c62-014aff19769c {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:08:37 user nova-compute[73917]: DEBUG nova.network.neutron [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:08:37 user nova-compute[73917]: DEBUG nova.network.neutron [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d393fc1-9567-4b15-9c19-0b578552c629 req-e597dbbe-2a96-489d-b59a-b123c4464812 service nova] Releasing lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Acquired lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:37 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:08:37 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:08:38 user nova-compute[73917]: INFO nova.compute.claims [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Claim successful on node user
Aug 26 19:08:38 user nova-compute[73917]: DEBUG nova.compute.manager [req-35d0438b-cb25-4d58-aa1c-86386b7cf757 req-3ccf8e21-7146-4b21-804a-13ecab959b5d service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-changed-472badf6-8de1-4c67-8bfa-7105f672eff0 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG nova.compute.manager [req-35d0438b-cb25-4d58-aa1c-86386b7cf757 req-3ccf8e21-7146-4b21-804a-13ecab959b5d service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Refreshing instance network info cache due to event network-changed-472badf6-8de1-4c67-8bfa-7105f672eff0. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-35d0438b-cb25-4d58-aa1c-86386b7cf757 req-3ccf8e21-7146-4b21-804a-13ecab959b5d service nova] Acquiring lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:08:38 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:08:38 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:08:38 user nova-compute[73917]: INFO nova.virt.block_device [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Booting with volume e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 at /dev/vda
Aug 26 19:08:38 user nova-compute[73917]: DEBUG os_brick.utils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG nova.policy [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '342283890ee8406f980c8637d7ce3cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c12b2a813a419ea0705659b402aff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[066650cb-4621-429b-a776-33a43dc55572]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a555167a-d17f-47c8-a15e-01af67309c07]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[68552115-1751-4a51-b41d-f79c79686523]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba82007-81cf-4d69-9be0-a853058e0178]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:08:39 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:08:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b520fa0-6165-4d3f-9aac-3c2ef629b108]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG os_brick.utils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Updating existing volume attachment record: b055b2ec-3926-407d-b049-ddd0c1205c52 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Updating instance_info_cache with network_info: [{"id": "9268e463-2367-4d84-be0e-f432a917b945", "address": "fa:16:3e:3c:5e:e6", "network": {"id": "b5165b66-cdc8-4b7f-ab73-feae1a655345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716155983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9268e463-23", "ovs_interfaceid": "9268e463-2367-4d84-be0e-f432a917b945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "address": "fa:16:3e:d7:d4:c6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc09729-80", "ovs_interfaceid": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22c864bd-81de-436b-9745-de2cf3cfffd5", "address": "fa:16:3e:2b:23:f6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c864bd-81", "ovs_interfaceid": "22c864bd-81de-436b-9745-de2cf3cfffd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "address": "fa:16:3e:ea:a2:cb", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1aa81-34", "ovs_interfaceid": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "address": "fa:16:3e:f6:f5:7c", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4bbc97-cf", "ovs_interfaceid": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19a44d0d-f673-49e9-8c62-014aff19769c", "address": "fa:16:3e:08:64:60", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a44d0d-f6", "ovs_interfaceid": "19a44d0d-f673-49e9-8c62-014aff19769c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "472badf6-8de1-4c67-8bfa-7105f672eff0", "address": "fa:16:3e:c9:52:16", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472badf6-8d", "ovs_interfaceid": "472badf6-8de1-4c67-8bfa-7105f672eff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Releasing lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Instance network_info: |[{"id": "9268e463-2367-4d84-be0e-f432a917b945", "address": "fa:16:3e:3c:5e:e6", "network": {"id": "b5165b66-cdc8-4b7f-ab73-feae1a655345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716155983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9268e463-23", "ovs_interfaceid": "9268e463-2367-4d84-be0e-f432a917b945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "address": "fa:16:3e:d7:d4:c6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc09729-80", "ovs_interfaceid": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22c864bd-81de-436b-9745-de2cf3cfffd5", "address": "fa:16:3e:2b:23:f6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c864bd-81", "ovs_interfaceid": "22c864bd-81de-436b-9745-de2cf3cfffd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "address": "fa:16:3e:ea:a2:cb", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1aa81-34", "ovs_interfaceid": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "address": "fa:16:3e:f6:f5:7c", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4bbc97-cf", "ovs_interfaceid": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19a44d0d-f673-49e9-8c62-014aff19769c", "address": "fa:16:3e:08:64:60", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a44d0d-f6", "ovs_interfaceid": "19a44d0d-f673-49e9-8c62-014aff19769c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "472badf6-8de1-4c67-8bfa-7105f672eff0", "address": "fa:16:3e:c9:52:16", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472badf6-8d", "ovs_interfaceid": "472badf6-8de1-4c67-8bfa-7105f672eff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-35d0438b-cb25-4d58-aa1c-86386b7cf757 req-3ccf8e21-7146-4b21-804a-13ecab959b5d service nova] Acquired lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG nova.network.neutron [req-35d0438b-cb25-4d58-aa1c-86386b7cf757 req-3ccf8e21-7146-4b21-804a-13ecab959b5d service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Refreshing network info cache for port 472badf6-8de1-4c67-8bfa-7105f672eff0 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Successfully created port: 41ff38f9-7c92-4705-acd5-26e82e7d472d {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG nova.network.neutron [req-35d0438b-cb25-4d58-aa1c-86386b7cf757 req-3ccf8e21-7146-4b21-804a-13ecab959b5d service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Updated VIF entry in instance network info cache for port 472badf6-8de1-4c67-8bfa-7105f672eff0. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG nova.network.neutron [req-35d0438b-cb25-4d58-aa1c-86386b7cf757 req-3ccf8e21-7146-4b21-804a-13ecab959b5d service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Updating instance_info_cache with network_info: [{"id": "9268e463-2367-4d84-be0e-f432a917b945", "address": "fa:16:3e:3c:5e:e6", "network": {"id": "b5165b66-cdc8-4b7f-ab73-feae1a655345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716155983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9268e463-23", "ovs_interfaceid": "9268e463-2367-4d84-be0e-f432a917b945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "address": "fa:16:3e:d7:d4:c6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc09729-80", "ovs_interfaceid": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22c864bd-81de-436b-9745-de2cf3cfffd5", "address": "fa:16:3e:2b:23:f6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c864bd-81", "ovs_interfaceid": "22c864bd-81de-436b-9745-de2cf3cfffd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "address": "fa:16:3e:ea:a2:cb", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1aa81-34", "ovs_interfaceid": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "address": "fa:16:3e:f6:f5:7c", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4bbc97-cf", "ovs_interfaceid": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19a44d0d-f673-49e9-8c62-014aff19769c", "address": "fa:16:3e:08:64:60", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a44d0d-f6", "ovs_interfaceid": "19a44d0d-f673-49e9-8c62-014aff19769c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "472badf6-8de1-4c67-8bfa-7105f672eff0", "address": "fa:16:3e:c9:52:16", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472badf6-8d", "ovs_interfaceid": "472badf6-8de1-4c67-8bfa-7105f672eff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-35d0438b-cb25-4d58-aa1c-86386b7cf757 req-3ccf8e21-7146-4b21-804a-13ecab959b5d service nova] Releasing lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:40 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Successfully created port: 6d2e08fa-3f5c-4648-8702-e52284894e6c {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:08:40 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Successfully created port: 46f621b9-5715-4346-8832-94ec62dbaf26 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Successfully created port: b8a4a214-2ed6-4e39-b408-e8636f7a5bc2 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:08:41 user nova-compute[73917]: INFO nova.virt.block_device [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Booting with volume e6f1ea72-e543-43ea-bdeb-47608eefd15c at /dev/vdb
Aug 26 19:08:41 user nova-compute[73917]: DEBUG os_brick.utils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87d91f9-d165-4e8e-82e5-3de8b4c6fb07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d41a1f1-bb96-49ce-8e1f-a429646ae869]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bf8ce4-4fe1-42fc-a9df-589143e2f99e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e67fabb-4fbe-40b9-b069-15716c5c6f7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:08:41 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:08:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e029fe8-b7cd-4114-b0b9-39fbf0e0323b]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG os_brick.utils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Updating existing volume attachment record: 7ebda2e7-b2a1-40be-ad80-0e55df41aab3 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:08:41 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Successfully created port: fdc4ead3-a55c-4dcb-b62c-7cac780b2343 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:08:42 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Successfully updated port: 41ff38f9-7c92-4705-acd5-26e82e7d472d {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:08:42 user nova-compute[73917]: DEBUG nova.compute.manager [req-2ebaa6aa-ca23-4015-b131-08f015e49077 req-6fe10c16-7666-4a95-b1db-26fe58142a91 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-changed-41ff38f9-7c92-4705-acd5-26e82e7d472d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:42 user nova-compute[73917]: DEBUG nova.compute.manager [req-2ebaa6aa-ca23-4015-b131-08f015e49077 req-6fe10c16-7666-4a95-b1db-26fe58142a91 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Refreshing instance network info cache due to event network-changed-41ff38f9-7c92-4705-acd5-26e82e7d472d. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:08:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2ebaa6aa-ca23-4015-b131-08f015e49077 req-6fe10c16-7666-4a95-b1db-26fe58142a91 service nova] Acquiring lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2ebaa6aa-ca23-4015-b131-08f015e49077 req-6fe10c16-7666-4a95-b1db-26fe58142a91 service nova] Acquired lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:42 user nova-compute[73917]: DEBUG nova.network.neutron [req-2ebaa6aa-ca23-4015-b131-08f015e49077 req-6fe10c16-7666-4a95-b1db-26fe58142a91 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Refreshing network info cache for port 41ff38f9-7c92-4705-acd5-26e82e7d472d {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:08:42 user nova-compute[73917]: DEBUG nova.network.neutron [req-2ebaa6aa-ca23-4015-b131-08f015e49077 req-6fe10c16-7666-4a95-b1db-26fe58142a91 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:08:43 user nova-compute[73917]: DEBUG nova.network.neutron [req-2ebaa6aa-ca23-4015-b131-08f015e49077 req-6fe10c16-7666-4a95-b1db-26fe58142a91 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2ebaa6aa-ca23-4015-b131-08f015e49077 req-6fe10c16-7666-4a95-b1db-26fe58142a91 service nova] Releasing lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:43 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Successfully updated port: 13b34769-8c09-4cc2-a083-6fa9aef81a5e {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:08:44 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Successfully updated port: 8b0ca7bf-b702-4c8a-9ba8-15d3d9725437 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:08:44 user nova-compute[73917]: DEBUG nova.compute.manager [req-fa631f81-406c-4d55-807f-d6d9488bb370 req-c348aea0-8a2c-4161-b025-f6d207b066eb service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Received event network-changed-70707344-848e-4e9b-baf4-6cfbb4737fb8 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:44 user nova-compute[73917]: DEBUG nova.compute.manager [req-fa631f81-406c-4d55-807f-d6d9488bb370 req-c348aea0-8a2c-4161-b025-f6d207b066eb service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Refreshing instance network info cache due to event network-changed-70707344-848e-4e9b-baf4-6cfbb4737fb8. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:08:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fa631f81-406c-4d55-807f-d6d9488bb370 req-c348aea0-8a2c-4161-b025-f6d207b066eb service nova] Acquiring lock "refresh_cache-5dd60c10-f99a-431d-a66f-936a7a7a1c55" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fa631f81-406c-4d55-807f-d6d9488bb370 req-c348aea0-8a2c-4161-b025-f6d207b066eb service nova] Acquired lock "refresh_cache-5dd60c10-f99a-431d-a66f-936a7a7a1c55" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:44 user nova-compute[73917]: DEBUG nova.network.neutron [req-fa631f81-406c-4d55-807f-d6d9488bb370 req-c348aea0-8a2c-4161-b025-f6d207b066eb service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Refreshing network info cache for port 70707344-848e-4e9b-baf4-6cfbb4737fb8 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:08:44 user nova-compute[73917]: DEBUG nova.compute.manager [req-8a69f936-b08b-403d-8e19-0427ed5e2b65 req-d406992b-83e6-4180-a35f-fae101160918 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-changed-13b34769-8c09-4cc2-a083-6fa9aef81a5e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:44 user nova-compute[73917]: DEBUG nova.compute.manager [req-8a69f936-b08b-403d-8e19-0427ed5e2b65 req-d406992b-83e6-4180-a35f-fae101160918 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Refreshing instance network info cache due to event network-changed-13b34769-8c09-4cc2-a083-6fa9aef81a5e. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:08:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8a69f936-b08b-403d-8e19-0427ed5e2b65 req-d406992b-83e6-4180-a35f-fae101160918 service nova] Acquiring lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8a69f936-b08b-403d-8e19-0427ed5e2b65 req-d406992b-83e6-4180-a35f-fae101160918 service nova] Acquired lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:44 user nova-compute[73917]: DEBUG nova.network.neutron [req-8a69f936-b08b-403d-8e19-0427ed5e2b65 req-d406992b-83e6-4180-a35f-fae101160918 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Refreshing network info cache for port 13b34769-8c09-4cc2-a083-6fa9aef81a5e {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:08:44 user nova-compute[73917]: DEBUG nova.network.neutron [req-8a69f936-b08b-403d-8e19-0427ed5e2b65 req-d406992b-83e6-4180-a35f-fae101160918 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:08:44 user nova-compute[73917]: DEBUG nova.network.neutron [req-fa631f81-406c-4d55-807f-d6d9488bb370 req-c348aea0-8a2c-4161-b025-f6d207b066eb service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Updated VIF entry in instance network info cache for port 70707344-848e-4e9b-baf4-6cfbb4737fb8. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:08:44 user nova-compute[73917]: DEBUG nova.network.neutron [req-fa631f81-406c-4d55-807f-d6d9488bb370 req-c348aea0-8a2c-4161-b025-f6d207b066eb service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Updating instance_info_cache with network_info: [{"id": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "address": "fa:16:3e:5a:c1:dd", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70707344-84", "ovs_interfaceid": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fa631f81-406c-4d55-807f-d6d9488bb370 req-c348aea0-8a2c-4161-b025-f6d207b066eb service nova] Releasing lock "refresh_cache-5dd60c10-f99a-431d-a66f-936a7a7a1c55" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:45 user nova-compute[73917]: DEBUG nova.network.neutron [req-8a69f936-b08b-403d-8e19-0427ed5e2b65 req-d406992b-83e6-4180-a35f-fae101160918 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8a69f936-b08b-403d-8e19-0427ed5e2b65 req-d406992b-83e6-4180-a35f-fae101160918 service nova] Releasing lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:45 user nova-compute[73917]: DEBUG nova.compute.manager [req-8a69f936-b08b-403d-8e19-0427ed5e2b65 req-d406992b-83e6-4180-a35f-fae101160918 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-changed-8b0ca7bf-b702-4c8a-9ba8-15d3d9725437 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:45 user nova-compute[73917]: DEBUG nova.compute.manager [req-8a69f936-b08b-403d-8e19-0427ed5e2b65 req-d406992b-83e6-4180-a35f-fae101160918 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Refreshing instance network info cache due to event network-changed-8b0ca7bf-b702-4c8a-9ba8-15d3d9725437. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:08:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8a69f936-b08b-403d-8e19-0427ed5e2b65 req-d406992b-83e6-4180-a35f-fae101160918 service nova] Acquiring lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8a69f936-b08b-403d-8e19-0427ed5e2b65 req-d406992b-83e6-4180-a35f-fae101160918 service nova] Acquired lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:45 user nova-compute[73917]: DEBUG nova.network.neutron [req-8a69f936-b08b-403d-8e19-0427ed5e2b65 req-d406992b-83e6-4180-a35f-fae101160918 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Refreshing network info cache for port 8b0ca7bf-b702-4c8a-9ba8-15d3d9725437 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:08:45 user nova-compute[73917]: DEBUG nova.network.neutron [req-8a69f936-b08b-403d-8e19-0427ed5e2b65 req-d406992b-83e6-4180-a35f-fae101160918 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:08:45 user nova-compute[73917]: DEBUG nova.network.neutron [req-8a69f936-b08b-403d-8e19-0427ed5e2b65 req-d406992b-83e6-4180-a35f-fae101160918 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8a69f936-b08b-403d-8e19-0427ed5e2b65 req-d406992b-83e6-4180-a35f-fae101160918 service nova] Releasing lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:45 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Successfully updated port: 6d2e08fa-3f5c-4648-8702-e52284894e6c {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:08:46 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Successfully updated port: 46f621b9-5715-4346-8832-94ec62dbaf26 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:08:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:08:46 user nova-compute[73917]: DEBUG nova.compute.manager [req-493942a1-21d0-41d5-ad1f-ec2fd24e5b09 req-0791b3ad-98d8-46c3-af57-211cee4262c8 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-changed-6d2e08fa-3f5c-4648-8702-e52284894e6c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:46 user nova-compute[73917]: DEBUG nova.compute.manager [req-493942a1-21d0-41d5-ad1f-ec2fd24e5b09 req-0791b3ad-98d8-46c3-af57-211cee4262c8 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Refreshing instance network info cache due to event network-changed-6d2e08fa-3f5c-4648-8702-e52284894e6c. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:08:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-493942a1-21d0-41d5-ad1f-ec2fd24e5b09 req-0791b3ad-98d8-46c3-af57-211cee4262c8 service nova] Acquiring lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-493942a1-21d0-41d5-ad1f-ec2fd24e5b09 req-0791b3ad-98d8-46c3-af57-211cee4262c8 service nova] Acquired lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:46 user nova-compute[73917]: DEBUG nova.network.neutron [req-493942a1-21d0-41d5-ad1f-ec2fd24e5b09 req-0791b3ad-98d8-46c3-af57-211cee4262c8 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Refreshing network info cache for port 6d2e08fa-3f5c-4648-8702-e52284894e6c {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:08:46 user nova-compute[73917]: DEBUG nova.network.neutron [req-493942a1-21d0-41d5-ad1f-ec2fd24e5b09 req-0791b3ad-98d8-46c3-af57-211cee4262c8 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:08:47 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:08:47 user nova-compute[73917]: DEBUG nova.network.neutron [req-493942a1-21d0-41d5-ad1f-ec2fd24e5b09 req-0791b3ad-98d8-46c3-af57-211cee4262c8 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-493942a1-21d0-41d5-ad1f-ec2fd24e5b09 req-0791b3ad-98d8-46c3-af57-211cee4262c8 service nova] Releasing lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:47 user nova-compute[73917]: DEBUG nova.compute.manager [req-493942a1-21d0-41d5-ad1f-ec2fd24e5b09 req-0791b3ad-98d8-46c3-af57-211cee4262c8 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-changed-46f621b9-5715-4346-8832-94ec62dbaf26 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:47 user nova-compute[73917]: DEBUG nova.compute.manager [req-493942a1-21d0-41d5-ad1f-ec2fd24e5b09 req-0791b3ad-98d8-46c3-af57-211cee4262c8 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Refreshing instance network info cache due to event network-changed-46f621b9-5715-4346-8832-94ec62dbaf26. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:08:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-493942a1-21d0-41d5-ad1f-ec2fd24e5b09 req-0791b3ad-98d8-46c3-af57-211cee4262c8 service nova] Acquiring lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-493942a1-21d0-41d5-ad1f-ec2fd24e5b09 req-0791b3ad-98d8-46c3-af57-211cee4262c8 service nova] Acquired lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:47 user nova-compute[73917]: DEBUG nova.network.neutron [req-493942a1-21d0-41d5-ad1f-ec2fd24e5b09 req-0791b3ad-98d8-46c3-af57-211cee4262c8 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Refreshing network info cache for port 46f621b9-5715-4346-8832-94ec62dbaf26 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:08:47 user nova-compute[73917]: DEBUG nova.network.neutron [req-493942a1-21d0-41d5-ad1f-ec2fd24e5b09 req-0791b3ad-98d8-46c3-af57-211cee4262c8 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:08:47 user nova-compute[73917]: INFO nova.compute.manager [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Rescuing
Aug 26 19:08:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "refresh_cache-fd801f18-34b6-4682-8d43-edf82bd216c2" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquired lock "refresh_cache-fd801f18-34b6-4682-8d43-edf82bd216c2" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:47 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG nova.network.neutron [req-493942a1-21d0-41d5-ad1f-ec2fd24e5b09 req-0791b3ad-98d8-46c3-af57-211cee4262c8 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-493942a1-21d0-41d5-ad1f-ec2fd24e5b09 req-0791b3ad-98d8-46c3-af57-211cee4262c8 service nova] Releasing lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Updating instance_info_cache with network_info: [{"id": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "address": "fa:16:3e:9c:f5:38", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b11e5e-5c", "ovs_interfaceid": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Releasing lock "refresh_cache-fd801f18-34b6-4682-8d43-edf82bd216c2" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Successfully updated port: b8a4a214-2ed6-4e39-b408-e8636f7a5bc2 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG nova.compute.manager [req-43701909-6975-4228-90f2-0119fcfc76d9 req-5d46741a-2d49-4326-9056-ab96df360057 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Received event network-vif-unplugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-43701909-6975-4228-90f2-0119fcfc76d9 req-5d46741a-2d49-4326-9056-ab96df360057 service nova] Acquiring lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-43701909-6975-4228-90f2-0119fcfc76d9 req-5d46741a-2d49-4326-9056-ab96df360057 service nova] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-43701909-6975-4228-90f2-0119fcfc76d9 req-5d46741a-2d49-4326-9056-ab96df360057 service nova] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG nova.compute.manager [req-43701909-6975-4228-90f2-0119fcfc76d9 req-5d46741a-2d49-4326-9056-ab96df360057 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] No waiting events found dispatching network-vif-unplugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:08:48 user nova-compute[73917]: WARNING nova.compute.manager [req-43701909-6975-4228-90f2-0119fcfc76d9 req-5d46741a-2d49-4326-9056-ab96df360057 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Received unexpected event network-vif-unplugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 for instance with vm_state active and task_state rescuing.
Aug 26 19:08:48 user nova-compute[73917]: DEBUG nova.objects.instance [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lazy-loading 'flavor' on Instance uuid 5dd60c10-f99a-431d-a66f-936a7a7a1c55 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.124s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG nova.compute.manager [req-3cd78016-54df-4ade-9287-bf22fce70476 req-8c5557f4-5db5-4814-a937-066fee253192 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-changed-b8a4a214-2ed6-4e39-b408-e8636f7a5bc2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG nova.compute.manager [req-3cd78016-54df-4ade-9287-bf22fce70476 req-8c5557f4-5db5-4814-a937-066fee253192 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Refreshing instance network info cache due to event network-changed-b8a4a214-2ed6-4e39-b408-e8636f7a5bc2. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3cd78016-54df-4ade-9287-bf22fce70476 req-8c5557f4-5db5-4814-a937-066fee253192 service nova] Acquiring lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3cd78016-54df-4ade-9287-bf22fce70476 req-8c5557f4-5db5-4814-a937-066fee253192 service nova] Acquired lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG nova.network.neutron [req-3cd78016-54df-4ade-9287-bf22fce70476 req-8c5557f4-5db5-4814-a937-066fee253192 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Refreshing network info cache for port b8a4a214-2ed6-4e39-b408-e8636f7a5bc2 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:08:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:08:48 user nova-compute[73917]: INFO nova.compute.manager [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Attaching volume 6f35b01a-5495-493f-94e8-0f452a936a67 to /dev/vdb
Aug 26 19:08:48 user nova-compute[73917]: DEBUG nova.network.neutron [req-3cd78016-54df-4ade-9287-bf22fce70476 req-8c5557f4-5db5-4814-a937-066fee253192 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:08:49 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Instance destroyed successfully.
Aug 26 19:08:49 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Attempting rescue
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73917) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG os_brick.utils [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Instance directory exists: not creating {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 19:08:49 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Creating image(s)
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "/opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "/opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.objects.instance [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'trusted_certs' on Instance uuid fd801f18-34b6-4682-8d43-edf82bd216c2 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82870a6-8272-49e0-87c4-d7207754a900]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f332f62-8bd7-4507-ade7-bffe4c36ced2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56a60af-ab52-462b-8dbe-b64f904824ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2117420-0414-41ed-9d40-7a81c116ff60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Successfully updated port: fdc4ead3-a55c-4dcb-b62c-7cac780b2343 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.network.neutron [req-3cd78016-54df-4ade-9287-bf22fce70476 req-8c5557f4-5db5-4814-a937-066fee253192 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Acquiring lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3cd78016-54df-4ade-9287-bf22fce70476 req-8c5557f4-5db5-4814-a937-066fee253192 service nova] Releasing lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Acquired lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:08:49 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f844dce1-ff58-480d-bf4a-636160e5bc21]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG os_brick.utils [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Updating existing volume attachment record: 13ce30c8-33f7-4e16-a90b-f15ac8f4ac2e {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.190s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue" returned: 0 in 0.064s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.objects.instance [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'migration_context' on Instance uuid fd801f18-34b6-4682-8d43-edf82bd216c2 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.objects.base [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Object Instance<fd801f18-34b6-4682-8d43-edf82bd216c2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Start _get_guest_xml network_info=[{"id": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "address": "fa:16:3e:9c:f5:38", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "vif_mac": "fa:16:3e:9c:f5:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b11e5e-5c", "ovs_interfaceid": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.objects.instance [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'resources' on Instance uuid fd801f18-34b6-4682-8d43-edf82bd216c2 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.objects.base [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Object Instance<fd801f18-34b6-4682-8d43-edf82bd216c2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.objects.instance [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'numa_topology' on Instance uuid fd801f18-34b6-4682-8d43-edf82bd216c2 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.objects.base [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Object Instance<fd801f18-34b6-4682-8d43-edf82bd216c2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:08:49 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:08:49 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.objects.instance [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'vcpu_model' on Instance uuid fd801f18-34b6-4682-8d43-edf82bd216c2 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.objects.base [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Object Instance<fd801f18-34b6-4682-8d43-edf82bd216c2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:06:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-864264859',display_name='tempest-ServerRescueNegativeTestJSON-server-864264859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-864264859',id=4,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1298aa7a6ca478fb973d5a6d7bea7be',ramdisk_id='',reservation_id='r-yrrbw1ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475026115',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475026115-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:07:17Z,user_data=None,user_id='118080e0f2fe4533a25e002e894b99f9',uuid=fd801f18-34b6-4682-8d43-edf82bd216c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "address": "fa:16:3e:9c:f5:38", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "vif_mac": "fa:16:3e:9c:f5:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b11e5e-5c", "ovs_interfaceid": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converting VIF {"id": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "address": "fa:16:3e:9c:f5:38", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "vif_mac": "fa:16:3e:9c:f5:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b11e5e-5c", "ovs_interfaceid": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:f5:38,bridge_name='br-int',has_traffic_filtering=True,id=e1b11e5e-5c2a-43b9-bb05-0936cdac7705,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b11e5e-5c') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.objects.instance [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'pci_devices' on Instance uuid fd801f18-34b6-4682-8d43-edf82bd216c2 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.objects.base [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Object Instance<fd801f18-34b6-4682-8d43-edf82bd216c2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:08:49 user nova-compute[73917]:   <uuid>fd801f18-34b6-4682-8d43-edf82bd216c2</uuid>
Aug 26 19:08:49 user nova-compute[73917]:   <name>instance-00000004</name>
Aug 26 19:08:49 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:08:49 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:08:49 user nova-compute[73917]:   <metadata>
Aug 26 19:08:49 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:08:49 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:08:49 user nova-compute[73917]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-864264859</nova:name>
Aug 26 19:08:49 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:08:49</nova:creationTime>
Aug 26 19:08:49 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:08:49 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:08:49 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:08:49 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:08:49 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:08:49 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:08:49 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:08:49 user nova-compute[73917]:       <nova:owner>
Aug 26 19:08:49 user nova-compute[73917]:         <nova:user uuid="118080e0f2fe4533a25e002e894b99f9">tempest-ServerRescueNegativeTestJSON-1475026115-project-member</nova:user>
Aug 26 19:08:49 user nova-compute[73917]:         <nova:project uuid="d1298aa7a6ca478fb973d5a6d7bea7be">tempest-ServerRescueNegativeTestJSON-1475026115</nova:project>
Aug 26 19:08:49 user nova-compute[73917]:       </nova:owner>
Aug 26 19:08:49 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:08:49 user nova-compute[73917]:       <nova:ports>
Aug 26 19:08:49 user nova-compute[73917]:         <nova:port uuid="e1b11e5e-5c2a-43b9-bb05-0936cdac7705">
Aug 26 19:08:49 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 19:08:49 user nova-compute[73917]:         </nova:port>
Aug 26 19:08:49 user nova-compute[73917]:       </nova:ports>
Aug 26 19:08:49 user nova-compute[73917]:     </nova:instance>
Aug 26 19:08:49 user nova-compute[73917]:   </metadata>
Aug 26 19:08:49 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:08:49 user nova-compute[73917]:     <system>
Aug 26 19:08:49 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:08:49 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:08:49 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:08:49 user nova-compute[73917]:       <entry name="serial">fd801f18-34b6-4682-8d43-edf82bd216c2</entry>
Aug 26 19:08:49 user nova-compute[73917]:       <entry name="uuid">fd801f18-34b6-4682-8d43-edf82bd216c2</entry>
Aug 26 19:08:49 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:08:49 user nova-compute[73917]:     </system>
Aug 26 19:08:49 user nova-compute[73917]:   </sysinfo>
Aug 26 19:08:49 user nova-compute[73917]:   <os>
Aug 26 19:08:49 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:08:49 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:08:49 user nova-compute[73917]:   </os>
Aug 26 19:08:49 user nova-compute[73917]:   <features>
Aug 26 19:08:49 user nova-compute[73917]:     <acpi/>
Aug 26 19:08:49 user nova-compute[73917]:     <apic/>
Aug 26 19:08:49 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:08:49 user nova-compute[73917]:   </features>
Aug 26 19:08:49 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:08:49 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:08:49 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:08:49 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:08:49 user nova-compute[73917]:   </clock>
Aug 26 19:08:49 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:08:49 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:08:49 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:08:49 user nova-compute[73917]:   </cpu>
Aug 26 19:08:49 user nova-compute[73917]:   <devices>
Aug 26 19:08:49 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:08:49 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:08:49 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue"/>
Aug 26 19:08:49 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:08:49 user nova-compute[73917]:     </disk>
Aug 26 19:08:49 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:08:49 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:08:49 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk"/>
Aug 26 19:08:49 user nova-compute[73917]:       <target dev="vdb" bus="virtio"/>
Aug 26 19:08:49 user nova-compute[73917]:     </disk>
Aug 26 19:08:49 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:08:49 user nova-compute[73917]:       <mac address="fa:16:3e:9c:f5:38"/>
Aug 26 19:08:49 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:08:49 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:08:49 user nova-compute[73917]:       <target dev="tape1b11e5e-5c"/>
Aug 26 19:08:49 user nova-compute[73917]:     </interface>
Aug 26 19:08:49 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:08:49 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/console.log" append="off"/>
Aug 26 19:08:49 user nova-compute[73917]:     </serial>
Aug 26 19:08:49 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:08:49 user nova-compute[73917]:     <video>
Aug 26 19:08:49 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:08:49 user nova-compute[73917]:     </video>
Aug 26 19:08:49 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:08:49 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:08:49 user nova-compute[73917]:     </rng>
Aug 26 19:08:49 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:08:49 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:08:49 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:08:49 user nova-compute[73917]:     </memballoon>
Aug 26 19:08:49 user nova-compute[73917]:   </devices>
Aug 26 19:08:49 user nova-compute[73917]: </domain>
Aug 26 19:08:49 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:08:49 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Instance destroyed successfully.
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:08:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] No VIF found with MAC fa:16:3e:9c:f5:38, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:08:50 user nova-compute[73917]: INFO nova.virt.block_device [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Booting with volume 85aa6bd1-1305-4063-99e0-70e1329a38cc at /dev/vdb
Aug 26 19:08:50 user nova-compute[73917]: DEBUG os_brick.utils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[952c24e6-48ab-400a-9518-a33394e3c7ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[577706be-684b-44dd-ae42-8c280ba5bcc7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9df9bb-bda8-4b49-bd38-179063053487]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8088850-0414-4bdf-85e9-8a0bcab0364a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:08:50 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef4e0ff-9a0c-4093-8020-b82675dd72f1]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG os_brick.utils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Updating existing volume attachment record: 88a5b7f2-768e-48be-bc76-3b1562c5d83f {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG nova.compute.manager [req-b1c9c998-ab72-49bf-9730-fb9a901c9095 req-62244bc5-1635-4df5-9413-e6bb11d33ef4 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-changed-fdc4ead3-a55c-4dcb-b62c-7cac780b2343 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG nova.compute.manager [req-b1c9c998-ab72-49bf-9730-fb9a901c9095 req-62244bc5-1635-4df5-9413-e6bb11d33ef4 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Refreshing instance network info cache due to event network-changed-fdc4ead3-a55c-4dcb-b62c-7cac780b2343. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b1c9c998-ab72-49bf-9730-fb9a901c9095 req-62244bc5-1635-4df5-9413-e6bb11d33ef4 service nova] Acquiring lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Updating instance_info_cache with network_info: [{"id": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "address": "fa:16:3e:89:79:8b", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8ac63b-61", "ovs_interfaceid": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:08:50 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-3a93cff0-5f7a-4ec1-b333-e7d09b3e4700 req-493f7c80-a75a-429b-9add-89dd988cd02c service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Received event network-vif-plugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a93cff0-5f7a-4ec1-b333-e7d09b3e4700 req-493f7c80-a75a-429b-9add-89dd988cd02c service nova] Acquiring lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a93cff0-5f7a-4ec1-b333-e7d09b3e4700 req-493f7c80-a75a-429b-9add-89dd988cd02c service nova] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a93cff0-5f7a-4ec1-b333-e7d09b3e4700 req-493f7c80-a75a-429b-9add-89dd988cd02c service nova] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-3a93cff0-5f7a-4ec1-b333-e7d09b3e4700 req-493f7c80-a75a-429b-9add-89dd988cd02c service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] No waiting events found dispatching network-vif-plugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:08:51 user nova-compute[73917]: WARNING nova.compute.manager [req-3a93cff0-5f7a-4ec1-b333-e7d09b3e4700 req-493f7c80-a75a-429b-9add-89dd988cd02c service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Received unexpected event network-vif-plugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 for instance with vm_state active and task_state rescuing.
Aug 26 19:08:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Updating instance_info_cache with network_info: [{"id": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "address": "fa:16:3e:90:51:54", "network": {"id": "ac76a379-a5c0-4a2e-af46-10ba88cc1bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1001642955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ff38f9-7c", "ovs_interfaceid": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "address": "fa:16:3e:04:13:20", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b34769-8c", "ovs_interfaceid": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "address": "fa:16:3e:d4:c6:e1", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0ca7bf-b7", "ovs_interfaceid": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "address": "fa:16:3e:ae:55:aa", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2e08fa-3f", "ovs_interfaceid": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "46f621b9-5715-4346-8832-94ec62dbaf26", "address": "fa:16:3e:84:7e:49", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f621b9-57", "ovs_interfaceid": "46f621b9-5715-4346-8832-94ec62dbaf26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "address": "fa:16:3e:58:d6:83", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a4a214-2e", "ovs_interfaceid": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "address": "fa:16:3e:6b:a4:c0", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc4ead3-a5", "ovs_interfaceid": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Releasing lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Instance network_info: |[{"id": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "address": "fa:16:3e:90:51:54", "network": {"id": "ac76a379-a5c0-4a2e-af46-10ba88cc1bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1001642955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ff38f9-7c", "ovs_interfaceid": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "address": "fa:16:3e:04:13:20", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b34769-8c", "ovs_interfaceid": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "address": "fa:16:3e:d4:c6:e1", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0ca7bf-b7", "ovs_interfaceid": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "address": "fa:16:3e:ae:55:aa", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2e08fa-3f", "ovs_interfaceid": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "46f621b9-5715-4346-8832-94ec62dbaf26", "address": "fa:16:3e:84:7e:49", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f621b9-57", "ovs_interfaceid": "46f621b9-5715-4346-8832-94ec62dbaf26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "address": "fa:16:3e:58:d6:83", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a4a214-2e", "ovs_interfaceid": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "address": "fa:16:3e:6b:a4:c0", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc4ead3-a5", "ovs_interfaceid": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b1c9c998-ab72-49bf-9730-fb9a901c9095 req-62244bc5-1635-4df5-9413-e6bb11d33ef4 service nova] Acquired lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG nova.network.neutron [req-b1c9c998-ab72-49bf-9730-fb9a901c9095 req-62244bc5-1635-4df5-9413-e6bb11d33ef4 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Refreshing network info cache for port fdc4ead3-a55c-4dcb-b62c-7cac780b2343 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:52 user nova-compute[73917]: DEBUG nova.network.neutron [req-b1c9c998-ab72-49bf-9730-fb9a901c9095 req-62244bc5-1635-4df5-9413-e6bb11d33ef4 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Updated VIF entry in instance network info cache for port fdc4ead3-a55c-4dcb-b62c-7cac780b2343. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:08:52 user nova-compute[73917]: DEBUG nova.network.neutron [req-b1c9c998-ab72-49bf-9730-fb9a901c9095 req-62244bc5-1635-4df5-9413-e6bb11d33ef4 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Updating instance_info_cache with network_info: [{"id": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "address": "fa:16:3e:90:51:54", "network": {"id": "ac76a379-a5c0-4a2e-af46-10ba88cc1bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1001642955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ff38f9-7c", "ovs_interfaceid": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "address": "fa:16:3e:04:13:20", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b34769-8c", "ovs_interfaceid": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "address": "fa:16:3e:d4:c6:e1", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0ca7bf-b7", "ovs_interfaceid": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "address": "fa:16:3e:ae:55:aa", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2e08fa-3f", "ovs_interfaceid": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "46f621b9-5715-4346-8832-94ec62dbaf26", "address": "fa:16:3e:84:7e:49", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f621b9-57", "ovs_interfaceid": "46f621b9-5715-4346-8832-94ec62dbaf26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "address": "fa:16:3e:58:d6:83", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a4a214-2e", "ovs_interfaceid": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "address": "fa:16:3e:6b:a4:c0", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc4ead3-a5", "ovs_interfaceid": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b1c9c998-ab72-49bf-9730-fb9a901c9095 req-62244bc5-1635-4df5-9413-e6bb11d33ef4 service nova] Releasing lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-ae5ace8d-a4d3-467d-b6e9-7b8d7d408f94 req-16523922-2cc2-4813-a142-e1d975f67455 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Received event network-vif-plugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ae5ace8d-a4d3-467d-b6e9-7b8d7d408f94 req-16523922-2cc2-4813-a142-e1d975f67455 service nova] Acquiring lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ae5ace8d-a4d3-467d-b6e9-7b8d7d408f94 req-16523922-2cc2-4813-a142-e1d975f67455 service nova] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ae5ace8d-a4d3-467d-b6e9-7b8d7d408f94 req-16523922-2cc2-4813-a142-e1d975f67455 service nova] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-ae5ace8d-a4d3-467d-b6e9-7b8d7d408f94 req-16523922-2cc2-4813-a142-e1d975f67455 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] No waiting events found dispatching network-vif-plugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:08:53 user nova-compute[73917]: WARNING nova.compute.manager [req-ae5ace8d-a4d3-467d-b6e9-7b8d7d408f94 req-16523922-2cc2-4813-a142-e1d975f67455 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Received unexpected event network-vif-plugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 for instance with vm_state active and task_state rescuing.
Aug 26 19:08:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-ae5ace8d-a4d3-467d-b6e9-7b8d7d408f94 req-16523922-2cc2-4813-a142-e1d975f67455 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Received event network-vif-plugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ae5ace8d-a4d3-467d-b6e9-7b8d7d408f94 req-16523922-2cc2-4813-a142-e1d975f67455 service nova] Acquiring lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ae5ace8d-a4d3-467d-b6e9-7b8d7d408f94 req-16523922-2cc2-4813-a142-e1d975f67455 service nova] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ae5ace8d-a4d3-467d-b6e9-7b8d7d408f94 req-16523922-2cc2-4813-a142-e1d975f67455 service nova] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-ae5ace8d-a4d3-467d-b6e9-7b8d7d408f94 req-16523922-2cc2-4813-a142-e1d975f67455 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] No waiting events found dispatching network-vif-plugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:08:53 user nova-compute[73917]: WARNING nova.compute.manager [req-ae5ace8d-a4d3-467d-b6e9-7b8d7d408f94 req-16523922-2cc2-4813-a142-e1d975f67455 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Received unexpected event network-vif-plugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 for instance with vm_state active and task_state rescuing.
Aug 26 19:08:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Removed pending event for fd801f18-34b6-4682-8d43-edf82bd216c2 due to event {{(pid=73917) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076933.3890932, fd801f18-34b6-4682-8d43-edf82bd216c2 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:08:53 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] VM Resumed (Lifecycle Event)
Aug 26 19:08:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ec8f106e-84f9-4150-9521-1b4f58b022a8 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-6289b064-9c17-4a5f-9f68-747edb535394 req-e34f0305-40d2-43b8-bfbb-90d5cbf56337 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received event network-changed-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-6289b064-9c17-4a5f-9f68-747edb535394 req-e34f0305-40d2-43b8-bfbb-90d5cbf56337 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Refreshing instance network info cache due to event network-changed-37aa792a-c367-4dfd-b814-cb9c32ef373c. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6289b064-9c17-4a5f-9f68-747edb535394 req-e34f0305-40d2-43b8-bfbb-90d5cbf56337 service nova] Acquiring lock "refresh_cache-fdfb377e-119e-41ce-b9e0-6e21053306cc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6289b064-9c17-4a5f-9f68-747edb535394 req-e34f0305-40d2-43b8-bfbb-90d5cbf56337 service nova] Acquired lock "refresh_cache-fdfb377e-119e-41ce-b9e0-6e21053306cc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG nova.network.neutron [req-6289b064-9c17-4a5f-9f68-747edb535394 req-e34f0305-40d2-43b8-bfbb-90d5cbf56337 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Refreshing network info cache for port 37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:08:53 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 19:08:53 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076933.390375, fd801f18-34b6-4682-8d43-edf82bd216c2 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:08:53 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] VM Started (Lifecycle Event)
Aug 26 19:08:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:54 user nova-compute[73917]: INFO nova.virt.block_device [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Booting with volume 5b486c20-77b8-42e7-aa76-224979a67334 at /dev/vdc
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Acquiring lock "ce383b5a-c726-4d82-b0e3-be6ac6659428" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "ce383b5a-c726-4d82-b0e3-be6ac6659428" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG nova.network.neutron [req-6289b064-9c17-4a5f-9f68-747edb535394 req-e34f0305-40d2-43b8-bfbb-90d5cbf56337 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Updated VIF entry in instance network info cache for port 37aa792a-c367-4dfd-b814-cb9c32ef373c. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG nova.network.neutron [req-6289b064-9c17-4a5f-9f68-747edb535394 req-e34f0305-40d2-43b8-bfbb-90d5cbf56337 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Updating instance_info_cache with network_info: [{"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG nova.objects.instance [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lazy-loading 'flavor' on Instance uuid ce383b5a-c726-4d82-b0e3-be6ac6659428 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6289b064-9c17-4a5f-9f68-747edb535394 req-e34f0305-40d2-43b8-bfbb-90d5cbf56337 service nova] Releasing lock "refresh_cache-fdfb377e-119e-41ce-b9e0-6e21053306cc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "ce383b5a-c726-4d82-b0e3-be6ac6659428" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.164s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG os_brick.utils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0218b5cc-73cf-4d53-abe5-58924492cfa9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b0e172-4c20-44fc-8069-a9dced40f5bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c506a4-1d4a-44b2-8ef6-0bc34cd7e2b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9531d422-d46f-4f50-8917-c2faf8c8b5dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:08:54 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7181fbe2-dd13-458b-bd32-718d0b9e00c7]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG os_brick.utils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Updating existing volume attachment record: 9c436044-99fc-4e9e-932e-bea5019a0f96 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Acquiring lock "ce383b5a-c726-4d82-b0e3-be6ac6659428" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "ce383b5a-c726-4d82-b0e3-be6ac6659428" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:08:54 user nova-compute[73917]: INFO nova.compute.manager [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Attaching volume 6b2c8e85-497c-44d1-839e-d8aca05396d6 to /dev/vdb
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:08:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG nova.compute.manager [req-76d7f522-1ef2-4603-bc9f-bb803528fb7e req-4a11a957-408e-48f1-bc48-3d2a7153f656 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Received event network-changed-2738a59b-9109-4fef-8868-920d458dfaa1 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG nova.compute.manager [req-76d7f522-1ef2-4603-bc9f-bb803528fb7e req-4a11a957-408e-48f1-bc48-3d2a7153f656 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Refreshing instance network info cache due to event network-changed-2738a59b-9109-4fef-8868-920d458dfaa1. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-76d7f522-1ef2-4603-bc9f-bb803528fb7e req-4a11a957-408e-48f1-bc48-3d2a7153f656 service nova] Acquiring lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-76d7f522-1ef2-4603-bc9f-bb803528fb7e req-4a11a957-408e-48f1-bc48-3d2a7153f656 service nova] Acquired lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG nova.network.neutron [req-76d7f522-1ef2-4603-bc9f-bb803528fb7e req-4a11a957-408e-48f1-bc48-3d2a7153f656 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Refreshing network info cache for port 2738a59b-9109-4fef-8868-920d458dfaa1 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:08:57 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:08:57 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:08:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=6758MB free_disk=25.559654235839844GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 5dd60c10-f99a-431d-a66f-936a7a7a1c55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance cc0ae046-2a39-4ab6-9327-2d9452c3035d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance ce383b5a-c726-4d82-b0e3-be6ac6659428 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fd801f18-34b6-4682-8d43-edf82bd216c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fdfb377e-119e-41ce-b9e0-6e21053306cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f019c6c6-e76f-4a75-8ba4-8c566d9f5791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c8f0be92-c7bf-49cd-a4a4-23e625603081 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 86937c34-db86-44a9-8196-3cae0d7ce400 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c5120da8-5837-420f-b472-572a088a4a27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 54fd570d-421c-4a39-b4ae-772500b24cec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:08:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:08:58 user nova-compute[73917]: DEBUG nova.network.neutron [req-76d7f522-1ef2-4603-bc9f-bb803528fb7e req-4a11a957-408e-48f1-bc48-3d2a7153f656 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Updated VIF entry in instance network info cache for port 2738a59b-9109-4fef-8868-920d458dfaa1. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:08:58 user nova-compute[73917]: DEBUG nova.network.neutron [req-76d7f522-1ef2-4603-bc9f-bb803528fb7e req-4a11a957-408e-48f1-bc48-3d2a7153f656 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Updating instance_info_cache with network_info: [{"id": "2738a59b-9109-4fef-8868-920d458dfaa1", "address": "fa:16:3e:e9:a2:a3", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2738a59b-91", "ovs_interfaceid": "2738a59b-9109-4fef-8868-920d458dfaa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:08:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-76d7f522-1ef2-4603-bc9f-bb803528fb7e req-4a11a957-408e-48f1-bc48-3d2a7153f656 service nova] Releasing lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:08:58 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:08:58 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:08:58 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:08:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.114s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connector [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Factory for ISCSI on None {{(pid=73917) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAIFloEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:02 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.009s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:02 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:02 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0a23a6-1af3-4c9a-a2e8-69644c006d35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:09:02 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b514fe1c-4697-4382-93ee-a9ce886ba8f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67] added
Aug 26 19:09:02 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fddc1b-16fe-44cc-b681-d690fc214425]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c7e771-3c38-4cf9-867a-406e2c28291d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAIFloEx {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAIFloEx" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8004d4dd-956f-48f4-bd33-ca280bcd5707]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WAIFloEx'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0acffad-9651-4c5a-9fd7-5b09e449226b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6b3a2f-21d8-4d22-a8e4-33330837f832]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 19:09:02 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 19:09:02 user nova-compute[73917]:  {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:02 user nova-compute[73917]: WARNING os_brick.initiator.connectors.iscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 19:09:02 user nova-compute[73917]: 
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb0bad5-ecca-4b63-be01-42cd56a443ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67, portal: 172.16.0.220,3260]
Aug 26 19:09:02 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67, portal: 172.16.0.220,3260] successful.
Aug 26 19:09:02 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.utils [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4774ee-870c-4666-9203-49bdfde641a3]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efe003c-d239-4ff9-a2e3-91bf5c0e28f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d11d355-aaf0-4490-9ae4-f21585a10c2b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:02 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:02 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d64526-be90-4df4-9426-3e4c3135ead9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG nova.objects.instance [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'flavor' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[49653760-c15f-4ba4-871f-870685db43c9]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAIFloEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.034s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[da09da77-2e6d-491e-b7e5-9e595eb639e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbad05f-92c3-4543-a80b-83b50fb80eaa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:09:02 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:09:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5e1264-8105-4b61-8453-eabb22128c80]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG os_brick.utils [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:02 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Updating existing volume attachment record: 703fcf66-19a9-4ed5-812a-56331a6e8499 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG nova.compute.manager [req-a5b4cf98-27e3-4cad-bac1-2a1947839319 req-a70160ff-211e-468b-810d-87bf9f9d04f1 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-changed-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG nova.compute.manager [req-a5b4cf98-27e3-4cad-bac1-2a1947839319 req-a70160ff-211e-468b-810d-87bf9f9d04f1 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Refreshing instance network info cache due to event network-changed-245e99f5-fb5c-4442-b5f7-c2b05207f2fc. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a5b4cf98-27e3-4cad-bac1-2a1947839319 req-a70160ff-211e-468b-810d-87bf9f9d04f1 service nova] Acquiring lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a5b4cf98-27e3-4cad-bac1-2a1947839319 req-a70160ff-211e-468b-810d-87bf9f9d04f1 service nova] Acquired lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG nova.network.neutron [req-a5b4cf98-27e3-4cad-bac1-2a1947839319 req-a70160ff-211e-468b-810d-87bf9f9d04f1 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Refreshing network info cache for port 245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:03 user nova-compute[73917]: INFO nova.compute.manager [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Attaching volume 90b84430-2ecf-40e8-96de-912b95b5bf86 to /dev/vdb
Aug 26 19:09:03 user nova-compute[73917]: INFO nova.virt.block_device [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Booting with volume 87f6874a-24b7-4e83-bd0d-01ea7bad1cdb at /dev/vdc
Aug 26 19:09:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26338636361373333', 'path': '/dev/sdb'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338636361373333', 'path': '/dev/sdb'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG nova.objects.instance [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lazy-loading 'flavor' on Instance uuid 5dd60c10-f99a-431d-a66f-936a7a7a1c55 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:09:03 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:09:03 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 19:09:03 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:09:03 user nova-compute[73917]:   <serial>6f35b01a-5495-493f-94e8-0f452a936a67</serial>
Aug 26 19:09:03 user nova-compute[73917]: </disk>
Aug 26 19:09:03 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG os_brick.utils [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[213b3fc4-4172-4fd6-adce-e53b2aa29d8d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bbe393-ea9e-4eea-97a3-595591a9f1ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6905cf46-2674-403f-9336-3cb9e9aa0baf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c03fc5f-14d8-4802-8aab-3c6b631826e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG os_brick.utils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[82df1b79-bbcc-4a58-b070-603831e8f734]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:09:03 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f70d316-49fa-44d9-86d9-44fec2ae7cba]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG os_brick.utils [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Updating existing volume attachment record: eb374e5a-a19c-4b28-9da3-e5beb440aa93 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed5d3fc-9925-4b44-a1f8-81ef735d2889]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[434ccb7c-6a2b-4538-8357-3384c20dbf5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97897f5-5e86-47ba-8ed8-7a5661480e77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:09:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:09:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:09:04 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:09:04 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfd647a-f3e3-4609-bb1c-f8b48502d44c]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:04 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:09:04 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:09:04 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:09:04 user nova-compute[73917]: DEBUG os_brick.utils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:04 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Updating existing volume attachment record: ecafb237-b3b0-4ec6-a038-4f1d4445276a {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:09:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:09:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:09:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] No VIF found with MAC fa:16:3e:5a:c1:dd, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:09:04 user nova-compute[73917]: DEBUG nova.network.neutron [req-a5b4cf98-27e3-4cad-bac1-2a1947839319 req-a70160ff-211e-468b-810d-87bf9f9d04f1 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Updated VIF entry in instance network info cache for port 245e99f5-fb5c-4442-b5f7-c2b05207f2fc. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:09:04 user nova-compute[73917]: DEBUG nova.network.neutron [req-a5b4cf98-27e3-4cad-bac1-2a1947839319 req-a70160ff-211e-468b-810d-87bf9f9d04f1 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Updating instance_info_cache with network_info: [{"id": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "address": "fa:16:3e:c9:58:2d", "network": {"id": "4fb39591-1339-423b-a17d-cec979856e60", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09772507cd24e329e84aa3b9a3b9b7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245e99f5-fb", "ovs_interfaceid": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:09:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a5b4cf98-27e3-4cad-bac1-2a1947839319 req-a70160ff-211e-468b-810d-87bf9f9d04f1 service nova] Releasing lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:09:05 user nova-compute[73917]: DEBUG nova.compute.manager [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:09:05 user nova-compute[73917]: INFO nova.compute.manager [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] instance snapshotting
Aug 26 19:09:05 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Beginning live snapshot process
Aug 26 19:09:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json -f qcow2 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json -f qcow2" returned: 0 in 0.206s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json -f qcow2 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.194s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphe0ps8_e/fe7b7da3e0894e24a0683e6a57cc90af.delta 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphe0ps8_e/fe7b7da3e0894e24a0683e6a57cc90af.delta 1073741824" returned: 0 in 0.054s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:06 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 19:09:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73917) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 26 19:09:06 user nova-compute[73917]: INFO nova.virt.libvirt.host [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] UEFI support detected
Aug 26 19:09:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:09:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] COPY block job progress, current cursor: 59179008 final cursor: 75497472 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:09:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:09:07 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 19:09:07 user nova-compute[73917]: DEBUG nova.privsep.utils [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73917) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 19:09:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphe0ps8_e/fe7b7da3e0894e24a0683e6a57cc90af.delta /opt/stack/data/nova/instances/snapshots/tmphe0ps8_e/fe7b7da3e0894e24a0683e6a57cc90af {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphe0ps8_e/fe7b7da3e0894e24a0683e6a57cc90af.delta /opt/stack/data/nova/instances/snapshots/tmphe0ps8_e/fe7b7da3e0894e24a0683e6a57cc90af" returned: 0 in 0.520s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:08 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Snapshot extracted, beginning image upload
Aug 26 19:09:10 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Snapshot image upload complete
Aug 26 19:09:10 user nova-compute[73917]: INFO nova.compute.manager [None req-8e407c10-3076-4540-a3c0-8e3941ff4e94 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Took 5.73 seconds to snapshot the instance on the hypervisor.
Aug 26 19:09:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:09:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnywxBYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:15 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:15 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:15 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:09:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a304343-8ff1-4263-9eef-8dba0aad27c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:09:15 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1a8730-2a05-4322-8041-fa73d12a62ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6] added
Aug 26 19:09:15 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a866e1ab-4d59-4ec5-bb88-e534a185779b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c465c6dd-3d8d-497d-9fe3-c61bc1ebf391 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.040s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[656ce96d-ca86-4848-be91-62f139ffb1dd]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qnywxBYF {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qnywxBYF" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0205e5-a280-4414-b1b2-cb35b74a94b5]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qnywxBYF'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7763ce3-b10b-4fea-a6ca-f9d2c61e1a0e]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06be9af-12e8-43bc-aeff-2774e32ed62e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:16 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:16 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd1b32b-1b23-42a7-a297-c20daa5c5645]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6, portal: 172.16.0.220,3260]
Aug 26 19:09:16 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6, portal: 172.16.0.220,3260] successful.
Aug 26 19:09:16 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bff8a46-388b-44c5-9993-950554daab8d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[87de9729-395a-4425-862b-e1b5e2464333]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:16 user nova-compute[73917]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)
Aug 26 19:09:16 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:16 user nova-compute[73917]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)
Aug 26 19:09:16 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[53694482-12a4-4c72-96cc-99182c9f0bf2]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnywxBYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:09:16 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Creating image(s)
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Did not create local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Ensure instance console log exists: /opt/stack/data/nova/instances/54fd570d-421c-4a39-b4ae-772500b24cec/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Start _get_guest_xml network_info=[{"id": "9268e463-2367-4d84-be0e-f432a917b945", "address": "fa:16:3e:3c:5e:e6", "network": {"id": "b5165b66-cdc8-4b7f-ab73-feae1a655345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716155983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9268e463-23", "ovs_interfaceid": "9268e463-2367-4d84-be0e-f432a917b945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "address": "fa:16:3e:d7:d4:c6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc09729-80", "ovs_interfaceid": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22c864bd-81de-436b-9745-de2cf3cfffd5", "address": "fa:16:3e:2b:23:f6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c864bd-81", "ovs_interfaceid": "22c864bd-81de-436b-9745-de2cf3cfffd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "address": "fa:16:3e:ea:a2:cb", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1aa81-34", "ovs_interfaceid": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "address": "fa:16:3e:f6:f5:7c", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4bbc97-cf", "ovs_interfaceid": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19a44d0d-f673-49e9-8c62-014aff19769c", "address": "fa:16:3e:08:64:60", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a44d0d-f6", "ovs_interfaceid": "19a44d0d-f673-49e9-8c62-014aff19769c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "472badf6-8de1-4c67-8bfa-7105f672eff0", "address": "fa:16:3e:c9:52:16", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472badf6-8d", "ovs_interfaceid": "472badf6-8de1-4c67-8bfa-7105f672eff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QEyjfTiJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54fd570d-421c-4a39-b4ae-772500b24cec', 'attached_at': '', 'detached_at': '', 'volume_id': '6f794151-249c-4191-990d-cee0e30d3a5a', 'serial': '6f794151-249c-4191-990d-cee0e30d3a5a'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'a3a8ea39-07e9-45e0-8986-a46c1feebed1', 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 1, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcHTzUrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54fd570d-421c-4a39-b4ae-772500b24cec', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6f1ea72-e543-43ea-bdeb-47608eefd15c', 'serial': 'e6f1ea72-e543-43ea-bdeb-47608eefd15c'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '7ebda2e7-b2a1-40be-ad80-0e55df41aab3', 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 2, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btAlVdFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54fd570d-421c-4a39-b4ae-772500b24cec', 'attached_at': '', 'detached_at': '', 'volume_id': '5b486c20-77b8-42e7-aa76-224979a67334', 'serial': '5b486c20-77b8-42e7-aa76-224979a67334'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'attachment_id': '9c436044-99fc-4e9e-932e-bea5019a0f96', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:09:16 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:09:16 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QEyjfTiJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:16 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:09:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hXixcyfT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:16 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26665666262613361', 'path': '/dev/sdc'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665666262613361', 'path': '/dev/sdc'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.916s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:17 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:17 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG nova.objects.instance [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lazy-loading 'flavor' on Instance uuid ce383b5a-c726-4d82-b0e3-be6ac6659428 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9520663f-4083-42fc-913c-a68f17b53fce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:09:17 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:09:17 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:09:17 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:09:17 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:09:17 user nova-compute[73917]:   <serial>6b2c8e85-497c-44d1-839e-d8aca05396d6</serial>
Aug 26 19:09:17 user nova-compute[73917]: </disk>
Aug 26 19:09:17 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b00a5e-f435-4fb6-a388-6b6f8a6e9012]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a] added
Aug 26 19:09:17 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8ca2e7-8b25-48cb-95ec-ac49a3fdb3ce]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1914b7d3-4b23-42ac-bd21-625b2368fc92]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QEyjfTiJ {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QEyjfTiJ" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd5341a-d69d-4c60-9341-68388d11e4df]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QEyjfTiJ'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69e36a7-201a-4558-ad7a-642e4e4fefc3]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fa16cb-0b1a-43c4-8245-fcbcbf1a4be5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:17 user nova-compute[73917]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)
Aug 26 19:09:17 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:17 user nova-compute[73917]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)
Aug 26 19:09:17 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9092db-5865-44f1-9613-c2e021ffb484]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a, portal: 172.16.0.220,3260]
Aug 26 19:09:17 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a, portal: 172.16.0.220,3260] successful.
Aug 26 19:09:17 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[705b7e17-11c6-4c7d-a873-7ff1ea8df0be]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c559ba-b9c5-43a4-a52e-67c7ab99d634]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:17 user nova-compute[73917]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)
Aug 26 19:09:17 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:17 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:17 user nova-compute[73917]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)
Aug 26 19:09:17 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:17 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bb5504-d813-4fb5-868e-816d946f5928]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QEyjfTiJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] No VIF found with MAC fa:16:3e:5b:58:7f, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:09:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-827da238-b011-43ca-ba00-5abe389b8cda tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "ce383b5a-c726-4d82-b0e3-be6ac6659428" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.411s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Acquiring lock "ce383b5a-c726-4d82-b0e3-be6ac6659428" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "ce383b5a-c726-4d82-b0e3-be6ac6659428" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Acquiring lock "ce383b5a-c726-4d82-b0e3-be6ac6659428-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "ce383b5a-c726-4d82-b0e3-be6ac6659428-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "ce383b5a-c726-4d82-b0e3-be6ac6659428-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:18 user nova-compute[73917]: INFO nova.compute.manager [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Terminating instance
Aug 26 19:09:18 user nova-compute[73917]: DEBUG nova.compute.manager [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] <== connect_volume: return (2250ms) {'type': 'block', 'scsi_wwn': '26531643662343038', 'path': '/dev/sdd'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531643662343038', 'path': '/dev/sdd'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.648s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:18 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:18 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb75a693-3466-424d-be47-e3e40248388e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:09:18 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcHTzUrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:18 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b81f92d-5cb0-4175-a371-da97e2f72d0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86] added
Aug 26 19:09:18 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe6cce9-56e3-49c0-bb08-f7e5a987e393]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[144110c0-da54-48c2-81a5-5ffbef30aeac]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hXixcyfT {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hXixcyfT" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f8e204-908a-4edd-8c8d-e16f41644194]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hXixcyfT'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4edfb38-e9df-4798-b375-6216be710e28]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[814c9bed-ac7d-43ce-b720-3ac7861d5276]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:18 user nova-compute[73917]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)
Aug 26 19:09:18 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:18 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:18 user nova-compute[73917]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)
Aug 26 19:09:18 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:18 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG nova.compute.manager [req-f9e9e5d7-2e20-4ad9-910d-cbdae80fe254 req-2eea22b4-b64c-42d7-824b-57a1b1a1b7f2 service nova] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Received event network-vif-unplugged-a8f8f32c-cf87-43ae-b6db-43da89ab6888 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f9e9e5d7-2e20-4ad9-910d-cbdae80fe254 req-2eea22b4-b64c-42d7-824b-57a1b1a1b7f2 service nova] Acquiring lock "ce383b5a-c726-4d82-b0e3-be6ac6659428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f9e9e5d7-2e20-4ad9-910d-cbdae80fe254 req-2eea22b4-b64c-42d7-824b-57a1b1a1b7f2 service nova] Lock "ce383b5a-c726-4d82-b0e3-be6ac6659428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f9e9e5d7-2e20-4ad9-910d-cbdae80fe254 req-2eea22b4-b64c-42d7-824b-57a1b1a1b7f2 service nova] Lock "ce383b5a-c726-4d82-b0e3-be6ac6659428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG nova.compute.manager [req-f9e9e5d7-2e20-4ad9-910d-cbdae80fe254 req-2eea22b4-b64c-42d7-824b-57a1b1a1b7f2 service nova] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] No waiting events found dispatching network-vif-unplugged-a8f8f32c-cf87-43ae-b6db-43da89ab6888 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG nova.compute.manager [req-f9e9e5d7-2e20-4ad9-910d-cbdae80fe254 req-2eea22b4-b64c-42d7-824b-57a1b1a1b7f2 service nova] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Received event network-vif-unplugged-a8f8f32c-cf87-43ae-b6db-43da89ab6888 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8323e5-0c27-4230-b0a7-4cea427965cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86, portal: 172.16.0.220,3260]
Aug 26 19:09:18 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86, portal: 172.16.0.220,3260] successful.
Aug 26 19:09:18 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa61338-7555-47c9-8bb5-969b546f46b8]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c790e07-8412-467c-9f94-db8518d2af6f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:18 user nova-compute[73917]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)
Aug 26 19:09:18 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:18 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:18 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:18 user nova-compute[73917]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)
Aug 26 19:09:18 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:18 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:18 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e26283-7dfa-4089-916c-56210508e254]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hXixcyfT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "2e449059-38d9-40bb-aa04-8b6c3865309b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "2e449059-38d9-40bb-aa04-8b6c3865309b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:18 user nova-compute[73917]: DEBUG nova.compute.manager [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:09:19 user nova-compute[73917]: INFO nova.compute.claims [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Claim successful on node user
Aug 26 19:09:19 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Instance destroyed successfully.
Aug 26 19:09:19 user nova-compute[73917]: DEBUG nova.objects.instance [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lazy-loading 'resources' on Instance uuid ce383b5a-c726-4d82-b0e3-be6ac6659428 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:06:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-577121937',display_name='tempest-DeleteServersTestJSON-server-577121937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-577121937',id=3,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d61981dd63e469e8e4c5ecdf13119e0',ramdisk_id='',reservation_id='r-10piorus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1349277273',owner_user_name='tempest-DeleteServersTestJSON-1349277273-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:07:17Z,user_data=None,user_id='7b21184109904699b0077f13cb8709d5',uuid=ce383b5a-c726-4d82-b0e3-be6ac6659428,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8f8f32c-cf87-43ae-b6db-43da89ab6888", "address": "fa:16:3e:5b:58:7f", "network": {"id": "f605ba6b-ba4d-4ab9-b650-c5d0ef2ad199", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979781726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d61981dd63e469e8e4c5ecdf13119e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f8f32c-cf", "ovs_interfaceid": "a8f8f32c-cf87-43ae-b6db-43da89ab6888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Converting VIF {"id": "a8f8f32c-cf87-43ae-b6db-43da89ab6888", "address": "fa:16:3e:5b:58:7f", "network": {"id": "f605ba6b-ba4d-4ab9-b650-c5d0ef2ad199", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979781726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d61981dd63e469e8e4c5ecdf13119e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f8f32c-cf", "ovs_interfaceid": "a8f8f32c-cf87-43ae-b6db-43da89ab6888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:58:7f,bridge_name='br-int',has_traffic_filtering=True,id=a8f8f32c-cf87-43ae-b6db-43da89ab6888,network=Network(f605ba6b-ba4d-4ab9-b650-c5d0ef2ad199),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8f8f32c-cf') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG os_vif [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:58:7f,bridge_name='br-int',has_traffic_filtering=True,id=a8f8f32c-cf87-43ae-b6db-43da89ab6888,network=Network(f605ba6b-ba4d-4ab9-b650-c5d0ef2ad199),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8f8f32c-cf') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8f8f32c-cf, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:09:19 user nova-compute[73917]: INFO os_vif [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:58:7f,bridge_name='br-int',has_traffic_filtering=True,id=a8f8f32c-cf87-43ae-b6db-43da89ab6888,network=Network(f605ba6b-ba4d-4ab9-b650-c5d0ef2ad199),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8f8f32c-cf')
Aug 26 19:09:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnywxBYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:19 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG nova.network.neutron [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:09:19 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:09:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG nova.policy [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c64a5d226b8b4d60af840d49315bf60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b291bbf9aedc4414a1ab402602849140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:09:19 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Creating image(s)
Aug 26 19:09:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "/opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "/opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '26339336262316339', 'path': '/dev/sde'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339336262316339', 'path': '/dev/sde'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.358s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:19 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:19 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:09:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:19 user nova-compute[73917]: DEBUG nova.objects.instance [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'flavor' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8cae04-5e7d-44ff-993f-6877381699ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:09:20 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:09:20 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:09:20 user nova-compute[73917]:   <source dev="/dev/sde"/>
Aug 26 19:09:20 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:09:20 user nova-compute[73917]:   <serial>90b84430-2ecf-40e8-96de-912b95b5bf86</serial>
Aug 26 19:09:20 user nova-compute[73917]: </disk>
Aug 26 19:09:20 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a5ad85-ac10-4278-8cec-c93c394caa02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c] added
Aug 26 19:09:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23b830c-5018-44c5-856c-b7fe0671a616]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[da656da8-5adc-4b1b-95bf-87f0213202b5]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.221s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.013s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcHTzUrq {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcHTzUrq" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd3e65e-9d9b-47c2-9eb3-843dab2f8a5e]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lcHTzUrq'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[02eed3b8-6c18-4f61-8f48-5d3c0388aff2]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2950a2-b86c-4912-a0c8-b6099a0abd06]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:20 user nova-compute[73917]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)
Aug 26 19:09:20 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:20 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:20 user nova-compute[73917]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)
Aug 26 19:09:20 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:20 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4905c59-a185-4530-b02f-adc5723ac597]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c, portal: 172.16.0.220,3260]
Aug 26 19:09:20 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c, portal: 172.16.0.220,3260] successful.
Aug 26 19:09:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.190s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53ab9c1-a2c8-4429-bbfa-3cadb9b6879e]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b/disk 1073741824" returned: 0 in 0.059s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9b4059-d6b0-4283-8e27-b42f0993dfd1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:20 user nova-compute[73917]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)
Aug 26 19:09:20 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:20 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:20 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:20 user nova-compute[73917]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)
Aug 26 19:09:20 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:20 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:20 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.421s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG nova.network.neutron [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Successfully created port: 47597ca6-32f6-4311-b24d-2857c005fb86 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e043fd-0661-49db-9790-cb55a1a3e160]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcHTzUrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] No VIF found with MAC fa:16:3e:ce:ab:20, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.193s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1413eb87-7007-4d25-9197-33834e7f736c tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.232s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Cannot resize image /opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Ensure instance console log exists: /opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG nova.compute.manager [req-5835ca82-06a2-4c41-84d6-999d097ef99c req-5523ccf1-7d74-4063-9c4f-b56076dc9fa5 service nova] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Received event network-vif-plugged-a8f8f32c-cf87-43ae-b6db-43da89ab6888 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5835ca82-06a2-4c41-84d6-999d097ef99c req-5523ccf1-7d74-4063-9c4f-b56076dc9fa5 service nova] Acquiring lock "ce383b5a-c726-4d82-b0e3-be6ac6659428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5835ca82-06a2-4c41-84d6-999d097ef99c req-5523ccf1-7d74-4063-9c4f-b56076dc9fa5 service nova] Lock "ce383b5a-c726-4d82-b0e3-be6ac6659428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5835ca82-06a2-4c41-84d6-999d097ef99c req-5523ccf1-7d74-4063-9c4f-b56076dc9fa5 service nova] Lock "ce383b5a-c726-4d82-b0e3-be6ac6659428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:20 user nova-compute[73917]: DEBUG nova.compute.manager [req-5835ca82-06a2-4c41-84d6-999d097ef99c req-5523ccf1-7d74-4063-9c4f-b56076dc9fa5 service nova] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] No waiting events found dispatching network-vif-plugged-a8f8f32c-cf87-43ae-b6db-43da89ab6888 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:20 user nova-compute[73917]: WARNING nova.compute.manager [req-5835ca82-06a2-4c41-84d6-999d097ef99c req-5523ccf1-7d74-4063-9c4f-b56076dc9fa5 service nova] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Received unexpected event network-vif-plugged-a8f8f32c-cf87-43ae-b6db-43da89ab6888 for instance with vm_state active and task_state deleting.
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.network.neutron [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Successfully updated port: 47597ca6-32f6-4311-b24d-2857c005fb86 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "refresh_cache-2e449059-38d9-40bb-aa04-8b6c3865309b" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquired lock "refresh_cache-2e449059-38d9-40bb-aa04-8b6c3865309b" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.network.neutron [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.network.neutron [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:09:21 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Creating image(s)
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Did not create local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Ensure instance console log exists: /opt/stack/data/nova/instances/06bdc5b6-c1cb-4006-a48f-73e762fdb7ed/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Start _get_guest_xml network_info=[{"id": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "address": "fa:16:3e:90:51:54", "network": {"id": "ac76a379-a5c0-4a2e-af46-10ba88cc1bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1001642955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ff38f9-7c", "ovs_interfaceid": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "address": "fa:16:3e:04:13:20", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b34769-8c", "ovs_interfaceid": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "address": "fa:16:3e:d4:c6:e1", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0ca7bf-b7", "ovs_interfaceid": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "address": "fa:16:3e:ae:55:aa", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2e08fa-3f", "ovs_interfaceid": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "46f621b9-5715-4346-8832-94ec62dbaf26", "address": "fa:16:3e:84:7e:49", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f621b9-57", "ovs_interfaceid": "46f621b9-5715-4346-8832-94ec62dbaf26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "address": "fa:16:3e:58:d6:83", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a4a214-2e", "ovs_interfaceid": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "address": "fa:16:3e:6b:a4:c0", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc4ead3-a5", "ovs_interfaceid": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFWqzoui', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '06bdc5b6-c1cb-4006-a48f-73e762fdb7ed', 'attached_at': '', 'detached_at': '', 'volume_id': 'e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646', 'serial': 'e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'b055b2ec-3926-407d-b049-ddd0c1205c52', 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 1, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVpoXjlb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '06bdc5b6-c1cb-4006-a48f-73e762fdb7ed', 'attached_at': '', 'detached_at': '', 'volume_id': '85aa6bd1-1305-4063-99e0-70e1329a38cc', 'serial': '85aa6bd1-1305-4063-99e0-70e1329a38cc'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '88a5b7f2-768e-48be-bc76-3b1562c5d83f', 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 2, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zYiWXCrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '06bdc5b6-c1cb-4006-a48f-73e762fdb7ed', 'attached_at': '', 'detached_at': '', 'volume_id': '87f6874a-24b7-4e83-bd0d-01ea7bad1cdb', 'serial': '87f6874a-24b7-4e83-bd0d-01ea7bad1cdb'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'attachment_id': 'ecafb237-b3b0-4ec6-a038-4f1d4445276a', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:09:21 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:09:21 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFWqzoui', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:21 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.network.neutron [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Updating instance_info_cache with network_info: [{"id": "47597ca6-32f6-4311-b24d-2857c005fb86", "address": "fa:16:3e:e9:4e:c5", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47597ca6-32", "ovs_interfaceid": "47597ca6-32f6-4311-b24d-2857c005fb86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Releasing lock "refresh_cache-2e449059-38d9-40bb-aa04-8b6c3865309b" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Instance network_info: |[{"id": "47597ca6-32f6-4311-b24d-2857c005fb86", "address": "fa:16:3e:e9:4e:c5", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47597ca6-32", "ovs_interfaceid": "47597ca6-32f6-4311-b24d-2857c005fb86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Start _get_guest_xml network_info=[{"id": "47597ca6-32f6-4311-b24d-2857c005fb86", "address": "fa:16:3e:e9:4e:c5", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47597ca6-32", "ovs_interfaceid": "47597ca6-32f6-4311-b24d-2857c005fb86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:09:21 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:09:21 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.487s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] <== connect_volume: return (2845ms) {'type': 'block', 'scsi_wwn': '26236386232356131', 'path': '/dev/sdf'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236386232356131', 'path': '/dev/sdf'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.174s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:09:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-181003080',display_name='tempest-AttachVolumeNegativeTest-server-181003080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-181003080',id=14,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUsi9Pz8uXzuo584y/ESwFqG6J/kAl/D/5mwPFEr39hK4TZqXjrzvLpjbHgbaCKHGu1EM9FF5eZqtyVsxRtKG3BciTVJFk9GMWf6zcPzl7xmi/dCVatlzVQ2uBoAhcUPw==',key_name='tempest-keypair-1551013087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b291bbf9aedc4414a1ab402602849140',ramdisk_id='',reservation_id='r-ntm60pjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2066333616',owner_user_name='tempest-AttachVolumeNegativeTest-2066333616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c64a5d226b8b4d60af840d49315bf60f',uuid=2e449059-38d9-40bb-aa04-8b6c3865309b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47597ca6-32f6-4311-b24d-2857c005fb86", "address": "fa:16:3e:e9:4e:c5", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47597ca6-32", "ovs_interfaceid": "47597ca6-32f6-4311-b24d-2857c005fb86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converting VIF {"id": "47597ca6-32f6-4311-b24d-2857c005fb86", "address": "fa:16:3e:e9:4e:c5", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47597ca6-32", "ovs_interfaceid": "47597ca6-32f6-4311-b24d-2857c005fb86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:4e:c5,bridge_name='br-int',has_traffic_filtering=True,id=47597ca6-32f6-4311-b24d-2857c005fb86,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47597ca6-32') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.objects.instance [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e449059-38d9-40bb-aa04-8b6c3865309b {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d31c5bb-cc5b-4c2b-aac5-5ddda7b3b5b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:09:21 user nova-compute[73917]:   <uuid>2e449059-38d9-40bb-aa04-8b6c3865309b</uuid>
Aug 26 19:09:21 user nova-compute[73917]:   <name>instance-0000000e</name>
Aug 26 19:09:21 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:09:21 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:09:21 user nova-compute[73917]:   <metadata>
Aug 26 19:09:21 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:09:21 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:09:21 user nova-compute[73917]:       <nova:name>tempest-AttachVolumeNegativeTest-server-181003080</nova:name>
Aug 26 19:09:21 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:09:21</nova:creationTime>
Aug 26 19:09:21 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:09:21 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:09:21 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:09:21 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:09:21 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:09:21 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:09:21 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:09:21 user nova-compute[73917]:       <nova:owner>
Aug 26 19:09:21 user nova-compute[73917]:         <nova:user uuid="c64a5d226b8b4d60af840d49315bf60f">tempest-AttachVolumeNegativeTest-2066333616-project-member</nova:user>
Aug 26 19:09:21 user nova-compute[73917]:         <nova:project uuid="b291bbf9aedc4414a1ab402602849140">tempest-AttachVolumeNegativeTest-2066333616</nova:project>
Aug 26 19:09:21 user nova-compute[73917]:       </nova:owner>
Aug 26 19:09:21 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:09:21 user nova-compute[73917]:       <nova:ports>
Aug 26 19:09:21 user nova-compute[73917]:         <nova:port uuid="47597ca6-32f6-4311-b24d-2857c005fb86">
Aug 26 19:09:21 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 19:09:21 user nova-compute[73917]:         </nova:port>
Aug 26 19:09:21 user nova-compute[73917]:       </nova:ports>
Aug 26 19:09:21 user nova-compute[73917]:     </nova:instance>
Aug 26 19:09:21 user nova-compute[73917]:   </metadata>
Aug 26 19:09:21 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:09:21 user nova-compute[73917]:     <system>
Aug 26 19:09:21 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:09:21 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:09:21 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:09:21 user nova-compute[73917]:       <entry name="serial">2e449059-38d9-40bb-aa04-8b6c3865309b</entry>
Aug 26 19:09:21 user nova-compute[73917]:       <entry name="uuid">2e449059-38d9-40bb-aa04-8b6c3865309b</entry>
Aug 26 19:09:21 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:09:21 user nova-compute[73917]:     </system>
Aug 26 19:09:21 user nova-compute[73917]:   </sysinfo>
Aug 26 19:09:21 user nova-compute[73917]:   <os>
Aug 26 19:09:21 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:09:21 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:09:21 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:09:21 user nova-compute[73917]:   </os>
Aug 26 19:09:21 user nova-compute[73917]:   <features>
Aug 26 19:09:21 user nova-compute[73917]:     <acpi/>
Aug 26 19:09:21 user nova-compute[73917]:     <apic/>
Aug 26 19:09:21 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:09:21 user nova-compute[73917]:   </features>
Aug 26 19:09:21 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:09:21 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:09:21 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:09:21 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:09:21 user nova-compute[73917]:   </clock>
Aug 26 19:09:21 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:09:21 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:09:21 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:09:21 user nova-compute[73917]:   </cpu>
Aug 26 19:09:21 user nova-compute[73917]:   <devices>
Aug 26 19:09:21 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:09:21 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:09:21 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b/disk"/>
Aug 26 19:09:21 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:09:21 user nova-compute[73917]:     </disk>
Aug 26 19:09:21 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:09:21 user nova-compute[73917]:       <mac address="fa:16:3e:e9:4e:c5"/>
Aug 26 19:09:21 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:09:21 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:09:21 user nova-compute[73917]:       <target dev="tap47597ca6-32"/>
Aug 26 19:09:21 user nova-compute[73917]:     </interface>
Aug 26 19:09:21 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:09:21 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b/console.log" append="off"/>
Aug 26 19:09:21 user nova-compute[73917]:     </serial>
Aug 26 19:09:21 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:09:21 user nova-compute[73917]:     <video>
Aug 26 19:09:21 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:09:21 user nova-compute[73917]:     </video>
Aug 26 19:09:21 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:09:21 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:09:21 user nova-compute[73917]:     </rng>
Aug 26 19:09:21 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:09:21 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:09:21 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:09:21 user nova-compute[73917]:     </memballoon>
Aug 26 19:09:21 user nova-compute[73917]:   </devices>
Aug 26 19:09:21 user nova-compute[73917]: </domain>
Aug 26 19:09:21 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:09:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-181003080',display_name='tempest-AttachVolumeNegativeTest-server-181003080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-181003080',id=14,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUsi9Pz8uXzuo584y/ESwFqG6J/kAl/D/5mwPFEr39hK4TZqXjrzvLpjbHgbaCKHGu1EM9FF5eZqtyVsxRtKG3BciTVJFk9GMWf6zcPzl7xmi/dCVatlzVQ2uBoAhcUPw==',key_name='tempest-keypair-1551013087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b291bbf9aedc4414a1ab402602849140',ramdisk_id='',reservation_id='r-ntm60pjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2066333616',owner_user_name='tempest-AttachVolumeNegativeTest-2066333616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c64a5d226b8b4d60af840d49315bf60f',uuid=2e449059-38d9-40bb-aa04-8b6c3865309b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47597ca6-32f6-4311-b24d-2857c005fb86", "address": "fa:16:3e:e9:4e:c5", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47597ca6-32", "ovs_interfaceid": "47597ca6-32f6-4311-b24d-2857c005fb86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converting VIF {"id": "47597ca6-32f6-4311-b24d-2857c005fb86", "address": "fa:16:3e:e9:4e:c5", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47597ca6-32", "ovs_interfaceid": "47597ca6-32f6-4311-b24d-2857c005fb86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:4e:c5,bridge_name='br-int',has_traffic_filtering=True,id=47597ca6-32f6-4311-b24d-2857c005fb86,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47597ca6-32') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_vif [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:4e:c5,bridge_name='br-int',has_traffic_filtering=True,id=47597ca6-32f6-4311-b24d-2857c005fb86,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47597ca6-32') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btAlVdFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:21 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47597ca6-32, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap47597ca6-32, col_values=(('external_ids', {'iface-id': '47597ca6-32f6-4311-b24d-2857c005fb86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:4e:c5', 'vm-uuid': '2e449059-38d9-40bb-aa04-8b6c3865309b'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf17092-b318-43c7-8158-41fb064751f1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:21 user nova-compute[73917]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)
Aug 26 19:09:21 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:21 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:21 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:21 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:21 user nova-compute[73917]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 (non-flash)
Aug 26 19:09:21 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:21 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:21 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:21 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b983749d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6'): ({'sdc'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Removing single pathed devices sdc {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:21 user nova-compute[73917]: INFO os_vif [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:4e:c5,bridge_name='br-int',has_traffic_filtering=True,id=47597ca6-32f6-4311-b24d-2857c005fb86,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47597ca6-32')
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7eb09e-5a92-4273-b6a7-a60872699730]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-260b2cc2-5e2c-4d12-b381-be013a00774d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-260b2cc2-5e2c-4d12-b381-be013a00774d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-260b2cc2-5e2c-4d12-b381-be013a00774d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9092e0-6079-4967-b582-e9e7cb8a1543]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Flushing IO for device /dev/sdc {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-260b2cc2-5e2c-4d12-b381-be013a00774d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73917) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.objects.instance [None req-260b2cc2-5e2c-4d12-b381-be013a00774d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'flavor' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b299ad9-f849-4010-9354-11198cf3eb79]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] No VIF found with MAC fa:16:3e:e9:4e:c5, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.076s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67bcff5-8a21-4ed7-b981-9039fe786ad0]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bf37ec-d4d8-42ad-a48e-e8586b4b33c5]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cda204-c5a1-4253-ae19-5d7f5565aadb]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6, portal: 172.16.0.220,3260]
Aug 26 19:09:21 user nova-compute[73917]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6, portal: 172.16.0.220,3260] successful.
Aug 26 19:09:21 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2c8e85-497c-44d1-839e-d8aca05396d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6c8ed2-e99d-4d30-9220-f20e1b17fd82]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] <== disconnect_volume: return (2565ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:09:21 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Deleting instance files /opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428_del
Aug 26 19:09:21 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Deletion of /opt/stack/data/nova/instances/ce383b5a-c726-4d82-b0e3-be6ac6659428_del complete
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.467s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:21 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:21 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf0ec81-94c4-474b-8c61-dfe79b7ea5fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:09:21 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb55574-640e-461e-a3b4-acba33863c64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646] added
Aug 26 19:09:21 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcaaed1-de20-4c85-88a9-eb6cd280b09b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:21 user nova-compute[73917]: INFO nova.compute.manager [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Took 3.52 seconds to destroy the instance on the hypervisor.
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-d2118ade-81a8-4351-a08f-8fb4397c65bb req-f18329ba-261c-4d60-9d66-33388490e7dc service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received event network-vif-unplugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d2118ade-81a8-4351-a08f-8fb4397c65bb req-f18329ba-261c-4d60-9d66-33388490e7dc service nova] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d2118ade-81a8-4351-a08f-8fb4397c65bb req-f18329ba-261c-4d60-9d66-33388490e7dc service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d2118ade-81a8-4351-a08f-8fb4397c65bb req-f18329ba-261c-4d60-9d66-33388490e7dc service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-d2118ade-81a8-4351-a08f-8fb4397c65bb req-f18329ba-261c-4d60-9d66-33388490e7dc service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] No waiting events found dispatching network-vif-unplugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:21 user nova-compute[73917]: WARNING nova.compute.manager [req-d2118ade-81a8-4351-a08f-8fb4397c65bb req-f18329ba-261c-4d60-9d66-33388490e7dc service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received unexpected event network-vif-unplugged-37aa792a-c367-4dfd-b814-cb9c32ef373c for instance with vm_state active and task_state powering-off.
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9a4aea-3a3e-475b-a34c-576779a8344f]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AFWqzoui {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AFWqzoui" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a613f9e7-acd4-422c-9dc6-5b651529cdd6]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AFWqzoui'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71adc29-fa8b-43e1-8a27-34216cc983da]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f229834-9d2b-42b6-8322-20a4d1a1aa6f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:22 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:22 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:22 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:22 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:22 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:22 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:22 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:22 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3bd08b-3385-4aee-bf1a-bf8469284be5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646, portal: 172.16.0.220,3260]
Aug 26 19:09:22 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646, portal: 172.16.0.220,3260] successful.
Aug 26 19:09:22 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc5476b-d1c2-4526-aebe-fa1eb63190b6]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bf6ab8-f8e7-486f-8509-f768262ec218]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:22 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:22 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:22 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:22 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:22 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:22 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:22 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:22 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:22 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:22 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] HCTL ('34', '-', '-', 0) found on session 7 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a66461-c544-429b-a1b0-29cf63f99093]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Searching for a device in session 7 and hctl ['34', '*', '*', 0] yield: None {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:09:22 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Took 0.58 seconds to deallocate network for instance.
Aug 26 19:09:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-9606470e-236a-4974-a020-e640611f6c7d req-12658cb3-020d-4f8a-b2a4-9ba0973ed0d9 service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Received event network-changed-47597ca6-32f6-4311-b24d-2857c005fb86 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-9606470e-236a-4974-a020-e640611f6c7d req-12658cb3-020d-4f8a-b2a4-9ba0973ed0d9 service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Refreshing instance network info cache due to event network-changed-47597ca6-32f6-4311-b24d-2857c005fb86. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9606470e-236a-4974-a020-e640611f6c7d req-12658cb3-020d-4f8a-b2a4-9ba0973ed0d9 service nova] Acquiring lock "refresh_cache-2e449059-38d9-40bb-aa04-8b6c3865309b" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9606470e-236a-4974-a020-e640611f6c7d req-12658cb3-020d-4f8a-b2a4-9ba0973ed0d9 service nova] Acquired lock "refresh_cache-2e449059-38d9-40bb-aa04-8b6c3865309b" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:09:22 user nova-compute[73917]: DEBUG nova.network.neutron [req-9606470e-236a-4974-a020-e640611f6c7d req-12658cb3-020d-4f8a-b2a4-9ba0973ed0d9 service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Refreshing network info cache for port 47597ca6-32f6-4311-b24d-2857c005fb86 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:09:23 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Instance destroyed successfully.
Aug 26 19:09:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-260b2cc2-5e2c-4d12-b381-be013a00774d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-260b2cc2-5e2c-4d12-b381-be013a00774d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.533s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Searching for a device in session 7 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFWqzoui', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] <== connect_volume: return (1812ms) {'type': 'block', 'scsi_wwn': '26666343964353330', 'path': '/dev/sdc'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666343964353330', 'path': '/dev/sdc'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.676s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:23 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:23 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVpoXjlb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:23 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b485d0a-9e3b-46a2-b610-dc841c99e304]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:09:23 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6ddbcd-4132-4c8f-8398-a66ad9bcd45f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334] added
Aug 26 19:09:23 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[979fdc5f-8093-4f19-a5a7-4af6c0d4a84b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[41da4f81-3a3a-41a0-a694-40fc3127de6b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v btAlVdFy {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v btAlVdFy" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2190ac-bfa7-46dc-820a-925f3711ba13]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'btAlVdFy'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a39988a-9a5d-4b63-b68b-26c24e848dbe]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2f7e92-cc3d-4336-8f2b-ae8767014b76]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:23 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:23 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:23 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:23 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:23 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:23 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:23 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:23 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:23 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:23 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c6d661-9042-46e8-8374-0cf018772800]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334, portal: 172.16.0.220,3260]
Aug 26 19:09:23 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334, portal: 172.16.0.220,3260] successful.
Aug 26 19:09:23 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG nova.network.neutron [req-9606470e-236a-4974-a020-e640611f6c7d req-12658cb3-020d-4f8a-b2a4-9ba0973ed0d9 service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Updated VIF entry in instance network info cache for port 47597ca6-32f6-4311-b24d-2857c005fb86. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG nova.network.neutron [req-9606470e-236a-4974-a020-e640611f6c7d req-12658cb3-020d-4f8a-b2a4-9ba0973ed0d9 service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Updating instance_info_cache with network_info: [{"id": "47597ca6-32f6-4311-b24d-2857c005fb86", "address": "fa:16:3e:e9:4e:c5", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47597ca6-32", "ovs_interfaceid": "47597ca6-32f6-4311-b24d-2857c005fb86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:09:23 user nova-compute[73917]: INFO nova.compute.manager [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Took 0.99 seconds to detach 1 volumes for instance.
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[52958acb-195e-40d9-8bcd-a95bfe507294]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9606470e-236a-4974-a020-e640611f6c7d req-12658cb3-020d-4f8a-b2a4-9ba0973ed0d9 service nova] Releasing lock "refresh_cache-2e449059-38d9-40bb-aa04-8b6c3865309b" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-9606470e-236a-4974-a020-e640611f6c7d req-12658cb3-020d-4f8a-b2a4-9ba0973ed0d9 service nova] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Received event network-vif-deleted-a8f8f32c-cf87-43ae-b6db-43da89ab6888 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c82a1f5-0fe1-492c-b832-17f0692d0649]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:23 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:23 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:23 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:23 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:23 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:23 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:23 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:23 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:23 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:23 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:23 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:23 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaebf846-a747-484a-99fc-f461cd04dff1]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btAlVdFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-20829d4c-60da-49b9-9dea-15ec4a760b7e req-686af4cf-8c1e-45b9-86a9-8d1f30a041e8 service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Received event network-vif-plugged-47597ca6-32f6-4311-b24d-2857c005fb86 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-20829d4c-60da-49b9-9dea-15ec4a760b7e req-686af4cf-8c1e-45b9-86a9-8d1f30a041e8 service nova] Acquiring lock "2e449059-38d9-40bb-aa04-8b6c3865309b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-20829d4c-60da-49b9-9dea-15ec4a760b7e req-686af4cf-8c1e-45b9-86a9-8d1f30a041e8 service nova] Lock "2e449059-38d9-40bb-aa04-8b6c3865309b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-20829d4c-60da-49b9-9dea-15ec4a760b7e req-686af4cf-8c1e-45b9-86a9-8d1f30a041e8 service nova] Lock "2e449059-38d9-40bb-aa04-8b6c3865309b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-20829d4c-60da-49b9-9dea-15ec4a760b7e req-686af4cf-8c1e-45b9-86a9-8d1f30a041e8 service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] No waiting events found dispatching network-vif-plugged-47597ca6-32f6-4311-b24d-2857c005fb86 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:23 user nova-compute[73917]: WARNING nova.compute.manager [req-20829d4c-60da-49b9-9dea-15ec4a760b7e req-686af4cf-8c1e-45b9-86a9-8d1f30a041e8 service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Received unexpected event network-vif-plugged-47597ca6-32f6-4311-b24d-2857c005fb86 for instance with vm_state building and task_state spawning.
Aug 26 19:09:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] No waiting events found dispatching network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:24 user nova-compute[73917]: WARNING nova.compute.manager [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received unexpected event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c for instance with vm_state stopped and task_state None.
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] No waiting events found dispatching network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:24 user nova-compute[73917]: WARNING nova.compute.manager [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received unexpected event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c for instance with vm_state stopped and task_state None.
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] No waiting events found dispatching network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:24 user nova-compute[73917]: WARNING nova.compute.manager [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received unexpected event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c for instance with vm_state stopped and task_state None.
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received event network-vif-unplugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] No waiting events found dispatching network-vif-unplugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:24 user nova-compute[73917]: WARNING nova.compute.manager [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received unexpected event network-vif-unplugged-37aa792a-c367-4dfd-b814-cb9c32ef373c for instance with vm_state stopped and task_state None.
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] No waiting events found dispatching network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:24 user nova-compute[73917]: WARNING nova.compute.manager [req-5e7d6977-ab0c-4e39-9e16-903ca05a79ea req-650e3dbf-fc6d-45f3-bab8-306cc136c124 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received unexpected event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c for instance with vm_state stopped and task_state None.
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:24 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Deleted allocations for instance ce383b5a-c726-4d82-b0e3-be6ac6659428
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35459697-86c0-4e50-8b29-4d8ca372d122 tempest-DeleteServersTestJSON-1349277273 tempest-DeleteServersTestJSON-1349277273-project-member] Lock "ce383b5a-c726-4d82-b0e3-be6ac6659428" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.812s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] <== connect_volume: return (3071ms) {'type': 'block', 'scsi_wwn': '23437623138366230', 'path': '/dev/sdg'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437623138366230', 'path': '/dev/sdg'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.363s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:24 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:24 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c10b7f7-0e42-4cd7-b054-7382d32d1a87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:09:24 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9268e463-2367-4d84-be0e-f432a917b945", "address": "fa:16:3e:3c:5e:e6", "network": {"id": "b5165b66-cdc8-4b7f-ab73-feae1a655345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716155983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9268e463-23", "ovs_interfaceid": "9268e463-2367-4d84-be0e-f432a917b945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "9268e463-2367-4d84-be0e-f432a917b945", "address": "fa:16:3e:3c:5e:e6", "network": {"id": "b5165b66-cdc8-4b7f-ab73-feae1a655345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716155983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9268e463-23", "ovs_interfaceid": "9268e463-2367-4d84-be0e-f432a917b945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:5e:e6,bridge_name='br-int',has_traffic_filtering=True,id=9268e463-2367-4d84-be0e-f432a917b945,network=Network(b5165b66-cdc8-4b7f-ab73-feae1a655345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9268e463-23') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "address": "fa:16:3e:d7:d4:c6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc09729-80", "ovs_interfaceid": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "address": "fa:16:3e:d7:d4:c6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc09729-80", "ovs_interfaceid": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d4:c6,bridge_name='br-int',has_traffic_filtering=True,id=dfc09729-80ce-463f-8ad4-4f16f8b304f2,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdfc09729-80') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22c864bd-81de-436b-9745-de2cf3cfffd5", "address": "fa:16:3e:2b:23:f6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c864bd-81", "ovs_interfaceid": "22c864bd-81de-436b-9745-de2cf3cfffd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "22c864bd-81de-436b-9745-de2cf3cfffd5", "address": "fa:16:3e:2b:23:f6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c864bd-81", "ovs_interfaceid": "22c864bd-81de-436b-9745-de2cf3cfffd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=22c864bd-81de-436b-9745-de2cf3cfffd5,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22c864bd-81') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "address": "fa:16:3e:ea:a2:cb", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1aa81-34", "ovs_interfaceid": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "address": "fa:16:3e:ea:a2:cb", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1aa81-34", "ovs_interfaceid": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a2:cb,bridge_name='br-int',has_traffic_filtering=True,id=eec1aa81-34b7-44ea-aa98-57b54a967dcc,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1aa81-34') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "address": "fa:16:3e:f6:f5:7c", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4bbc97-cf", "ovs_interfaceid": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "address": "fa:16:3e:f6:f5:7c", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4bbc97-cf", "ovs_interfaceid": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f5:7c,bridge_name='br-int',has_traffic_filtering=True,id=2d4bbc97-cf69-4155-8f62-0de77084cbdd,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d4bbc97-cf') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19a44d0d-f673-49e9-8c62-014aff19769c", "address": "fa:16:3e:08:64:60", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a44d0d-f6", "ovs_interfaceid": "19a44d0d-f673-49e9-8c62-014aff19769c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "19a44d0d-f673-49e9-8c62-014aff19769c", "address": "fa:16:3e:08:64:60", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a44d0d-f6", "ovs_interfaceid": "19a44d0d-f673-49e9-8c62-014aff19769c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:64:60,bridge_name='br-int',has_traffic_filtering=True,id=19a44d0d-f673-49e9-8c62-014aff19769c,network=Network(df3ccd13-2ec7-4c92-94e4-82d953121d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a44d0d-f6') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "472badf6-8de1-4c67-8bfa-7105f672eff0", "address": "fa:16:3e:c9:52:16", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472badf6-8d", "ovs_interfaceid": "472badf6-8de1-4c67-8bfa-7105f672eff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "472badf6-8de1-4c67-8bfa-7105f672eff0", "address": "fa:16:3e:c9:52:16", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472badf6-8d", "ovs_interfaceid": "472badf6-8de1-4c67-8bfa-7105f672eff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:52:16,bridge_name='br-int',has_traffic_filtering=True,id=472badf6-8de1-4c67-8bfa-7105f672eff0,network=Network(df3ccd13-2ec7-4c92-94e4-82d953121d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472badf6-8d') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.objects.instance [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lazy-loading 'pci_devices' on Instance uuid 54fd570d-421c-4a39-b4ae-772500b24cec {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c0003f-eb32-4ad0-a198-755b29ff65e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc] added
Aug 26 19:09:24 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:09:24 user nova-compute[73917]:   <uuid>54fd570d-421c-4a39-b4ae-772500b24cec</uuid>
Aug 26 19:09:24 user nova-compute[73917]:   <name>instance-0000000c</name>
Aug 26 19:09:24 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:09:24 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:09:24 user nova-compute[73917]:   <metadata>
Aug 26 19:09:24 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:09:24 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:09:24 user nova-compute[73917]:       <nova:name>tempest-device-tagging-server-322773328</nova:name>
Aug 26 19:09:24 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:09:16</nova:creationTime>
Aug 26 19:09:24 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:09:24 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:09:24 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:09:24 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:09:24 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:09:24 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:09:24 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:09:24 user nova-compute[73917]:       <nova:owner>
Aug 26 19:09:24 user nova-compute[73917]:         <nova:user uuid="9ff0ceab2aad4ddcbc5f76ee6a0858bf">tempest-TaggedBootDevicesTest-403565623-project-member</nova:user>
Aug 26 19:09:24 user nova-compute[73917]:         <nova:project uuid="a01f4bc78d87474a8a3027d928dc77e5">tempest-TaggedBootDevicesTest-403565623</nova:project>
Aug 26 19:09:24 user nova-compute[73917]:       </nova:owner>
Aug 26 19:09:24 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:09:24 user nova-compute[73917]:       <nova:ports>
Aug 26 19:09:24 user nova-compute[73917]:         <nova:port uuid="9268e463-2367-4d84-be0e-f432a917b945">
Aug 26 19:09:24 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 19:09:24 user nova-compute[73917]:         </nova:port>
Aug 26 19:09:24 user nova-compute[73917]:         <nova:port uuid="dfc09729-80ce-463f-8ad4-4f16f8b304f2">
Aug 26 19:09:24 user nova-compute[73917]:           <nova:ip type="fixed" address="10.1.1.214" ipVersion="4"/>
Aug 26 19:09:24 user nova-compute[73917]:         </nova:port>
Aug 26 19:09:24 user nova-compute[73917]:         <nova:port uuid="22c864bd-81de-436b-9745-de2cf3cfffd5">
Aug 26 19:09:24 user nova-compute[73917]:           <nova:ip type="fixed" address="10.1.1.128" ipVersion="4"/>
Aug 26 19:09:24 user nova-compute[73917]:         </nova:port>
Aug 26 19:09:24 user nova-compute[73917]:         <nova:port uuid="eec1aa81-34b7-44ea-aa98-57b54a967dcc">
Aug 26 19:09:24 user nova-compute[73917]:           <nova:ip type="fixed" address="10.1.1.244" ipVersion="4"/>
Aug 26 19:09:24 user nova-compute[73917]:         </nova:port>
Aug 26 19:09:24 user nova-compute[73917]:         <nova:port uuid="2d4bbc97-cf69-4155-8f62-0de77084cbdd">
Aug 26 19:09:24 user nova-compute[73917]:           <nova:ip type="fixed" address="10.1.1.212" ipVersion="4"/>
Aug 26 19:09:24 user nova-compute[73917]:         </nova:port>
Aug 26 19:09:24 user nova-compute[73917]:         <nova:port uuid="19a44d0d-f673-49e9-8c62-014aff19769c">
Aug 26 19:09:24 user nova-compute[73917]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 19:09:24 user nova-compute[73917]:         </nova:port>
Aug 26 19:09:24 user nova-compute[73917]:         <nova:port uuid="472badf6-8de1-4c67-8bfa-7105f672eff0">
Aug 26 19:09:24 user nova-compute[73917]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 19:09:24 user nova-compute[73917]:         </nova:port>
Aug 26 19:09:24 user nova-compute[73917]:       </nova:ports>
Aug 26 19:09:24 user nova-compute[73917]:     </nova:instance>
Aug 26 19:09:24 user nova-compute[73917]:   </metadata>
Aug 26 19:09:24 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:09:24 user nova-compute[73917]:     <system>
Aug 26 19:09:24 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:09:24 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:09:24 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:09:24 user nova-compute[73917]:       <entry name="serial">54fd570d-421c-4a39-b4ae-772500b24cec</entry>
Aug 26 19:09:24 user nova-compute[73917]:       <entry name="uuid">54fd570d-421c-4a39-b4ae-772500b24cec</entry>
Aug 26 19:09:24 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:09:24 user nova-compute[73917]:     </system>
Aug 26 19:09:24 user nova-compute[73917]:   </sysinfo>
Aug 26 19:09:24 user nova-compute[73917]:   <os>
Aug 26 19:09:24 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:09:24 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:09:24 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:09:24 user nova-compute[73917]:   </os>
Aug 26 19:09:24 user nova-compute[73917]:   <features>
Aug 26 19:09:24 user nova-compute[73917]:     <acpi/>
Aug 26 19:09:24 user nova-compute[73917]:     <apic/>
Aug 26 19:09:24 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:09:24 user nova-compute[73917]:   </features>
Aug 26 19:09:24 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:09:24 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:09:24 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:09:24 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:09:24 user nova-compute[73917]:   </clock>
Aug 26 19:09:24 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:09:24 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:09:24 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:09:24 user nova-compute[73917]:   </cpu>
Aug 26 19:09:24 user nova-compute[73917]:   <devices>
Aug 26 19:09:24 user nova-compute[73917]:     <disk type="file" device="cdrom">
Aug 26 19:09:24 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 19:09:24 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/54fd570d-421c-4a39-b4ae-772500b24cec/disk.config"/>
Aug 26 19:09:24 user nova-compute[73917]:       <target dev="hda" bus="ide"/>
Aug 26 19:09:24 user nova-compute[73917]:     </disk>
Aug 26 19:09:24 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:09:24 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:09:24 user nova-compute[73917]:       <source dev="/dev/sdd"/>
Aug 26 19:09:24 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:09:24 user nova-compute[73917]:       <serial>6f794151-249c-4191-990d-cee0e30d3a5a</serial>
Aug 26 19:09:24 user nova-compute[73917]:     </disk>
Aug 26 19:09:24 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:09:24 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:09:24 user nova-compute[73917]:       <source dev="/dev/sdf"/>
Aug 26 19:09:24 user nova-compute[73917]:       <target dev="vdb" bus="virtio"/>
Aug 26 19:09:24 user nova-compute[73917]:       <serial>e6f1ea72-e543-43ea-bdeb-47608eefd15c</serial>
Aug 26 19:09:24 user nova-compute[73917]:     </disk>
Aug 26 19:09:24 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:09:24 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:09:24 user nova-compute[73917]:       <source dev="/dev/sdg"/>
Aug 26 19:09:24 user nova-compute[73917]:       <target dev="vdc" bus="virtio"/>
Aug 26 19:09:24 user nova-compute[73917]:       <serial>5b486c20-77b8-42e7-aa76-224979a67334</serial>
Aug 26 19:09:24 user nova-compute[73917]:     </disk>
Aug 26 19:09:24 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:09:24 user nova-compute[73917]:       <mac address="fa:16:3e:3c:5e:e6"/>
Aug 26 19:09:24 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:09:24 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:09:24 user nova-compute[73917]:       <target dev="tap9268e463-23"/>
Aug 26 19:09:24 user nova-compute[73917]:     </interface>
Aug 26 19:09:24 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:09:24 user nova-compute[73917]:       <mac address="fa:16:3e:d7:d4:c6"/>
Aug 26 19:09:24 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:09:24 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:09:24 user nova-compute[73917]:       <target dev="tapdfc09729-80"/>
Aug 26 19:09:24 user nova-compute[73917]:     </interface>
Aug 26 19:09:24 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:09:24 user nova-compute[73917]:       <mac address="fa:16:3e:2b:23:f6"/>
Aug 26 19:09:24 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:09:24 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:09:24 user nova-compute[73917]:       <target dev="tap22c864bd-81"/>
Aug 26 19:09:24 user nova-compute[73917]:     </interface>
Aug 26 19:09:24 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:09:24 user nova-compute[73917]:       <mac address="fa:16:3e:ea:a2:cb"/>
Aug 26 19:09:24 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:09:24 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:09:24 user nova-compute[73917]:       <target dev="tapeec1aa81-34"/>
Aug 26 19:09:24 user nova-compute[73917]:     </interface>
Aug 26 19:09:24 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:09:24 user nova-compute[73917]:       <mac address="fa:16:3e:f6:f5:7c"/>
Aug 26 19:09:24 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:09:24 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:09:24 user nova-compute[73917]:       <target dev="tap2d4bbc97-cf"/>
Aug 26 19:09:24 user nova-compute[73917]:     </interface>
Aug 26 19:09:24 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:09:24 user nova-compute[73917]:       <mac address="fa:16:3e:08:64:60"/>
Aug 26 19:09:24 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:09:24 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:09:24 user nova-compute[73917]:       <target dev="tap19a44d0d-f6"/>
Aug 26 19:09:24 user nova-compute[73917]:     </interface>
Aug 26 19:09:24 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:09:24 user nova-compute[73917]:       <mac address="fa:16:3e:c9:52:16"/>
Aug 26 19:09:24 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:09:24 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:09:24 user nova-compute[73917]:       <target dev="tap472badf6-8d"/>
Aug 26 19:09:24 user nova-compute[73917]:     </interface>
Aug 26 19:09:24 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:09:24 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/54fd570d-421c-4a39-b4ae-772500b24cec/console.log" append="off"/>
Aug 26 19:09:24 user nova-compute[73917]:     </serial>
Aug 26 19:09:24 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:09:24 user nova-compute[73917]:     <video>
Aug 26 19:09:24 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:09:24 user nova-compute[73917]:     </video>
Aug 26 19:09:24 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:09:24 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:09:24 user nova-compute[73917]:     </rng>
Aug 26 19:09:24 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:09:24 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:09:24 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:09:24 user nova-compute[73917]:     </memballoon>
Aug 26 19:09:24 user nova-compute[73917]:   </devices>
Aug 26 19:09:24 user nova-compute[73917]: </domain>
Aug 26 19:09:24 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9268e463-2367-4d84-be0e-f432a917b945", "address": "fa:16:3e:3c:5e:e6", "network": {"id": "b5165b66-cdc8-4b7f-ab73-feae1a655345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716155983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9268e463-23", "ovs_interfaceid": "9268e463-2367-4d84-be0e-f432a917b945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "9268e463-2367-4d84-be0e-f432a917b945", "address": "fa:16:3e:3c:5e:e6", "network": {"id": "b5165b66-cdc8-4b7f-ab73-feae1a655345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716155983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9268e463-23", "ovs_interfaceid": "9268e463-2367-4d84-be0e-f432a917b945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:5e:e6,bridge_name='br-int',has_traffic_filtering=True,id=9268e463-2367-4d84-be0e-f432a917b945,network=Network(b5165b66-cdc8-4b7f-ab73-feae1a655345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9268e463-23') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:5e:e6,bridge_name='br-int',has_traffic_filtering=True,id=9268e463-2367-4d84-be0e-f432a917b945,network=Network(b5165b66-cdc8-4b7f-ab73-feae1a655345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9268e463-23') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2470763-320d-404d-b46d-b1de6f28411f]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9268e463-23, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9268e463-23, col_values=(('external_ids', {'iface-id': '9268e463-2367-4d84-be0e-f432a917b945', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:5e:e6', 'vm-uuid': '54fd570d-421c-4a39-b4ae-772500b24cec'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7b61d1-374d-49f1-b567-e03635b901a6]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hVpoXjlb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: INFO os_vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:5e:e6,bridge_name='br-int',has_traffic_filtering=True,id=9268e463-2367-4d84-be0e-f432a917b945,network=Network(b5165b66-cdc8-4b7f-ab73-feae1a655345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9268e463-23')
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "address": "fa:16:3e:d7:d4:c6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc09729-80", "ovs_interfaceid": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "address": "fa:16:3e:d7:d4:c6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc09729-80", "ovs_interfaceid": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d4:c6,bridge_name='br-int',has_traffic_filtering=True,id=dfc09729-80ce-463f-8ad4-4f16f8b304f2,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdfc09729-80') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d4:c6,bridge_name='br-int',has_traffic_filtering=True,id=dfc09729-80ce-463f-8ad4-4f16f8b304f2,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdfc09729-80') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfc09729-80, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdfc09729-80, col_values=(('external_ids', {'iface-id': 'dfc09729-80ce-463f-8ad4-4f16f8b304f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:d4:c6', 'vm-uuid': '54fd570d-421c-4a39-b4ae-772500b24cec'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hVpoXjlb" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa48c0d-4631-4fa8-a67a-2a50e57b97a1]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hVpoXjlb'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc51837-758a-4e2b-9d3e-1cd16e4ce7aa]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: INFO os_vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d4:c6,bridge_name='br-int',has_traffic_filtering=True,id=dfc09729-80ce-463f-8ad4-4f16f8b304f2,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdfc09729-80')
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22c864bd-81de-436b-9745-de2cf3cfffd5", "address": "fa:16:3e:2b:23:f6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c864bd-81", "ovs_interfaceid": "22c864bd-81de-436b-9745-de2cf3cfffd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "22c864bd-81de-436b-9745-de2cf3cfffd5", "address": "fa:16:3e:2b:23:f6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c864bd-81", "ovs_interfaceid": "22c864bd-81de-436b-9745-de2cf3cfffd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=22c864bd-81de-436b-9745-de2cf3cfffd5,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22c864bd-81') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=22c864bd-81de-436b-9745-de2cf3cfffd5,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22c864bd-81') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22c864bd-81, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22c864bd-81, col_values=(('external_ids', {'iface-id': '22c864bd-81de-436b-9745-de2cf3cfffd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:23:f6', 'vm-uuid': '54fd570d-421c-4a39-b4ae-772500b24cec'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d64aa1c-1893-437a-9e5e-7def1bae84b4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:24 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:24 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: INFO os_vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=22c864bd-81de-436b-9745-de2cf3cfffd5,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22c864bd-81')
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "address": "fa:16:3e:ea:a2:cb", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1aa81-34", "ovs_interfaceid": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "address": "fa:16:3e:ea:a2:cb", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1aa81-34", "ovs_interfaceid": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a2:cb,bridge_name='br-int',has_traffic_filtering=True,id=eec1aa81-34b7-44ea-aa98-57b54a967dcc,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1aa81-34') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a2:cb,bridge_name='br-int',has_traffic_filtering=True,id=eec1aa81-34b7-44ea-aa98-57b54a967dcc,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1aa81-34') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeec1aa81-34, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeec1aa81-34, col_values=(('external_ids', {'iface-id': 'eec1aa81-34b7-44ea-aa98-57b54a967dcc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:a2:cb', 'vm-uuid': '54fd570d-421c-4a39-b4ae-772500b24cec'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: INFO os_vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a2:cb,bridge_name='br-int',has_traffic_filtering=True,id=eec1aa81-34b7-44ea-aa98-57b54a967dcc,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1aa81-34')
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "address": "fa:16:3e:f6:f5:7c", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4bbc97-cf", "ovs_interfaceid": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "address": "fa:16:3e:f6:f5:7c", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4bbc97-cf", "ovs_interfaceid": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f5:7c,bridge_name='br-int',has_traffic_filtering=True,id=2d4bbc97-cf69-4155-8f62-0de77084cbdd,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d4bbc97-cf') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f5:7c,bridge_name='br-int',has_traffic_filtering=True,id=2d4bbc97-cf69-4155-8f62-0de77084cbdd,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d4bbc97-cf') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c1965b-47a2-4028-8a5f-1b919ab8ae46]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc, portal: 172.16.0.220,3260]
Aug 26 19:09:24 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc, portal: 172.16.0.220,3260] successful.
Aug 26 19:09:24 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d4bbc97-cf, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2d4bbc97-cf, col_values=(('external_ids', {'iface-id': '2d4bbc97-cf69-4155-8f62-0de77084cbdd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:f5:7c', 'vm-uuid': '54fd570d-421c-4a39-b4ae-772500b24cec'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c746dd09-1ebb-4927-a8e2-1ca6bd0af703]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[929910d1-54c8-496a-a9f1-0401b3b2d670]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:09:24 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:24 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:09:24 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: INFO os_vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f5:7c,bridge_name='br-int',has_traffic_filtering=True,id=2d4bbc97-cf69-4155-8f62-0de77084cbdd,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d4bbc97-cf')
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19a44d0d-f673-49e9-8c62-014aff19769c", "address": "fa:16:3e:08:64:60", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a44d0d-f6", "ovs_interfaceid": "19a44d0d-f673-49e9-8c62-014aff19769c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "19a44d0d-f673-49e9-8c62-014aff19769c", "address": "fa:16:3e:08:64:60", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a44d0d-f6", "ovs_interfaceid": "19a44d0d-f673-49e9-8c62-014aff19769c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:64:60,bridge_name='br-int',has_traffic_filtering=True,id=19a44d0d-f673-49e9-8c62-014aff19769c,network=Network(df3ccd13-2ec7-4c92-94e4-82d953121d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a44d0d-f6') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:64:60,bridge_name='br-int',has_traffic_filtering=True,id=19a44d0d-f673-49e9-8c62-014aff19769c,network=Network(df3ccd13-2ec7-4c92-94e4-82d953121d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a44d0d-f6') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19a44d0d-f6, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap19a44d0d-f6, col_values=(('external_ids', {'iface-id': '19a44d0d-f673-49e9-8c62-014aff19769c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:64:60', 'vm-uuid': '54fd570d-421c-4a39-b4ae-772500b24cec'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfb2475-151d-42ac-ab7e-5830ffc2c728]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: None {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:09:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:25 user nova-compute[73917]: INFO os_vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:64:60,bridge_name='br-int',has_traffic_filtering=True,id=19a44d0d-f673-49e9-8c62-014aff19769c,network=Network(df3ccd13-2ec7-4c92-94e4-82d953121d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a44d0d-f6')
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "472badf6-8de1-4c67-8bfa-7105f672eff0", "address": "fa:16:3e:c9:52:16", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472badf6-8d", "ovs_interfaceid": "472badf6-8de1-4c67-8bfa-7105f672eff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "472badf6-8de1-4c67-8bfa-7105f672eff0", "address": "fa:16:3e:c9:52:16", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472badf6-8d", "ovs_interfaceid": "472badf6-8de1-4c67-8bfa-7105f672eff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:52:16,bridge_name='br-int',has_traffic_filtering=True,id=472badf6-8de1-4c67-8bfa-7105f672eff0,network=Network(df3ccd13-2ec7-4c92-94e4-82d953121d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472badf6-8d') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG os_vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:52:16,bridge_name='br-int',has_traffic_filtering=True,id=472badf6-8de1-4c67-8bfa-7105f672eff0,network=Network(df3ccd13-2ec7-4c92-94e4-82d953121d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472badf6-8d') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap472badf6-8d, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap472badf6-8d, col_values=(('external_ids', {'iface-id': '472badf6-8de1-4c67-8bfa-7105f672eff0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:52:16', 'vm-uuid': '54fd570d-421c-4a39-b4ae-772500b24cec'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:25 user nova-compute[73917]: INFO os_vif [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:52:16,bridge_name='br-int',has_traffic_filtering=True,id=472badf6-8de1-4c67-8bfa-7105f672eff0,network=Network(df3ccd13-2ec7-4c92-94e4-82d953121d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472badf6-8d')
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] No BDM found with device name hda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] No VIF found with MAC fa:16:3e:3c:5e:e6, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] No VIF found with MAC fa:16:3e:f6:f5:7c, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:09:25 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Using config drive
Aug 26 19:09:25 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Creating config drive at /opt/stack/data/nova/instances/54fd570d-421c-4a39-b4ae-772500b24cec/disk.config
Aug 26 19:09:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/54fd570d-421c-4a39-b4ae-772500b24cec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqm67o9qv {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/54fd570d-421c-4a39-b4ae-772500b24cec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqm67o9qv" returned: 0 in 0.049s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076965.596594, 2e449059-38d9-40bb-aa04-8b6c3865309b => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:09:25 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] VM Resumed (Lifecycle Event)
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:09:25 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Instance spawned successfully.
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:09:25 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076965.597077, 2e449059-38d9-40bb-aa04-8b6c3865309b => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:09:25 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] VM Started (Lifecycle Event)
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:09:25 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:09:25 user nova-compute[73917]: INFO nova.compute.manager [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Took 5.88 seconds to spawn the instance on the hypervisor.
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-9f9a6b1f-5d4f-4080-9a8d-3bad7e7329c3 req-fb2b8953-853d-4a36-8ed8-9737c2bb4830 service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Received event network-vif-plugged-47597ca6-32f6-4311-b24d-2857c005fb86 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9f9a6b1f-5d4f-4080-9a8d-3bad7e7329c3 req-fb2b8953-853d-4a36-8ed8-9737c2bb4830 service nova] Acquiring lock "2e449059-38d9-40bb-aa04-8b6c3865309b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9f9a6b1f-5d4f-4080-9a8d-3bad7e7329c3 req-fb2b8953-853d-4a36-8ed8-9737c2bb4830 service nova] Lock "2e449059-38d9-40bb-aa04-8b6c3865309b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9f9a6b1f-5d4f-4080-9a8d-3bad7e7329c3 req-fb2b8953-853d-4a36-8ed8-9737c2bb4830 service nova] Lock "2e449059-38d9-40bb-aa04-8b6c3865309b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-9f9a6b1f-5d4f-4080-9a8d-3bad7e7329c3 req-fb2b8953-853d-4a36-8ed8-9737c2bb4830 service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] No waiting events found dispatching network-vif-plugged-47597ca6-32f6-4311-b24d-2857c005fb86 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:25 user nova-compute[73917]: WARNING nova.compute.manager [req-9f9a6b1f-5d4f-4080-9a8d-3bad7e7329c3 req-fb2b8953-853d-4a36-8ed8-9737c2bb4830 service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Received unexpected event network-vif-plugged-47597ca6-32f6-4311-b24d-2857c005fb86 for instance with vm_state building and task_state spawning.
Aug 26 19:09:25 user nova-compute[73917]: INFO nova.compute.manager [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Took 6.79 seconds to build instance.
Aug 26 19:09:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e35be12f-0c71-4f8e-aa0f-bd7d4951da8a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "2e449059-38d9-40bb-aa04-8b6c3865309b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.882s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVpoXjlb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] <== connect_volume: return (2722ms) {'type': 'block', 'scsi_wwn': '23430393736356332', 'path': '/dev/sdh'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430393736356332', 'path': '/dev/sdh'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zYiWXCrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:25 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:25 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:25 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bac03e-b960-46a1-a68d-0a77396468f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:09:26 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba99c326-828b-44cd-9cac-d963ab4d63b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb] added
Aug 26 19:09:26 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec0baec-ef82-4587-881c-2ba8772e6dc9]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1785f8-34d9-4053-a375-2d5f3c47b5bb]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zYiWXCrk {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zYiWXCrk" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2febcbc-df51-4d84-899b-91f5dee518cb]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zYiWXCrk'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff81b08-95e4-4f8b-bde4-d205e54a9521]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e6071c-eaec-45cf-9597-38216e1fd32a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:09:26 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:09:26 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0b84c1-8582-4d7f-9177-ea8e4175f0d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb, portal: 172.16.0.220,3260]
Aug 26 19:09:26 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb, portal: 172.16.0.220,3260] successful.
Aug 26 19:09:26 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b042e76-2852-45f3-947e-9f7cd0320736]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b502d6-cf61-4b71-8453-88542941f736]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:09:26 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:26 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:09:26 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a45ce18-f24e-4a8b-a62a-0635612e074b]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zYiWXCrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-472ed666-519a-4c59-a90b-0950c841e666 req-5727a7b1-3e93-43c8-bd76-6bb5ffb9f11e service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-9268e463-2367-4d84-be0e-f432a917b945 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-472ed666-519a-4c59-a90b-0950c841e666 req-5727a7b1-3e93-43c8-bd76-6bb5ffb9f11e service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-472ed666-519a-4c59-a90b-0950c841e666 req-5727a7b1-3e93-43c8-bd76-6bb5ffb9f11e service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-472ed666-519a-4c59-a90b-0950c841e666 req-5727a7b1-3e93-43c8-bd76-6bb5ffb9f11e service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-472ed666-519a-4c59-a90b-0950c841e666 req-5727a7b1-3e93-43c8-bd76-6bb5ffb9f11e service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-9268e463-2367-4d84-be0e-f432a917b945 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:27 user nova-compute[73917]: WARNING nova.compute.manager [req-472ed666-519a-4c59-a90b-0950c841e666 req-5727a7b1-3e93-43c8-bd76-6bb5ffb9f11e service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-9268e463-2367-4d84-be0e-f432a917b945 for instance with vm_state building and task_state spawning.
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-754fe7ee-c8c2-4942-906d-8a01243bff07 req-da2954f5-3980-49de-b766-d1a21f5b63b6 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-dfc09729-80ce-463f-8ad4-4f16f8b304f2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-754fe7ee-c8c2-4942-906d-8a01243bff07 req-da2954f5-3980-49de-b766-d1a21f5b63b6 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-754fe7ee-c8c2-4942-906d-8a01243bff07 req-da2954f5-3980-49de-b766-d1a21f5b63b6 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-754fe7ee-c8c2-4942-906d-8a01243bff07 req-da2954f5-3980-49de-b766-d1a21f5b63b6 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-754fe7ee-c8c2-4942-906d-8a01243bff07 req-da2954f5-3980-49de-b766-d1a21f5b63b6 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-dfc09729-80ce-463f-8ad4-4f16f8b304f2 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:27 user nova-compute[73917]: WARNING nova.compute.manager [req-754fe7ee-c8c2-4942-906d-8a01243bff07 req-da2954f5-3980-49de-b766-d1a21f5b63b6 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-dfc09729-80ce-463f-8ad4-4f16f8b304f2 for instance with vm_state building and task_state spawning.
Aug 26 19:09:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26531346130363262', 'path': '/dev/sdi'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531346130363262', 'path': '/dev/sdi'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "address": "fa:16:3e:90:51:54", "network": {"id": "ac76a379-a5c0-4a2e-af46-10ba88cc1bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1001642955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ff38f9-7c", "ovs_interfaceid": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "address": "fa:16:3e:90:51:54", "network": {"id": "ac76a379-a5c0-4a2e-af46-10ba88cc1bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1001642955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ff38f9-7c", "ovs_interfaceid": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:51:54,bridge_name='br-int',has_traffic_filtering=True,id=41ff38f9-7c92-4705-acd5-26e82e7d472d,network=Network(ac76a379-a5c0-4a2e-af46-10ba88cc1bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41ff38f9-7c') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "address": "fa:16:3e:04:13:20", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b34769-8c", "ovs_interfaceid": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "address": "fa:16:3e:04:13:20", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b34769-8c", "ovs_interfaceid": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:13:20,bridge_name='br-int',has_traffic_filtering=True,id=13b34769-8c09-4cc2-a083-6fa9aef81a5e,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13b34769-8c') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "address": "fa:16:3e:d4:c6:e1", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0ca7bf-b7", "ovs_interfaceid": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "address": "fa:16:3e:d4:c6:e1", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0ca7bf-b7", "ovs_interfaceid": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c6:e1,bridge_name='br-int',has_traffic_filtering=True,id=8b0ca7bf-b702-4c8a-9ba8-15d3d9725437,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b0ca7bf-b7') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "address": "fa:16:3e:ae:55:aa", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2e08fa-3f", "ovs_interfaceid": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "address": "fa:16:3e:ae:55:aa", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2e08fa-3f", "ovs_interfaceid": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:55:aa,bridge_name='br-int',has_traffic_filtering=True,id=6d2e08fa-3f5c-4648-8702-e52284894e6c,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2e08fa-3f') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46f621b9-5715-4346-8832-94ec62dbaf26", "address": "fa:16:3e:84:7e:49", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f621b9-57", "ovs_interfaceid": "46f621b9-5715-4346-8832-94ec62dbaf26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "46f621b9-5715-4346-8832-94ec62dbaf26", "address": "fa:16:3e:84:7e:49", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f621b9-57", "ovs_interfaceid": "46f621b9-5715-4346-8832-94ec62dbaf26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:7e:49,bridge_name='br-int',has_traffic_filtering=True,id=46f621b9-5715-4346-8832-94ec62dbaf26,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f621b9-57') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "address": "fa:16:3e:58:d6:83", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a4a214-2e", "ovs_interfaceid": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "address": "fa:16:3e:58:d6:83", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a4a214-2e", "ovs_interfaceid": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:d6:83,bridge_name='br-int',has_traffic_filtering=True,id=b8a4a214-2ed6-4e39-b408-e8636f7a5bc2,network=Network(b97befdf-464c-4341-b12d-97b8e3b350ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a4a214-2e') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "address": "fa:16:3e:6b:a4:c0", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc4ead3-a5", "ovs_interfaceid": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "address": "fa:16:3e:6b:a4:c0", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc4ead3-a5", "ovs_interfaceid": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:a4:c0,bridge_name='br-int',has_traffic_filtering=True,id=fdc4ead3-a55c-4dcb-b62c-7cac780b2343,network=Network(b97befdf-464c-4341-b12d-97b8e3b350ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc4ead3-a5') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.objects.instance [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lazy-loading 'pci_devices' on Instance uuid 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:09:27 user nova-compute[73917]:   <uuid>06bdc5b6-c1cb-4006-a48f-73e762fdb7ed</uuid>
Aug 26 19:09:27 user nova-compute[73917]:   <name>instance-0000000d</name>
Aug 26 19:09:27 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:09:27 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:09:27 user nova-compute[73917]:   <metadata>
Aug 26 19:09:27 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:09:27 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:09:27 user nova-compute[73917]:       <nova:name>tempest-device-tagging-server-570975378</nova:name>
Aug 26 19:09:27 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:09:21</nova:creationTime>
Aug 26 19:09:27 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:09:27 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:09:27 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:09:27 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:09:27 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:09:27 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:09:27 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:09:27 user nova-compute[73917]:       <nova:owner>
Aug 26 19:09:27 user nova-compute[73917]:         <nova:user uuid="342283890ee8406f980c8637d7ce3cd6">tempest-TaggedBootDevicesTest_v242-541646257-project-member</nova:user>
Aug 26 19:09:27 user nova-compute[73917]:         <nova:project uuid="42c12b2a813a419ea0705659b402aff5">tempest-TaggedBootDevicesTest_v242-541646257</nova:project>
Aug 26 19:09:27 user nova-compute[73917]:       </nova:owner>
Aug 26 19:09:27 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:09:27 user nova-compute[73917]:       <nova:ports>
Aug 26 19:09:27 user nova-compute[73917]:         <nova:port uuid="41ff38f9-7c92-4705-acd5-26e82e7d472d">
Aug 26 19:09:27 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 19:09:27 user nova-compute[73917]:         </nova:port>
Aug 26 19:09:27 user nova-compute[73917]:         <nova:port uuid="13b34769-8c09-4cc2-a083-6fa9aef81a5e">
Aug 26 19:09:27 user nova-compute[73917]:           <nova:ip type="fixed" address="10.1.1.100" ipVersion="4"/>
Aug 26 19:09:27 user nova-compute[73917]:         </nova:port>
Aug 26 19:09:27 user nova-compute[73917]:         <nova:port uuid="8b0ca7bf-b702-4c8a-9ba8-15d3d9725437">
Aug 26 19:09:27 user nova-compute[73917]:           <nova:ip type="fixed" address="10.1.1.80" ipVersion="4"/>
Aug 26 19:09:27 user nova-compute[73917]:         </nova:port>
Aug 26 19:09:27 user nova-compute[73917]:         <nova:port uuid="6d2e08fa-3f5c-4648-8702-e52284894e6c">
Aug 26 19:09:27 user nova-compute[73917]:           <nova:ip type="fixed" address="10.1.1.98" ipVersion="4"/>
Aug 26 19:09:27 user nova-compute[73917]:         </nova:port>
Aug 26 19:09:27 user nova-compute[73917]:         <nova:port uuid="46f621b9-5715-4346-8832-94ec62dbaf26">
Aug 26 19:09:27 user nova-compute[73917]:           <nova:ip type="fixed" address="10.1.1.51" ipVersion="4"/>
Aug 26 19:09:27 user nova-compute[73917]:         </nova:port>
Aug 26 19:09:27 user nova-compute[73917]:         <nova:port uuid="b8a4a214-2ed6-4e39-b408-e8636f7a5bc2">
Aug 26 19:09:27 user nova-compute[73917]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 19:09:27 user nova-compute[73917]:         </nova:port>
Aug 26 19:09:27 user nova-compute[73917]:         <nova:port uuid="fdc4ead3-a55c-4dcb-b62c-7cac780b2343">
Aug 26 19:09:27 user nova-compute[73917]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 19:09:27 user nova-compute[73917]:         </nova:port>
Aug 26 19:09:27 user nova-compute[73917]:       </nova:ports>
Aug 26 19:09:27 user nova-compute[73917]:     </nova:instance>
Aug 26 19:09:27 user nova-compute[73917]:   </metadata>
Aug 26 19:09:27 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:09:27 user nova-compute[73917]:     <system>
Aug 26 19:09:27 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:09:27 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:09:27 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:09:27 user nova-compute[73917]:       <entry name="serial">06bdc5b6-c1cb-4006-a48f-73e762fdb7ed</entry>
Aug 26 19:09:27 user nova-compute[73917]:       <entry name="uuid">06bdc5b6-c1cb-4006-a48f-73e762fdb7ed</entry>
Aug 26 19:09:27 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:09:27 user nova-compute[73917]:     </system>
Aug 26 19:09:27 user nova-compute[73917]:   </sysinfo>
Aug 26 19:09:27 user nova-compute[73917]:   <os>
Aug 26 19:09:27 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:09:27 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:09:27 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:09:27 user nova-compute[73917]:   </os>
Aug 26 19:09:27 user nova-compute[73917]:   <features>
Aug 26 19:09:27 user nova-compute[73917]:     <acpi/>
Aug 26 19:09:27 user nova-compute[73917]:     <apic/>
Aug 26 19:09:27 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:09:27 user nova-compute[73917]:   </features>
Aug 26 19:09:27 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:09:27 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:09:27 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:09:27 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:09:27 user nova-compute[73917]:   </clock>
Aug 26 19:09:27 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:09:27 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:09:27 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:09:27 user nova-compute[73917]:   </cpu>
Aug 26 19:09:27 user nova-compute[73917]:   <devices>
Aug 26 19:09:27 user nova-compute[73917]:     <disk type="file" device="cdrom">
Aug 26 19:09:27 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 19:09:27 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/06bdc5b6-c1cb-4006-a48f-73e762fdb7ed/disk.config"/>
Aug 26 19:09:27 user nova-compute[73917]:       <target dev="hda" bus="ide"/>
Aug 26 19:09:27 user nova-compute[73917]:     </disk>
Aug 26 19:09:27 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:09:27 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:09:27 user nova-compute[73917]:       <source dev="/dev/sdc"/>
Aug 26 19:09:27 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:09:27 user nova-compute[73917]:       <serial>e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646</serial>
Aug 26 19:09:27 user nova-compute[73917]:     </disk>
Aug 26 19:09:27 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:09:27 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:09:27 user nova-compute[73917]:       <source dev="/dev/sdh"/>
Aug 26 19:09:27 user nova-compute[73917]:       <target dev="vdb" bus="virtio"/>
Aug 26 19:09:27 user nova-compute[73917]:       <serial>85aa6bd1-1305-4063-99e0-70e1329a38cc</serial>
Aug 26 19:09:27 user nova-compute[73917]:     </disk>
Aug 26 19:09:27 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:09:27 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:09:27 user nova-compute[73917]:       <source dev="/dev/sdi"/>
Aug 26 19:09:27 user nova-compute[73917]:       <target dev="vdc" bus="virtio"/>
Aug 26 19:09:27 user nova-compute[73917]:       <serial>87f6874a-24b7-4e83-bd0d-01ea7bad1cdb</serial>
Aug 26 19:09:27 user nova-compute[73917]:     </disk>
Aug 26 19:09:27 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:09:27 user nova-compute[73917]:       <mac address="fa:16:3e:90:51:54"/>
Aug 26 19:09:27 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:09:27 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:09:27 user nova-compute[73917]:       <target dev="tap41ff38f9-7c"/>
Aug 26 19:09:27 user nova-compute[73917]:     </interface>
Aug 26 19:09:27 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:09:27 user nova-compute[73917]:       <mac address="fa:16:3e:04:13:20"/>
Aug 26 19:09:27 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:09:27 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:09:27 user nova-compute[73917]:       <target dev="tap13b34769-8c"/>
Aug 26 19:09:27 user nova-compute[73917]:     </interface>
Aug 26 19:09:27 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:09:27 user nova-compute[73917]:       <mac address="fa:16:3e:d4:c6:e1"/>
Aug 26 19:09:27 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:09:27 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:09:27 user nova-compute[73917]:       <target dev="tap8b0ca7bf-b7"/>
Aug 26 19:09:27 user nova-compute[73917]:     </interface>
Aug 26 19:09:27 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:09:27 user nova-compute[73917]:       <mac address="fa:16:3e:ae:55:aa"/>
Aug 26 19:09:27 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:09:27 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:09:27 user nova-compute[73917]:       <target dev="tap6d2e08fa-3f"/>
Aug 26 19:09:27 user nova-compute[73917]:     </interface>
Aug 26 19:09:27 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:09:27 user nova-compute[73917]:       <mac address="fa:16:3e:84:7e:49"/>
Aug 26 19:09:27 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:09:27 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:09:27 user nova-compute[73917]:       <target dev="tap46f621b9-57"/>
Aug 26 19:09:27 user nova-compute[73917]:     </interface>
Aug 26 19:09:27 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:09:27 user nova-compute[73917]:       <mac address="fa:16:3e:58:d6:83"/>
Aug 26 19:09:27 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:09:27 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:09:27 user nova-compute[73917]:       <target dev="tapb8a4a214-2e"/>
Aug 26 19:09:27 user nova-compute[73917]:     </interface>
Aug 26 19:09:27 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:09:27 user nova-compute[73917]:       <mac address="fa:16:3e:6b:a4:c0"/>
Aug 26 19:09:27 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:09:27 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:09:27 user nova-compute[73917]:       <target dev="tapfdc4ead3-a5"/>
Aug 26 19:09:27 user nova-compute[73917]:     </interface>
Aug 26 19:09:27 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:09:27 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/06bdc5b6-c1cb-4006-a48f-73e762fdb7ed/console.log" append="off"/>
Aug 26 19:09:27 user nova-compute[73917]:     </serial>
Aug 26 19:09:27 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:09:27 user nova-compute[73917]:     <video>
Aug 26 19:09:27 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:09:27 user nova-compute[73917]:     </video>
Aug 26 19:09:27 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:09:27 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:09:27 user nova-compute[73917]:     </rng>
Aug 26 19:09:27 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:09:27 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:09:27 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:09:27 user nova-compute[73917]:     </memballoon>
Aug 26 19:09:27 user nova-compute[73917]:   </devices>
Aug 26 19:09:27 user nova-compute[73917]: </domain>
Aug 26 19:09:27 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "address": "fa:16:3e:90:51:54", "network": {"id": "ac76a379-a5c0-4a2e-af46-10ba88cc1bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1001642955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ff38f9-7c", "ovs_interfaceid": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "address": "fa:16:3e:90:51:54", "network": {"id": "ac76a379-a5c0-4a2e-af46-10ba88cc1bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1001642955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ff38f9-7c", "ovs_interfaceid": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:51:54,bridge_name='br-int',has_traffic_filtering=True,id=41ff38f9-7c92-4705-acd5-26e82e7d472d,network=Network(ac76a379-a5c0-4a2e-af46-10ba88cc1bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41ff38f9-7c') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG os_vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:51:54,bridge_name='br-int',has_traffic_filtering=True,id=41ff38f9-7c92-4705-acd5-26e82e7d472d,network=Network(ac76a379-a5c0-4a2e-af46-10ba88cc1bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41ff38f9-7c') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41ff38f9-7c, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap41ff38f9-7c, col_values=(('external_ids', {'iface-id': '41ff38f9-7c92-4705-acd5-26e82e7d472d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:51:54', 'vm-uuid': '06bdc5b6-c1cb-4006-a48f-73e762fdb7ed'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: INFO os_vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:51:54,bridge_name='br-int',has_traffic_filtering=True,id=41ff38f9-7c92-4705-acd5-26e82e7d472d,network=Network(ac76a379-a5c0-4a2e-af46-10ba88cc1bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41ff38f9-7c')
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "address": "fa:16:3e:04:13:20", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b34769-8c", "ovs_interfaceid": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "address": "fa:16:3e:04:13:20", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b34769-8c", "ovs_interfaceid": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:13:20,bridge_name='br-int',has_traffic_filtering=True,id=13b34769-8c09-4cc2-a083-6fa9aef81a5e,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13b34769-8c') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG os_vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:13:20,bridge_name='br-int',has_traffic_filtering=True,id=13b34769-8c09-4cc2-a083-6fa9aef81a5e,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13b34769-8c') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13b34769-8c, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13b34769-8c, col_values=(('external_ids', {'iface-id': '13b34769-8c09-4cc2-a083-6fa9aef81a5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:13:20', 'vm-uuid': '06bdc5b6-c1cb-4006-a48f-73e762fdb7ed'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: INFO os_vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:13:20,bridge_name='br-int',has_traffic_filtering=True,id=13b34769-8c09-4cc2-a083-6fa9aef81a5e,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13b34769-8c')
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "address": "fa:16:3e:d4:c6:e1", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0ca7bf-b7", "ovs_interfaceid": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "address": "fa:16:3e:d4:c6:e1", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0ca7bf-b7", "ovs_interfaceid": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c6:e1,bridge_name='br-int',has_traffic_filtering=True,id=8b0ca7bf-b702-4c8a-9ba8-15d3d9725437,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b0ca7bf-b7') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG os_vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c6:e1,bridge_name='br-int',has_traffic_filtering=True,id=8b0ca7bf-b702-4c8a-9ba8-15d3d9725437,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b0ca7bf-b7') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b0ca7bf-b7, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b0ca7bf-b7, col_values=(('external_ids', {'iface-id': '8b0ca7bf-b702-4c8a-9ba8-15d3d9725437', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:c6:e1', 'vm-uuid': '06bdc5b6-c1cb-4006-a48f-73e762fdb7ed'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: INFO os_vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c6:e1,bridge_name='br-int',has_traffic_filtering=True,id=8b0ca7bf-b702-4c8a-9ba8-15d3d9725437,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b0ca7bf-b7')
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "address": "fa:16:3e:ae:55:aa", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2e08fa-3f", "ovs_interfaceid": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "address": "fa:16:3e:ae:55:aa", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2e08fa-3f", "ovs_interfaceid": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:55:aa,bridge_name='br-int',has_traffic_filtering=True,id=6d2e08fa-3f5c-4648-8702-e52284894e6c,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2e08fa-3f') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG os_vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:55:aa,bridge_name='br-int',has_traffic_filtering=True,id=6d2e08fa-3f5c-4648-8702-e52284894e6c,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2e08fa-3f') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d2e08fa-3f, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6d2e08fa-3f, col_values=(('external_ids', {'iface-id': '6d2e08fa-3f5c-4648-8702-e52284894e6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:55:aa', 'vm-uuid': '06bdc5b6-c1cb-4006-a48f-73e762fdb7ed'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: INFO os_vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:55:aa,bridge_name='br-int',has_traffic_filtering=True,id=6d2e08fa-3f5c-4648-8702-e52284894e6c,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2e08fa-3f')
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46f621b9-5715-4346-8832-94ec62dbaf26", "address": "fa:16:3e:84:7e:49", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f621b9-57", "ovs_interfaceid": "46f621b9-5715-4346-8832-94ec62dbaf26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "46f621b9-5715-4346-8832-94ec62dbaf26", "address": "fa:16:3e:84:7e:49", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f621b9-57", "ovs_interfaceid": "46f621b9-5715-4346-8832-94ec62dbaf26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:7e:49,bridge_name='br-int',has_traffic_filtering=True,id=46f621b9-5715-4346-8832-94ec62dbaf26,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f621b9-57') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG os_vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:7e:49,bridge_name='br-int',has_traffic_filtering=True,id=46f621b9-5715-4346-8832-94ec62dbaf26,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f621b9-57') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46f621b9-57, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap46f621b9-57, col_values=(('external_ids', {'iface-id': '46f621b9-5715-4346-8832-94ec62dbaf26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:7e:49', 'vm-uuid': '06bdc5b6-c1cb-4006-a48f-73e762fdb7ed'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:28 user nova-compute[73917]: INFO os_vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:7e:49,bridge_name='br-int',has_traffic_filtering=True,id=46f621b9-5715-4346-8832-94ec62dbaf26,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f621b9-57')
Aug 26 19:09:28 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "address": "fa:16:3e:58:d6:83", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a4a214-2e", "ovs_interfaceid": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "address": "fa:16:3e:58:d6:83", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a4a214-2e", "ovs_interfaceid": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:d6:83,bridge_name='br-int',has_traffic_filtering=True,id=b8a4a214-2ed6-4e39-b408-e8636f7a5bc2,network=Network(b97befdf-464c-4341-b12d-97b8e3b350ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a4a214-2e') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG os_vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:d6:83,bridge_name='br-int',has_traffic_filtering=True,id=b8a4a214-2ed6-4e39-b408-e8636f7a5bc2,network=Network(b97befdf-464c-4341-b12d-97b8e3b350ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a4a214-2e') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8a4a214-2e, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb8a4a214-2e, col_values=(('external_ids', {'iface-id': 'b8a4a214-2ed6-4e39-b408-e8636f7a5bc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:d6:83', 'vm-uuid': '06bdc5b6-c1cb-4006-a48f-73e762fdb7ed'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:28 user nova-compute[73917]: INFO os_vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:d6:83,bridge_name='br-int',has_traffic_filtering=True,id=b8a4a214-2ed6-4e39-b408-e8636f7a5bc2,network=Network(b97befdf-464c-4341-b12d-97b8e3b350ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a4a214-2e')
Aug 26 19:09:28 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "address": "fa:16:3e:6b:a4:c0", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc4ead3-a5", "ovs_interfaceid": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "address": "fa:16:3e:6b:a4:c0", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc4ead3-a5", "ovs_interfaceid": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:a4:c0,bridge_name='br-int',has_traffic_filtering=True,id=fdc4ead3-a55c-4dcb-b62c-7cac780b2343,network=Network(b97befdf-464c-4341-b12d-97b8e3b350ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc4ead3-a5') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG os_vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:a4:c0,bridge_name='br-int',has_traffic_filtering=True,id=fdc4ead3-a55c-4dcb-b62c-7cac780b2343,network=Network(b97befdf-464c-4341-b12d-97b8e3b350ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc4ead3-a5') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdc4ead3-a5, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfdc4ead3-a5, col_values=(('external_ids', {'iface-id': 'fdc4ead3-a55c-4dcb-b62c-7cac780b2343', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:a4:c0', 'vm-uuid': '06bdc5b6-c1cb-4006-a48f-73e762fdb7ed'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG nova.compute.manager [req-a3e20da8-bbc0-414d-b5d7-178523090567 req-0a8ae9a9-1ffb-40a1-a1bf-67c02726e6d1 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-eec1aa81-34b7-44ea-aa98-57b54a967dcc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a3e20da8-bbc0-414d-b5d7-178523090567 req-0a8ae9a9-1ffb-40a1-a1bf-67c02726e6d1 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a3e20da8-bbc0-414d-b5d7-178523090567 req-0a8ae9a9-1ffb-40a1-a1bf-67c02726e6d1 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a3e20da8-bbc0-414d-b5d7-178523090567 req-0a8ae9a9-1ffb-40a1-a1bf-67c02726e6d1 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG nova.compute.manager [req-a3e20da8-bbc0-414d-b5d7-178523090567 req-0a8ae9a9-1ffb-40a1-a1bf-67c02726e6d1 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-eec1aa81-34b7-44ea-aa98-57b54a967dcc {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:28 user nova-compute[73917]: WARNING nova.compute.manager [req-a3e20da8-bbc0-414d-b5d7-178523090567 req-0a8ae9a9-1ffb-40a1-a1bf-67c02726e6d1 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-eec1aa81-34b7-44ea-aa98-57b54a967dcc for instance with vm_state building and task_state spawning.
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:28 user nova-compute[73917]: INFO os_vif [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:a4:c0,bridge_name='br-int',has_traffic_filtering=True,id=fdc4ead3-a55c-4dcb-b62c-7cac780b2343,network=Network(b97befdf-464c-4341-b12d-97b8e3b350ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc4ead3-a5')
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] No BDM found with device name hda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] No VIF found with MAC fa:16:3e:90:51:54, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] No VIF found with MAC fa:16:3e:84:7e:49, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:09:28 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Using config drive
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-01675500-c33d-46da-b19c-539213df4e06 req-02888295-45df-44d4-80b5-5cab4bd49a5d service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-9268e463-2367-4d84-be0e-f432a917b945 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-01675500-c33d-46da-b19c-539213df4e06 req-02888295-45df-44d4-80b5-5cab4bd49a5d service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-01675500-c33d-46da-b19c-539213df4e06 req-02888295-45df-44d4-80b5-5cab4bd49a5d service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-01675500-c33d-46da-b19c-539213df4e06 req-02888295-45df-44d4-80b5-5cab4bd49a5d service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-01675500-c33d-46da-b19c-539213df4e06 req-02888295-45df-44d4-80b5-5cab4bd49a5d service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-9268e463-2367-4d84-be0e-f432a917b945 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:29 user nova-compute[73917]: WARNING nova.compute.manager [req-01675500-c33d-46da-b19c-539213df4e06 req-02888295-45df-44d4-80b5-5cab4bd49a5d service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-9268e463-2367-4d84-be0e-f432a917b945 for instance with vm_state building and task_state spawning.
Aug 26 19:09:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-01675500-c33d-46da-b19c-539213df4e06 req-02888295-45df-44d4-80b5-5cab4bd49a5d service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-2d4bbc97-cf69-4155-8f62-0de77084cbdd {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-01675500-c33d-46da-b19c-539213df4e06 req-02888295-45df-44d4-80b5-5cab4bd49a5d service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-01675500-c33d-46da-b19c-539213df4e06 req-02888295-45df-44d4-80b5-5cab4bd49a5d service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-01675500-c33d-46da-b19c-539213df4e06 req-02888295-45df-44d4-80b5-5cab4bd49a5d service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-01675500-c33d-46da-b19c-539213df4e06 req-02888295-45df-44d4-80b5-5cab4bd49a5d service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-2d4bbc97-cf69-4155-8f62-0de77084cbdd {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:29 user nova-compute[73917]: WARNING nova.compute.manager [req-01675500-c33d-46da-b19c-539213df4e06 req-02888295-45df-44d4-80b5-5cab4bd49a5d service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-2d4bbc97-cf69-4155-8f62-0de77084cbdd for instance with vm_state building and task_state spawning.
Aug 26 19:09:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-01675500-c33d-46da-b19c-539213df4e06 req-02888295-45df-44d4-80b5-5cab4bd49a5d service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-2d4bbc97-cf69-4155-8f62-0de77084cbdd {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-01675500-c33d-46da-b19c-539213df4e06 req-02888295-45df-44d4-80b5-5cab4bd49a5d service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-01675500-c33d-46da-b19c-539213df4e06 req-02888295-45df-44d4-80b5-5cab4bd49a5d service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-01675500-c33d-46da-b19c-539213df4e06 req-02888295-45df-44d4-80b5-5cab4bd49a5d service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-01675500-c33d-46da-b19c-539213df4e06 req-02888295-45df-44d4-80b5-5cab4bd49a5d service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-2d4bbc97-cf69-4155-8f62-0de77084cbdd {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:29 user nova-compute[73917]: WARNING nova.compute.manager [req-01675500-c33d-46da-b19c-539213df4e06 req-02888295-45df-44d4-80b5-5cab4bd49a5d service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-2d4bbc97-cf69-4155-8f62-0de77084cbdd for instance with vm_state building and task_state spawning.
Aug 26 19:09:29 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Creating config drive at /opt/stack/data/nova/instances/06bdc5b6-c1cb-4006-a48f-73e762fdb7ed/disk.config
Aug 26 19:09:29 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/06bdc5b6-c1cb-4006-a48f-73e762fdb7ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6wosdesb {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/06bdc5b6-c1cb-4006-a48f-73e762fdb7ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6wosdesb" returned: 0 in 0.067s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-106b019c-b5b1-4c3f-82e4-9a12aff256ff req-1e0e630d-fb9c-423a-94f8-f9fa8e08dba6 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-dfc09729-80ce-463f-8ad4-4f16f8b304f2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-106b019c-b5b1-4c3f-82e4-9a12aff256ff req-1e0e630d-fb9c-423a-94f8-f9fa8e08dba6 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-106b019c-b5b1-4c3f-82e4-9a12aff256ff req-1e0e630d-fb9c-423a-94f8-f9fa8e08dba6 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-106b019c-b5b1-4c3f-82e4-9a12aff256ff req-1e0e630d-fb9c-423a-94f8-f9fa8e08dba6 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-106b019c-b5b1-4c3f-82e4-9a12aff256ff req-1e0e630d-fb9c-423a-94f8-f9fa8e08dba6 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-dfc09729-80ce-463f-8ad4-4f16f8b304f2 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:29 user nova-compute[73917]: WARNING nova.compute.manager [req-106b019c-b5b1-4c3f-82e4-9a12aff256ff req-1e0e630d-fb9c-423a-94f8-f9fa8e08dba6 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-dfc09729-80ce-463f-8ad4-4f16f8b304f2 for instance with vm_state building and task_state spawning.
Aug 26 19:09:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-106b019c-b5b1-4c3f-82e4-9a12aff256ff req-1e0e630d-fb9c-423a-94f8-f9fa8e08dba6 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-22c864bd-81de-436b-9745-de2cf3cfffd5 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-106b019c-b5b1-4c3f-82e4-9a12aff256ff req-1e0e630d-fb9c-423a-94f8-f9fa8e08dba6 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-106b019c-b5b1-4c3f-82e4-9a12aff256ff req-1e0e630d-fb9c-423a-94f8-f9fa8e08dba6 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-106b019c-b5b1-4c3f-82e4-9a12aff256ff req-1e0e630d-fb9c-423a-94f8-f9fa8e08dba6 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-106b019c-b5b1-4c3f-82e4-9a12aff256ff req-1e0e630d-fb9c-423a-94f8-f9fa8e08dba6 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-22c864bd-81de-436b-9745-de2cf3cfffd5 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:29 user nova-compute[73917]: WARNING nova.compute.manager [req-106b019c-b5b1-4c3f-82e4-9a12aff256ff req-1e0e630d-fb9c-423a-94f8-f9fa8e08dba6 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-22c864bd-81de-436b-9745-de2cf3cfffd5 for instance with vm_state building and task_state spawning.
Aug 26 19:09:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-106b019c-b5b1-4c3f-82e4-9a12aff256ff req-1e0e630d-fb9c-423a-94f8-f9fa8e08dba6 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-22c864bd-81de-436b-9745-de2cf3cfffd5 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-106b019c-b5b1-4c3f-82e4-9a12aff256ff req-1e0e630d-fb9c-423a-94f8-f9fa8e08dba6 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-106b019c-b5b1-4c3f-82e4-9a12aff256ff req-1e0e630d-fb9c-423a-94f8-f9fa8e08dba6 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-106b019c-b5b1-4c3f-82e4-9a12aff256ff req-1e0e630d-fb9c-423a-94f8-f9fa8e08dba6 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-106b019c-b5b1-4c3f-82e4-9a12aff256ff req-1e0e630d-fb9c-423a-94f8-f9fa8e08dba6 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-22c864bd-81de-436b-9745-de2cf3cfffd5 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:29 user nova-compute[73917]: WARNING nova.compute.manager [req-106b019c-b5b1-4c3f-82e4-9a12aff256ff req-1e0e630d-fb9c-423a-94f8-f9fa8e08dba6 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-22c864bd-81de-436b-9745-de2cf3cfffd5 for instance with vm_state building and task_state spawning.
Aug 26 19:09:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Acquiring lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG nova.objects.instance [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lazy-loading 'flavor' on Instance uuid f019c6c6-e76f-4a75-8ba4-8c566d9f5791 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG nova.compute.manager [req-f0975baf-5aab-4399-9e7c-471e85584f6b req-fc9597ac-0d71-4b56-aa37-2ca06302b126 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-eec1aa81-34b7-44ea-aa98-57b54a967dcc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f0975baf-5aab-4399-9e7c-471e85584f6b req-fc9597ac-0d71-4b56-aa37-2ca06302b126 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f0975baf-5aab-4399-9e7c-471e85584f6b req-fc9597ac-0d71-4b56-aa37-2ca06302b126 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f0975baf-5aab-4399-9e7c-471e85584f6b req-fc9597ac-0d71-4b56-aa37-2ca06302b126 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG nova.compute.manager [req-f0975baf-5aab-4399-9e7c-471e85584f6b req-fc9597ac-0d71-4b56-aa37-2ca06302b126 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-eec1aa81-34b7-44ea-aa98-57b54a967dcc {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:30 user nova-compute[73917]: WARNING nova.compute.manager [req-f0975baf-5aab-4399-9e7c-471e85584f6b req-fc9597ac-0d71-4b56-aa37-2ca06302b126 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-eec1aa81-34b7-44ea-aa98-57b54a967dcc for instance with vm_state building and task_state spawning.
Aug 26 19:09:30 user nova-compute[73917]: DEBUG nova.compute.manager [req-f0975baf-5aab-4399-9e7c-471e85584f6b req-fc9597ac-0d71-4b56-aa37-2ca06302b126 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-19a44d0d-f673-49e9-8c62-014aff19769c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f0975baf-5aab-4399-9e7c-471e85584f6b req-fc9597ac-0d71-4b56-aa37-2ca06302b126 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f0975baf-5aab-4399-9e7c-471e85584f6b req-fc9597ac-0d71-4b56-aa37-2ca06302b126 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f0975baf-5aab-4399-9e7c-471e85584f6b req-fc9597ac-0d71-4b56-aa37-2ca06302b126 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG nova.compute.manager [req-f0975baf-5aab-4399-9e7c-471e85584f6b req-fc9597ac-0d71-4b56-aa37-2ca06302b126 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-19a44d0d-f673-49e9-8c62-014aff19769c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:30 user nova-compute[73917]: WARNING nova.compute.manager [req-f0975baf-5aab-4399-9e7c-471e85584f6b req-fc9597ac-0d71-4b56-aa37-2ca06302b126 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-19a44d0d-f673-49e9-8c62-014aff19769c for instance with vm_state building and task_state spawning.
Aug 26 19:09:30 user nova-compute[73917]: DEBUG nova.compute.manager [req-f0975baf-5aab-4399-9e7c-471e85584f6b req-fc9597ac-0d71-4b56-aa37-2ca06302b126 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-19a44d0d-f673-49e9-8c62-014aff19769c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f0975baf-5aab-4399-9e7c-471e85584f6b req-fc9597ac-0d71-4b56-aa37-2ca06302b126 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f0975baf-5aab-4399-9e7c-471e85584f6b req-fc9597ac-0d71-4b56-aa37-2ca06302b126 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f0975baf-5aab-4399-9e7c-471e85584f6b req-fc9597ac-0d71-4b56-aa37-2ca06302b126 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG nova.compute.manager [req-f0975baf-5aab-4399-9e7c-471e85584f6b req-fc9597ac-0d71-4b56-aa37-2ca06302b126 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-19a44d0d-f673-49e9-8c62-014aff19769c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:30 user nova-compute[73917]: WARNING nova.compute.manager [req-f0975baf-5aab-4399-9e7c-471e85584f6b req-fc9597ac-0d71-4b56-aa37-2ca06302b126 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-19a44d0d-f673-49e9-8c62-014aff19769c for instance with vm_state building and task_state spawning.
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Acquiring lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:30 user nova-compute[73917]: INFO nova.compute.manager [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Attaching volume c9c6466e-3525-42d6-8a7b-df107660ffd4 to /dev/vdb
Aug 26 19:09:30 user nova-compute[73917]: DEBUG os_brick.utils [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5b083e-6485-458a-8457-b90b3ee57ecf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5beb37-9824-48d2-a555-02fa72a36423]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[600abfad-89c0-458e-8182-d807f42f8a1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacbf09a-1fcb-4167-ab86-87e3b58bfc08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:09:30 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:09:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0748b20-a65a-4efe-b771-e91eb6235e0b]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG os_brick.utils [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Updating existing volume attachment record: 52585aac-da88-4d32-9982-8a72718faf9d {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076971.3450425, 54fd570d-421c-4a39-b4ae-772500b24cec => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:09:31 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] VM Resumed (Lifecycle Event)
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:09:31 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Instance spawned successfully.
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:31 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076971.3472197, 54fd570d-421c-4a39-b4ae-772500b24cec => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:09:31 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] VM Started (Lifecycle Event)
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-3e56834c-c241-4fad-ad53-41b69c4ed362 req-1b9f23fb-a364-4cd9-845b-6c0c93305b56 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-472badf6-8de1-4c67-8bfa-7105f672eff0 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3e56834c-c241-4fad-ad53-41b69c4ed362 req-1b9f23fb-a364-4cd9-845b-6c0c93305b56 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3e56834c-c241-4fad-ad53-41b69c4ed362 req-1b9f23fb-a364-4cd9-845b-6c0c93305b56 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3e56834c-c241-4fad-ad53-41b69c4ed362 req-1b9f23fb-a364-4cd9-845b-6c0c93305b56 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-3e56834c-c241-4fad-ad53-41b69c4ed362 req-1b9f23fb-a364-4cd9-845b-6c0c93305b56 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-472badf6-8de1-4c67-8bfa-7105f672eff0 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:31 user nova-compute[73917]: WARNING nova.compute.manager [req-3e56834c-c241-4fad-ad53-41b69c4ed362 req-1b9f23fb-a364-4cd9-845b-6c0c93305b56 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-472badf6-8de1-4c67-8bfa-7105f672eff0 for instance with vm_state building and task_state spawning.
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-3e56834c-c241-4fad-ad53-41b69c4ed362 req-1b9f23fb-a364-4cd9-845b-6c0c93305b56 service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Received event network-changed-2ad6ccc6-cb71-4105-88e4-cb48743f26ad {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-3e56834c-c241-4fad-ad53-41b69c4ed362 req-1b9f23fb-a364-4cd9-845b-6c0c93305b56 service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Refreshing instance network info cache due to event network-changed-2ad6ccc6-cb71-4105-88e4-cb48743f26ad. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3e56834c-c241-4fad-ad53-41b69c4ed362 req-1b9f23fb-a364-4cd9-845b-6c0c93305b56 service nova] Acquiring lock "refresh_cache-f019c6c6-e76f-4a75-8ba4-8c566d9f5791" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3e56834c-c241-4fad-ad53-41b69c4ed362 req-1b9f23fb-a364-4cd9-845b-6c0c93305b56 service nova] Acquired lock "refresh_cache-f019c6c6-e76f-4a75-8ba4-8c566d9f5791" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.network.neutron [req-3e56834c-c241-4fad-ad53-41b69c4ed362 req-1b9f23fb-a364-4cd9-845b-6c0c93305b56 service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Refreshing network info cache for port 2ad6ccc6-cb71-4105-88e4-cb48743f26ad {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:31 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:09:31 user nova-compute[73917]: INFO nova.compute.manager [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Took 15.33 seconds to spawn the instance on the hypervisor.
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:31 user nova-compute[73917]: INFO nova.compute.manager [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Took 64.19 seconds to build instance.
Aug 26 19:09:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f496548b-9dc1-4a9b-bae2-a43791441b89 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "54fd570d-421c-4a39-b4ae-772500b24cec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 64.286s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-d2334691-e6b4-4896-a82f-1b24001f7ace req-07f43d94-8f61-4f21-ad59-811e927f35bc service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-13b34769-8c09-4cc2-a083-6fa9aef81a5e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d2334691-e6b4-4896-a82f-1b24001f7ace req-07f43d94-8f61-4f21-ad59-811e927f35bc service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d2334691-e6b4-4896-a82f-1b24001f7ace req-07f43d94-8f61-4f21-ad59-811e927f35bc service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d2334691-e6b4-4896-a82f-1b24001f7ace req-07f43d94-8f61-4f21-ad59-811e927f35bc service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-d2334691-e6b4-4896-a82f-1b24001f7ace req-07f43d94-8f61-4f21-ad59-811e927f35bc service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-13b34769-8c09-4cc2-a083-6fa9aef81a5e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:31 user nova-compute[73917]: WARNING nova.compute.manager [req-d2334691-e6b4-4896-a82f-1b24001f7ace req-07f43d94-8f61-4f21-ad59-811e927f35bc service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-13b34769-8c09-4cc2-a083-6fa9aef81a5e for instance with vm_state building and task_state spawning.
Aug 26 19:09:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG nova.network.neutron [req-3e56834c-c241-4fad-ad53-41b69c4ed362 req-1b9f23fb-a364-4cd9-845b-6c0c93305b56 service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Updated VIF entry in instance network info cache for port 2ad6ccc6-cb71-4105-88e4-cb48743f26ad. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG nova.network.neutron [req-3e56834c-c241-4fad-ad53-41b69c4ed362 req-1b9f23fb-a364-4cd9-845b-6c0c93305b56 service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Updating instance_info_cache with network_info: [{"id": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "address": "fa:16:3e:90:3b:ae", "network": {"id": "d7f21c5c-fb69-4df5-aadb-b4712d9368cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-187373287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145ef38260474f159e954ecfa742224d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ad6ccc6-cb", "ovs_interfaceid": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3e56834c-c241-4fad-ad53-41b69c4ed362 req-1b9f23fb-a364-4cd9-845b-6c0c93305b56 service nova] Releasing lock "refresh_cache-f019c6c6-e76f-4a75-8ba4-8c566d9f5791" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG nova.compute.manager [req-3e56834c-c241-4fad-ad53-41b69c4ed362 req-1b9f23fb-a364-4cd9-845b-6c0c93305b56 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-472badf6-8de1-4c67-8bfa-7105f672eff0 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3e56834c-c241-4fad-ad53-41b69c4ed362 req-1b9f23fb-a364-4cd9-845b-6c0c93305b56 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3e56834c-c241-4fad-ad53-41b69c4ed362 req-1b9f23fb-a364-4cd9-845b-6c0c93305b56 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3e56834c-c241-4fad-ad53-41b69c4ed362 req-1b9f23fb-a364-4cd9-845b-6c0c93305b56 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG nova.compute.manager [req-3e56834c-c241-4fad-ad53-41b69c4ed362 req-1b9f23fb-a364-4cd9-845b-6c0c93305b56 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-472badf6-8de1-4c67-8bfa-7105f672eff0 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:32 user nova-compute[73917]: WARNING nova.compute.manager [req-3e56834c-c241-4fad-ad53-41b69c4ed362 req-1b9f23fb-a364-4cd9-845b-6c0c93305b56 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-472badf6-8de1-4c67-8bfa-7105f672eff0 for instance with vm_state building and task_state spawning.
Aug 26 19:09:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG nova.compute.manager [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Received event network-changed-c20cdde4-5ebd-4878-8eb2-4c62493255b9 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG nova.compute.manager [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Refreshing instance network info cache due to event network-changed-c20cdde4-5ebd-4878-8eb2-4c62493255b9. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] Acquiring lock "refresh_cache-c8f0be92-c7bf-49cd-a4a4-23e625603081" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] Acquired lock "refresh_cache-c8f0be92-c7bf-49cd-a4a4-23e625603081" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG nova.network.neutron [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Refreshing network info cache for port c20cdde4-5ebd-4878-8eb2-4c62493255b9 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-251dbfdb-99ff-4fc8-8843-328f618f043f req-63a9ce82-a573-4374-83f6-703ed083c6a8 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-b8a4a214-2ed6-4e39-b408-e8636f7a5bc2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-251dbfdb-99ff-4fc8-8843-328f618f043f req-63a9ce82-a573-4374-83f6-703ed083c6a8 service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-251dbfdb-99ff-4fc8-8843-328f618f043f req-63a9ce82-a573-4374-83f6-703ed083c6a8 service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-251dbfdb-99ff-4fc8-8843-328f618f043f req-63a9ce82-a573-4374-83f6-703ed083c6a8 service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-251dbfdb-99ff-4fc8-8843-328f618f043f req-63a9ce82-a573-4374-83f6-703ed083c6a8 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-b8a4a214-2ed6-4e39-b408-e8636f7a5bc2 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:33 user nova-compute[73917]: WARNING nova.compute.manager [req-251dbfdb-99ff-4fc8-8843-328f618f043f req-63a9ce82-a573-4374-83f6-703ed083c6a8 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-b8a4a214-2ed6-4e39-b408-e8636f7a5bc2 for instance with vm_state building and task_state spawning.
Aug 26 19:09:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-13b34769-8c09-4cc2-a083-6fa9aef81a5e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-13b34769-8c09-4cc2-a083-6fa9aef81a5e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:33 user nova-compute[73917]: WARNING nova.compute.manager [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-13b34769-8c09-4cc2-a083-6fa9aef81a5e for instance with vm_state building and task_state spawning.
Aug 26 19:09:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-6d2e08fa-3f5c-4648-8702-e52284894e6c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-6d2e08fa-3f5c-4648-8702-e52284894e6c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:33 user nova-compute[73917]: WARNING nova.compute.manager [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-6d2e08fa-3f5c-4648-8702-e52284894e6c for instance with vm_state building and task_state spawning.
Aug 26 19:09:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-6d2e08fa-3f5c-4648-8702-e52284894e6c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-6d2e08fa-3f5c-4648-8702-e52284894e6c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:33 user nova-compute[73917]: WARNING nova.compute.manager [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-6d2e08fa-3f5c-4648-8702-e52284894e6c for instance with vm_state building and task_state spawning.
Aug 26 19:09:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-46f621b9-5715-4346-8832-94ec62dbaf26 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-46f621b9-5715-4346-8832-94ec62dbaf26 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:33 user nova-compute[73917]: WARNING nova.compute.manager [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-46f621b9-5715-4346-8832-94ec62dbaf26 for instance with vm_state building and task_state spawning.
Aug 26 19:09:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-46f621b9-5715-4346-8832-94ec62dbaf26 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-46f621b9-5715-4346-8832-94ec62dbaf26 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:33 user nova-compute[73917]: WARNING nova.compute.manager [req-0b757b4a-1fd8-43a1-bde7-cc5136bacdb0 req-ef97031e-0577-452f-b77d-3ac2e87ee1bf service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-46f621b9-5715-4346-8832-94ec62dbaf26 for instance with vm_state building and task_state spawning.
Aug 26 19:09:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693076959.1879601, ce383b5a-c726-4d82-b0e3-be6ac6659428 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:09:34 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] VM Stopped (Lifecycle Event)
Aug 26 19:09:34 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9f578da8-a346-43d8-933f-88372eeeb804 None None] [instance: ce383b5a-c726-4d82-b0e3-be6ac6659428] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG nova.network.neutron [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Updated VIF entry in instance network info cache for port c20cdde4-5ebd-4878-8eb2-4c62493255b9. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG nova.network.neutron [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Updating instance_info_cache with network_info: [{"id": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "address": "fa:16:3e:be:0a:78", "network": {"id": "fef455a2-e475-421b-8d21-6ffa2b400885", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-784820277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef2cfaaccb74aa1b6754a79dafbbfde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20cdde4-5e", "ovs_interfaceid": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] Releasing lock "refresh_cache-c8f0be92-c7bf-49cd-a4a4-23e625603081" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-41ff38f9-7c92-4705-acd5-26e82e7d472d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-41ff38f9-7c92-4705-acd5-26e82e7d472d {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:34 user nova-compute[73917]: WARNING nova.compute.manager [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-41ff38f9-7c92-4705-acd5-26e82e7d472d for instance with vm_state building and task_state spawning.
Aug 26 19:09:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-41ff38f9-7c92-4705-acd5-26e82e7d472d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-41ff38f9-7c92-4705-acd5-26e82e7d472d {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:34 user nova-compute[73917]: WARNING nova.compute.manager [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-41ff38f9-7c92-4705-acd5-26e82e7d472d for instance with vm_state building and task_state spawning.
Aug 26 19:09:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-8b0ca7bf-b702-4c8a-9ba8-15d3d9725437 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-8b0ca7bf-b702-4c8a-9ba8-15d3d9725437 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:34 user nova-compute[73917]: WARNING nova.compute.manager [req-cc746a1d-bedf-4219-9833-222afd502cf2 req-0601a9a8-dec9-46d0-82e4-de5a2492b93a service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-8b0ca7bf-b702-4c8a-9ba8-15d3d9725437 for instance with vm_state building and task_state spawning.
Aug 26 19:09:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-60fd37c2-296c-4860-b7ed-31ad0cb5fab2 req-5a937d53-31e9-4626-ad5c-5c21b73305c7 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-8b0ca7bf-b702-4c8a-9ba8-15d3d9725437 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-60fd37c2-296c-4860-b7ed-31ad0cb5fab2 req-5a937d53-31e9-4626-ad5c-5c21b73305c7 service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-60fd37c2-296c-4860-b7ed-31ad0cb5fab2 req-5a937d53-31e9-4626-ad5c-5c21b73305c7 service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-60fd37c2-296c-4860-b7ed-31ad0cb5fab2 req-5a937d53-31e9-4626-ad5c-5c21b73305c7 service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-60fd37c2-296c-4860-b7ed-31ad0cb5fab2 req-5a937d53-31e9-4626-ad5c-5c21b73305c7 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-8b0ca7bf-b702-4c8a-9ba8-15d3d9725437 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:34 user nova-compute[73917]: WARNING nova.compute.manager [req-60fd37c2-296c-4860-b7ed-31ad0cb5fab2 req-5a937d53-31e9-4626-ad5c-5c21b73305c7 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-8b0ca7bf-b702-4c8a-9ba8-15d3d9725437 for instance with vm_state building and task_state spawning.
Aug 26 19:09:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquiring lock "interface-86937c34-db86-44a9-8196-3cae0d7ce400-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "interface-86937c34-db86-44a9-8196-3cae0d7ce400-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:34 user nova-compute[73917]: DEBUG nova.objects.instance [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lazy-loading 'flavor' on Instance uuid 86937c34-db86-44a9-8196-3cae0d7ce400 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.objects.instance [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lazy-loading 'pci_requests' on Instance uuid 86937c34-db86-44a9-8196-3cae0d7ce400 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.objects.base [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Object Instance<86937c34-db86-44a9-8196-3cae0d7ce400> lazy-loaded attributes: flavor,pci_requests {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.network.neutron [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.policy [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e883bb35273c4f9cacdc443695962e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec3e3b818b54192b32d90bb8240515e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076975.6658626, 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:09:35 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] VM Resumed (Lifecycle Event)
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:09:35 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Instance spawned successfully.
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:35 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693076975.6706429, 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:09:35 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] VM Started (Lifecycle Event)
Aug 26 19:09:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:09:35 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:09:35 user nova-compute[73917]: INFO nova.compute.manager [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Took 14.50 seconds to spawn the instance on the hypervisor.
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received event network-changed-0fd58968-f9e8-40f0-acff-8efea741379e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Refreshing instance network info cache due to event network-changed-0fd58968-f9e8-40f0-acff-8efea741379e. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] Acquiring lock "refresh_cache-86937c34-db86-44a9-8196-3cae0d7ce400" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] Acquired lock "refresh_cache-86937c34-db86-44a9-8196-3cae0d7ce400" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:09:35 user nova-compute[73917]: DEBUG nova.network.neutron [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Refreshing network info cache for port 0fd58968-f9e8-40f0-acff-8efea741379e {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:09:35 user nova-compute[73917]: INFO nova.compute.manager [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Took 57.87 seconds to build instance.
Aug 26 19:09:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b14cdc20-f1c2-482e-8896-cebc6bca464d tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 57.971s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG nova.network.neutron [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Successfully created port: 27ca071c-c2bc-4907-a0fa-b48c52f62721 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Acquiring lock "c8f0be92-c7bf-49cd-a4a4-23e625603081" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "c8f0be92-c7bf-49cd-a4a4-23e625603081" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG nova.objects.instance [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lazy-loading 'flavor' on Instance uuid c8f0be92-c7bf-49cd-a4a4-23e625603081 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG nova.network.neutron [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Updated VIF entry in instance network info cache for port 0fd58968-f9e8-40f0-acff-8efea741379e. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG nova.network.neutron [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Updating instance_info_cache with network_info: [{"id": "0fd58968-f9e8-40f0-acff-8efea741379e", "address": "fa:16:3e:b3:2d:13", "network": {"id": "02545642-9a23-4d7d-8ff0-231150ea7ced", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2072904890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd58968-f9", "ovs_interfaceid": "0fd58968-f9e8-40f0-acff-8efea741379e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "c8f0be92-c7bf-49cd-a4a4-23e625603081" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] Releasing lock "refresh_cache-86937c34-db86-44a9-8196-3cae0d7ce400" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-b8a4a214-2ed6-4e39-b408-e8636f7a5bc2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-b8a4a214-2ed6-4e39-b408-e8636f7a5bc2 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:36 user nova-compute[73917]: WARNING nova.compute.manager [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-b8a4a214-2ed6-4e39-b408-e8636f7a5bc2 for instance with vm_state building and task_state spawning.
Aug 26 19:09:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-fdc4ead3-a55c-4dcb-b62c-7cac780b2343 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-fdc4ead3-a55c-4dcb-b62c-7cac780b2343 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:36 user nova-compute[73917]: WARNING nova.compute.manager [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-fdc4ead3-a55c-4dcb-b62c-7cac780b2343 for instance with vm_state building and task_state spawning.
Aug 26 19:09:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-fdc4ead3-a55c-4dcb-b62c-7cac780b2343 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-fdc4ead3-a55c-4dcb-b62c-7cac780b2343 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:36 user nova-compute[73917]: WARNING nova.compute.manager [req-725a5a59-46d2-43df-86f6-9e05123fa263 req-227933f2-48ad-4445-afa8-d5a3c6d36c7b service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-fdc4ead3-a55c-4dcb-b62c-7cac780b2343 for instance with vm_state building and task_state spawning.
Aug 26 19:09:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Acquiring lock "c8f0be92-c7bf-49cd-a4a4-23e625603081" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "c8f0be92-c7bf-49cd-a4a4-23e625603081" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:36 user nova-compute[73917]: INFO nova.compute.manager [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Attaching volume bb4f2fe8-9529-4c56-8d50-543771708170 to /dev/sdc
Aug 26 19:09:36 user nova-compute[73917]: DEBUG os_brick.utils [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[531e6742-1476-4478-9d2d-5af187d01131]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2063ed0-f509-4634-aa07-dcacc03232ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35381c4-01b3-48d4-beb4-0505e14e2da6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d03d38-1070-456b-95d1-ca0e19150de6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG nova.network.neutron [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Successfully updated port: 27ca071c-c2bc-4907-a0fa-b48c52f62721 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquiring lock "refresh_cache-86937c34-db86-44a9-8196-3cae0d7ce400" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquired lock "refresh_cache-86937c34-db86-44a9-8196-3cae0d7ce400" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG nova.network.neutron [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:09:37 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:09:37 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37527db-4b39-4e6e-8425-340ad5a8add8]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG os_brick.utils [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Updating existing volume attachment record: 3ec47efa-032b-4c5f-a7e2-82045ec0283d {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG nova.network.neutron [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Updating instance_info_cache with network_info: [{"id": "0fd58968-f9e8-40f0-acff-8efea741379e", "address": "fa:16:3e:b3:2d:13", "network": {"id": "02545642-9a23-4d7d-8ff0-231150ea7ced", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2072904890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd58968-f9", "ovs_interfaceid": "0fd58968-f9e8-40f0-acff-8efea741379e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "address": "fa:16:3e:94:38:8b", "network": {"id": "42af97c0-edd6-4ebf-ae4d-fe4632ea7c95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1764354394", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ca071c-c2", "ovs_interfaceid": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Releasing lock "refresh_cache-86937c34-db86-44a9-8196-3cae0d7ce400" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152870467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1152870467',id=10,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh0Gq1qVrt69OKjzmbhUuqTEU+L2JyHLQ3aEGP1I2l94+VWUqaxZlu45tMYdws2tmkIV0iudsUfn6jRdBXdutT2e0DfOoTHtyHz97pVCSRiDLTiyRN8NsP3m644FqnDUA==',key_name='tempest-keypair-2122776356',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cec3e3b818b54192b32d90bb8240515e',ramdisk_id='',reservation_id='r-8k2gu0ce',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1228202789',owner_user_name='tempest-TaggedAttachmentsTest-1228202789-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e883bb35273c4f9cacdc443695962e5d',uuid=86937c34-db86-44a9-8196-3cae0d7ce400,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "address": "fa:16:3e:94:38:8b", "network": {"id": "42af97c0-edd6-4ebf-ae4d-fe4632ea7c95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1764354394", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ca071c-c2", "ovs_interfaceid": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Converting VIF {"id": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "address": "fa:16:3e:94:38:8b", "network": {"id": "42af97c0-edd6-4ebf-ae4d-fe4632ea7c95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1764354394", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ca071c-c2", "ovs_interfaceid": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:38:8b,bridge_name='br-int',has_traffic_filtering=True,id=27ca071c-c2bc-4907-a0fa-b48c52f62721,network=Network(42af97c0-edd6-4ebf-ae4d-fe4632ea7c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27ca071c-c2') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG os_vif [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:38:8b,bridge_name='br-int',has_traffic_filtering=True,id=27ca071c-c2bc-4907-a0fa-b48c52f62721,network=Network(42af97c0-edd6-4ebf-ae4d-fe4632ea7c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27ca071c-c2') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27ca071c-c2, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27ca071c-c2, col_values=(('external_ids', {'iface-id': '27ca071c-c2bc-4907-a0fa-b48c52f62721', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:38:8b', 'vm-uuid': '86937c34-db86-44a9-8196-3cae0d7ce400'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:37 user nova-compute[73917]: INFO os_vif [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:38:8b,bridge_name='br-int',has_traffic_filtering=True,id=27ca071c-c2bc-4907-a0fa-b48c52f62721,network=Network(42af97c0-edd6-4ebf-ae4d-fe4632ea7c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27ca071c-c2')
Aug 26 19:09:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152870467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1152870467',id=10,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh0Gq1qVrt69OKjzmbhUuqTEU+L2JyHLQ3aEGP1I2l94+VWUqaxZlu45tMYdws2tmkIV0iudsUfn6jRdBXdutT2e0DfOoTHtyHz97pVCSRiDLTiyRN8NsP3m644FqnDUA==',key_name='tempest-keypair-2122776356',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cec3e3b818b54192b32d90bb8240515e',ramdisk_id='',reservation_id='r-8k2gu0ce',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1228202789',owner_user_name='tempest-TaggedAttachmentsTest-1228202789-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e883bb35273c4f9cacdc443695962e5d',uuid=86937c34-db86-44a9-8196-3cae0d7ce400,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "address": "fa:16:3e:94:38:8b", "network": {"id": "42af97c0-edd6-4ebf-ae4d-fe4632ea7c95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1764354394", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ca071c-c2", "ovs_interfaceid": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Converting VIF {"id": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "address": "fa:16:3e:94:38:8b", "network": {"id": "42af97c0-edd6-4ebf-ae4d-fe4632ea7c95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1764354394", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ca071c-c2", "ovs_interfaceid": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:38:8b,bridge_name='br-int',has_traffic_filtering=True,id=27ca071c-c2bc-4907-a0fa-b48c52f62721,network=Network(42af97c0-edd6-4ebf-ae4d-fe4632ea7c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27ca071c-c2') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] attach device xml: <interface type="ethernet">
Aug 26 19:09:37 user nova-compute[73917]:   <mac address="fa:16:3e:94:38:8b"/>
Aug 26 19:09:37 user nova-compute[73917]:   <model type="virtio"/>
Aug 26 19:09:37 user nova-compute[73917]:   <mtu size="1442"/>
Aug 26 19:09:37 user nova-compute[73917]:   <target dev="tap27ca071c-c2"/>
Aug 26 19:09:37 user nova-compute[73917]: </interface>
Aug 26 19:09:37 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693076963.0320556, fdfb377e-119e-41ce-b9e0-6e21053306cc => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:09:38 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] VM Stopped (Lifecycle Event)
Aug 26 19:09:38 user nova-compute[73917]: DEBUG nova.compute.manager [req-11dca1d0-17b5-4e1d-a36d-c3988d799cdd req-1be827a7-8e5d-4836-b976-3e48c4142f4a service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received event network-changed-27ca071c-c2bc-4907-a0fa-b48c52f62721 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG nova.compute.manager [req-11dca1d0-17b5-4e1d-a36d-c3988d799cdd req-1be827a7-8e5d-4836-b976-3e48c4142f4a service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Refreshing instance network info cache due to event network-changed-27ca071c-c2bc-4907-a0fa-b48c52f62721. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-11dca1d0-17b5-4e1d-a36d-c3988d799cdd req-1be827a7-8e5d-4836-b976-3e48c4142f4a service nova] Acquiring lock "refresh_cache-86937c34-db86-44a9-8196-3cae0d7ce400" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-11dca1d0-17b5-4e1d-a36d-c3988d799cdd req-1be827a7-8e5d-4836-b976-3e48c4142f4a service nova] Acquired lock "refresh_cache-86937c34-db86-44a9-8196-3cae0d7ce400" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG nova.network.neutron [req-11dca1d0-17b5-4e1d-a36d-c3988d799cdd req-1be827a7-8e5d-4836-b976-3e48c4142f4a service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Refreshing network info cache for port 27ca071c-c2bc-4907-a0fa-b48c52f62721 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG nova.compute.manager [None req-6158a5a6-8eed-4324-8898-06e4c15f7255 None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG nova.compute.manager [None req-6158a5a6-8eed-4324-8898-06e4c15f7255 None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] No BDM found with device name hda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] No VIF found with MAC fa:16:3e:b3:2d:13, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG nova.compute.manager [req-6d9508b1-8ddc-4d0c-81ef-618c2e3135f4 req-1ed3ba24-95d9-476c-b8a5-2a765b4d91e5 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received event network-vif-plugged-27ca071c-c2bc-4907-a0fa-b48c52f62721 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d9508b1-8ddc-4d0c-81ef-618c2e3135f4 req-1ed3ba24-95d9-476c-b8a5-2a765b4d91e5 service nova] Acquiring lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d9508b1-8ddc-4d0c-81ef-618c2e3135f4 req-1ed3ba24-95d9-476c-b8a5-2a765b4d91e5 service nova] Lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d9508b1-8ddc-4d0c-81ef-618c2e3135f4 req-1ed3ba24-95d9-476c-b8a5-2a765b4d91e5 service nova] Lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG nova.compute.manager [req-6d9508b1-8ddc-4d0c-81ef-618c2e3135f4 req-1ed3ba24-95d9-476c-b8a5-2a765b4d91e5 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] No waiting events found dispatching network-vif-plugged-27ca071c-c2bc-4907-a0fa-b48c52f62721 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:38 user nova-compute[73917]: WARNING nova.compute.manager [req-6d9508b1-8ddc-4d0c-81ef-618c2e3135f4 req-1ed3ba24-95d9-476c-b8a5-2a765b4d91e5 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received unexpected event network-vif-plugged-27ca071c-c2bc-4907-a0fa-b48c52f62721 for instance with vm_state active and task_state None.
Aug 26 19:09:38 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:09:38 user nova-compute[73917]:   <nova:package version="0.0.0"/>
Aug 26 19:09:38 user nova-compute[73917]:   <nova:name>tempest-device-tagging-server-1152870467</nova:name>
Aug 26 19:09:38 user nova-compute[73917]:   <nova:creationTime>2023-08-26 19:09:38</nova:creationTime>
Aug 26 19:09:38 user nova-compute[73917]:   <nova:flavor name="m1.tiny">
Aug 26 19:09:38 user nova-compute[73917]:     <nova:memory>512</nova:memory>
Aug 26 19:09:38 user nova-compute[73917]:     <nova:disk>1</nova:disk>
Aug 26 19:09:38 user nova-compute[73917]:     <nova:swap>0</nova:swap>
Aug 26 19:09:38 user nova-compute[73917]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:09:38 user nova-compute[73917]:     <nova:vcpus>1</nova:vcpus>
Aug 26 19:09:38 user nova-compute[73917]:   </nova:flavor>
Aug 26 19:09:38 user nova-compute[73917]:   <nova:owner>
Aug 26 19:09:38 user nova-compute[73917]:     <nova:user uuid="e883bb35273c4f9cacdc443695962e5d">tempest-TaggedAttachmentsTest-1228202789-project-member</nova:user>
Aug 26 19:09:38 user nova-compute[73917]:     <nova:project uuid="cec3e3b818b54192b32d90bb8240515e">tempest-TaggedAttachmentsTest-1228202789</nova:project>
Aug 26 19:09:38 user nova-compute[73917]:   </nova:owner>
Aug 26 19:09:38 user nova-compute[73917]:   <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:09:38 user nova-compute[73917]:   <nova:ports>
Aug 26 19:09:38 user nova-compute[73917]:     <nova:port uuid="0fd58968-f9e8-40f0-acff-8efea741379e">
Aug 26 19:09:38 user nova-compute[73917]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 19:09:38 user nova-compute[73917]:     </nova:port>
Aug 26 19:09:38 user nova-compute[73917]:     <nova:port uuid="27ca071c-c2bc-4907-a0fa-b48c52f62721">
Aug 26 19:09:38 user nova-compute[73917]:       <nova:ip type="fixed" address="10.10.10.177" ipVersion="4"/>
Aug 26 19:09:38 user nova-compute[73917]:     </nova:port>
Aug 26 19:09:38 user nova-compute[73917]:   </nova:ports>
Aug 26 19:09:38 user nova-compute[73917]: </nova:instance>
Aug 26 19:09:38 user nova-compute[73917]:  {{(pid=73917) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ffb55a5-b25c-4cf7-b66d-b8b4f2e02f35 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "interface-86937c34-db86-44a9-8196-3cae0d7ce400-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.668s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG nova.network.neutron [req-11dca1d0-17b5-4e1d-a36d-c3988d799cdd req-1be827a7-8e5d-4836-b976-3e48c4142f4a service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Updated VIF entry in instance network info cache for port 27ca071c-c2bc-4907-a0fa-b48c52f62721. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG nova.network.neutron [req-11dca1d0-17b5-4e1d-a36d-c3988d799cdd req-1be827a7-8e5d-4836-b976-3e48c4142f4a service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Updating instance_info_cache with network_info: [{"id": "0fd58968-f9e8-40f0-acff-8efea741379e", "address": "fa:16:3e:b3:2d:13", "network": {"id": "02545642-9a23-4d7d-8ff0-231150ea7ced", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2072904890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd58968-f9", "ovs_interfaceid": "0fd58968-f9e8-40f0-acff-8efea741379e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "address": "fa:16:3e:94:38:8b", "network": {"id": "42af97c0-edd6-4ebf-ae4d-fe4632ea7c95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1764354394", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ca071c-c2", "ovs_interfaceid": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-11dca1d0-17b5-4e1d-a36d-c3988d799cdd req-1be827a7-8e5d-4836-b976-3e48c4142f4a service nova] Releasing lock "refresh_cache-86937c34-db86-44a9-8196-3cae0d7ce400" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquiring lock "86937c34-db86-44a9-8196-3cae0d7ce400" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "86937c34-db86-44a9-8196-3cae0d7ce400" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG nova.objects.instance [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lazy-loading 'flavor' on Instance uuid 86937c34-db86-44a9-8196-3cae0d7ce400 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "86937c34-db86-44a9-8196-3cae0d7ce400" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquiring lock "86937c34-db86-44a9-8196-3cae0d7ce400" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "86937c34-db86-44a9-8196-3cae0d7ce400" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:39 user nova-compute[73917]: INFO nova.compute.manager [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Attaching volume 3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 to /dev/vdb
Aug 26 19:09:39 user nova-compute[73917]: DEBUG os_brick.utils [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c3325d-5c85-4b50-bdf4-a96d24d8f71c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[61154ef6-ebf5-4d71-bf97-99a3df67163f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fe0673-7c4b-403d-85d7-10b2633cda02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8e1074-7c75-4912-b2d2-69655d97740f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:09:39 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:09:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd10e7c-fd4e-42dc-9f04-c5be258627a3]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG os_brick.utils [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:39 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Updating existing volume attachment record: 09a2782f-93b7-4bf8-b835-1ce2f2e0eda2 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:09:40 user nova-compute[73917]: DEBUG nova.compute.manager [req-14c92ade-40d9-42ff-9731-dfee0550b6f7 req-8f64b280-4a70-4395-a565-be245cbbedc1 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received event network-vif-plugged-27ca071c-c2bc-4907-a0fa-b48c52f62721 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-14c92ade-40d9-42ff-9731-dfee0550b6f7 req-8f64b280-4a70-4395-a565-be245cbbedc1 service nova] Acquiring lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-14c92ade-40d9-42ff-9731-dfee0550b6f7 req-8f64b280-4a70-4395-a565-be245cbbedc1 service nova] Lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-14c92ade-40d9-42ff-9731-dfee0550b6f7 req-8f64b280-4a70-4395-a565-be245cbbedc1 service nova] Lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:40 user nova-compute[73917]: DEBUG nova.compute.manager [req-14c92ade-40d9-42ff-9731-dfee0550b6f7 req-8f64b280-4a70-4395-a565-be245cbbedc1 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] No waiting events found dispatching network-vif-plugged-27ca071c-c2bc-4907-a0fa-b48c52f62721 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:40 user nova-compute[73917]: WARNING nova.compute.manager [req-14c92ade-40d9-42ff-9731-dfee0550b6f7 req-8f64b280-4a70-4395-a565-be245cbbedc1 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received unexpected event network-vif-plugged-27ca071c-c2bc-4907-a0fa-b48c52f62721 for instance with vm_state active and task_state None.
Aug 26 19:09:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:43 user nova-compute[73917]: DEBUG nova.compute.manager [req-1601d29d-096b-4f57-9dd7-40d8eacb5c2c req-0af71b88-3940-402a-9829-3bafe3090478 service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] Received event network-changed-39a5bed1-340d-44b2-9312-9f797f781447 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:43 user nova-compute[73917]: DEBUG nova.compute.manager [req-1601d29d-096b-4f57-9dd7-40d8eacb5c2c req-0af71b88-3940-402a-9829-3bafe3090478 service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] Refreshing instance network info cache due to event network-changed-39a5bed1-340d-44b2-9312-9f797f781447. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:09:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1601d29d-096b-4f57-9dd7-40d8eacb5c2c req-0af71b88-3940-402a-9829-3bafe3090478 service nova] Acquiring lock "refresh_cache-c5120da8-5837-420f-b472-572a088a4a27" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:09:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1601d29d-096b-4f57-9dd7-40d8eacb5c2c req-0af71b88-3940-402a-9829-3bafe3090478 service nova] Acquired lock "refresh_cache-c5120da8-5837-420f-b472-572a088a4a27" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:09:43 user nova-compute[73917]: DEBUG nova.network.neutron [req-1601d29d-096b-4f57-9dd7-40d8eacb5c2c req-0af71b88-3940-402a-9829-3bafe3090478 service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] Refreshing network info cache for port 39a5bed1-340d-44b2-9312-9f797f781447 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:09:44 user nova-compute[73917]: DEBUG nova.network.neutron [req-1601d29d-096b-4f57-9dd7-40d8eacb5c2c req-0af71b88-3940-402a-9829-3bafe3090478 service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] Updated VIF entry in instance network info cache for port 39a5bed1-340d-44b2-9312-9f797f781447. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:09:44 user nova-compute[73917]: DEBUG nova.network.neutron [req-1601d29d-096b-4f57-9dd7-40d8eacb5c2c req-0af71b88-3940-402a-9829-3bafe3090478 service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] Updating instance_info_cache with network_info: [{"id": "39a5bed1-340d-44b2-9312-9f797f781447", "address": "fa:16:3e:41:f3:a7", "network": {"id": "5d4fd3f9-2b4a-4416-8eaf-b1ee0a23f8f0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-676704280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65039916cc424226be394dcb7abc714e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a5bed1-34", "ovs_interfaceid": "39a5bed1-340d-44b2-9312-9f797f781447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:09:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1601d29d-096b-4f57-9dd7-40d8eacb5c2c req-0af71b88-3940-402a-9829-3bafe3090478 service nova] Releasing lock "refresh_cache-c5120da8-5837-420f-b472-572a088a4a27" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mznEgDVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:46 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:46 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:46 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa4ff32-9dd3-4264-87b1-fe33d6b42bb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:09:46 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ebae35-f593-4dc5-a750-39ca3ff05915]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4] added
Aug 26 19:09:46 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d0e861-6f5c-42b9-a481-fa234b406a7c]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ba98ec-8d39-4bea-8abf-c7415b158f11]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mznEgDVt {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mznEgDVt" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff9aba5-7cd5-4017-a68d-b6989fd22ed0]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mznEgDVt'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e322ca-6506-46e4-9989-c407ff5b4384]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Acquiring lock "c5120da8-5837-420f-b472-572a088a4a27" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Lock "c5120da8-5837-420f-b472-572a088a4a27" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG nova.objects.instance [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Lazy-loading 'flavor' on Instance uuid c5120da8-5837-420f-b472-572a088a4a27 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[644f4810-ec0c-440f-a053-17cbe615de7e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:09:46 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:09:46 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Lock "c5120da8-5837-420f-b472-572a088a4a27" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[831d96a4-f230-48f4-98d2-c7114f7077d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4, portal: 172.16.0.220,3260]
Aug 26 19:09:46 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4, portal: 172.16.0.220,3260] successful.
Aug 26 19:09:46 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4197232-596d-4fdc-956a-f234e616c034]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[11044f9b-8918-46d7-9f11-56b152a39fa8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:09:46 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:46 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:09:46 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dbb3fa-f3e5-449b-9b1b-8fe522bb9023]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mznEgDVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Acquiring lock "c5120da8-5837-420f-b472-572a088a4a27" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Lock "c5120da8-5837-420f-b472-572a088a4a27" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:46 user nova-compute[73917]: INFO nova.compute.manager [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] [instance: c5120da8-5837-420f-b472-572a088a4a27] Attaching volume ceff3905-f670-40df-b459-ddc1a92890a5 to /dev/vdb
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.utils [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b238631c-a45c-4ef9-9947-a186ed585660]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dcf609-6dd1-4e03-90a4-224a5427d4d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf325c5b-cd4b-481f-99df-14c7b7e24432]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6aaf6d-6746-4acf-bead-220fe9b3cf3e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:09:46 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:09:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bdd3b0-274d-4ff4-b5bb-514eedf06960]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG os_brick.utils [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:46 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] [instance: c5120da8-5837-420f-b472-572a088a4a27] Updating existing volume attachment record: 633bbd41-618c-4ac7-8c80-3e5fc766e197 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:09:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23464356637353662', 'path': '/dev/sdj'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464356637353662', 'path': '/dev/sdj'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:09:47 user nova-compute[73917]: DEBUG nova.objects.instance [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lazy-loading 'flavor' on Instance uuid f019c6c6-e76f-4a75-8ba4-8c566d9f5791 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:09:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:09:47 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:09:47 user nova-compute[73917]:   <source dev="/dev/sdj"/>
Aug 26 19:09:47 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:09:47 user nova-compute[73917]:   <serial>c9c6466e-3525-42d6-8a7b-df107660ffd4</serial>
Aug 26 19:09:47 user nova-compute[73917]: </disk>
Aug 26 19:09:47 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:09:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:09:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:09:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] No VIF found with MAC fa:16:3e:90:3b:ae, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CHIgznjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:51 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:51 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:51 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc856c7-093f-44e7-9b60-461a46c87d23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:09:51 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba31503a-518f-4ae1-8f9f-9c2336de949d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170] added
Aug 26 19:09:51 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efa053f-5eb8-4f3e-be14-e9b1bfe2b845]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa9bfb7-d800-42c8-a5de-23aa327fe78c]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CHIgznjD {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CHIgznjD" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63e1377-71e1-4a26-9cc2-deadae7a0e45]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CHIgznjD'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[501a8e5c-42c8-4291-bce0-3c30b054e5cd]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3820c3-de06-469d-8a43-be00900cbc4c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:09:51 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:09:51 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f33a1c-3123-4279-b329-7085a00de6ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170, portal: 172.16.0.220,3260]
Aug 26 19:09:51 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170, portal: 172.16.0.220,3260] successful.
Aug 26 19:09:51 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26e506b-69cd-45d9-9238-6cebbcff56ca]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[89786d4a-beba-4d62-b679-820c23483570]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:09:51 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:51 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:09:51 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[926523e3-e337-4731-9fd0-175238f82b8f]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CHIgznjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:09:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b2b656ec-21de-4ad4-9c14-3482201f0080 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.436s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '23434613631353935', 'path': '/dev/sdk'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434613631353935', 'path': '/dev/sdk'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:09:52 user nova-compute[73917]: DEBUG nova.objects.instance [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lazy-loading 'flavor' on Instance uuid c8f0be92-c7bf-49cd-a4a4-23e625603081 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:09:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:09:52 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:09:52 user nova-compute[73917]:   <source dev="/dev/sdk"/>
Aug 26 19:09:52 user nova-compute[73917]:   <target dev="sdc" bus="scsi"/>
Aug 26 19:09:52 user nova-compute[73917]:   <serial>bb4f2fe8-9529-4c56-8d50-543771708170</serial>
Aug 26 19:09:52 user nova-compute[73917]:   <address type="drive" controller="0" unit="2"/>
Aug 26 19:09:52 user nova-compute[73917]: </disk>
Aug 26 19:09:52 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Acquiring lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG os_brick.utils [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d11ed1-e2ec-4ca2-be6d-25a9a863e067]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c35231-727b-4bf3-8290-bc7e0fef9b32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6be6b4-ec3e-4368-918e-97c33cb0560f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe56f3fc-ddb6-4d39-9cbd-9ed9c7b1db3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:09:53 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:09:53 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2064066-aa71-4c1d-9532-cf8852a1bac4]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG os_brick.utils [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] No BDM found with device name sda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:09:53 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] No VIF found with MAC fa:16:3e:be:0a:78, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:09:53 user nova-compute[73917]: INFO nova.compute.manager [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Swapping volume c9c6466e-3525-42d6-8a7b-df107660ffd4 for ebae4a7e-65a5-4ecc-b06d-450a84b90047
Aug 26 19:09:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-36015917-915f-41c3-bba8-c9a0d7a72db5 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "c8f0be92-c7bf-49cd-a4a4-23e625603081" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.829s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dhFzGETb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:54 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:54 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:54 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e22d7ed-75dd-468d-a68f-dd63cfd18b1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:09:54 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99388a7-1519-4df3-bcc4-4ef5d7b036b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0] added
Aug 26 19:09:54 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[de97a451-3588-4b19-882e-93665ca7bd36]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29daf5b-8a85-45e4-acd4-758e2236f3b9]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dhFzGETb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dhFzGETb" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbf6ac3-561b-477f-932e-39627097f0b7]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dhFzGETb'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3a3588-e3f7-4a2a-a046-ac773fd66577]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7940f020-0634-487b-bbab-eaf445fce8d1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:09:54 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:09:54 user nova-compute[73917]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 (non-flash)
Aug 26 19:09:54 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:54 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:54 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:54 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:54 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:54 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:54 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:09:54 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:09:54 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:09:54 user nova-compute[73917]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 (non-flash)
Aug 26 19:09:54 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:54 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:54 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:54 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:54 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:54 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:54 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:09:54 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Acquiring lock "c8f0be92-c7bf-49cd-a4a4-23e625603081" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "c8f0be92-c7bf-49cd-a4a4-23e625603081" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:54 user nova-compute[73917]: INFO nova.compute.manager [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Detaching volume bb4f2fe8-9529-4c56-8d50-543771708170
Aug 26 19:09:54 user nova-compute[73917]: INFO nova.virt.block_device [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Attempting to driver detach volume bb4f2fe8-9529-4c56-8d50-543771708170 from mountpoint /dev/sdc
Aug 26 19:09:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Attempting to detach device sdc from instance c8f0be92-c7bf-49cd-a4a4-23e625603081 from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:09:54 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:09:54 user nova-compute[73917]:   <source dev="/dev/sdk"/>
Aug 26 19:09:54 user nova-compute[73917]:   <target dev="sdc" bus="scsi"/>
Aug 26 19:09:54 user nova-compute[73917]:   <serial>bb4f2fe8-9529-4c56-8d50-543771708170</serial>
Aug 26 19:09:54 user nova-compute[73917]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 19:09:54 user nova-compute[73917]: </disk>
Aug 26 19:09:54 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:09:54 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Successfully detached device sdc from instance c8f0be92-c7bf-49cd-a4a4-23e625603081 from the persistent domain config.
Aug 26 19:09:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance c8f0be92-c7bf-49cd-a4a4-23e625603081 from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:09:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:09:54 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:09:54 user nova-compute[73917]:   <source dev="/dev/sdk"/>
Aug 26 19:09:54 user nova-compute[73917]:   <target dev="sdc" bus="scsi"/>
Aug 26 19:09:54 user nova-compute[73917]:   <serial>bb4f2fe8-9529-4c56-8d50-543771708170</serial>
Aug 26 19:09:54 user nova-compute[73917]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 19:09:54 user nova-compute[73917]: </disk>
Aug 26 19:09:54 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693076995.363823, c8f0be92-c7bf-49cd-a4a4-23e625603081 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance c8f0be92-c7bf-49cd-a4a4-23e625603081 {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:09:55 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Successfully detached device sdc from instance c8f0be92-c7bf-49cd-a4a4-23e625603081 from the live domain config.
Aug 26 19:09:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CHIgznjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:09:55 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:09:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 --login" returned: 0 in 1.134s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ca0de9-3077-4637-892f-86a45e5bef44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0, portal: 172.16.0.220,3260]
Aug 26 19:09:55 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0, portal: 172.16.0.220,3260] successful.
Aug 26 19:09:55 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62ece9e-7f31-4f8a-8534-a1aeeb5d974f]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c590d64-5659-422a-8b1d-e87f887f72e9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:09:55 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:09:55 user nova-compute[73917]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 (non-flash)
Aug 26 19:09:55 user nova-compute[73917]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 (non-flash)
Aug 26 19:09:55 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:55 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:55 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:55 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:55 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:55 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:55 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:09:55 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:09:55 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:09:55 user nova-compute[73917]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 (non-flash)
Aug 26 19:09:55 user nova-compute[73917]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 (non-flash)
Aug 26 19:09:55 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:55 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:55 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:55 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:55 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:55 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:55 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:09:55 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.435s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e641c08-4b18-45fb-b0c0-d45ba9e0fccf]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:09:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Connected to sdl using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dhFzGETb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-fd801f18-34b6-4682-8d43-edf82bd216c2" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-fd801f18-34b6-4682-8d43-edf82bd216c2" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.477s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] <== connect_volume: return (2479ms) {'type': 'block', 'scsi_wwn': '26335343465396265', 'path': '/dev/sdl'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335343465396265', 'path': '/dev/sdl'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.470s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG nova.objects.instance [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lazy-loading 'flavor' on Instance uuid 86937c34-db86-44a9-8196-3cae0d7ce400 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[61080868-4a2a-479b-8ebf-535256750d0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:09:56 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:09:56 user nova-compute[73917]:   <source dev="/dev/sdl"/>
Aug 26 19:09:56 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:09:56 user nova-compute[73917]:   <serial>3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0</serial>
Aug 26 19:09:56 user nova-compute[73917]: </disk>
Aug 26 19:09:56 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf61f991-b13c-46db-a6ad-57ad9426ec23]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:09:56 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:09:56 user nova-compute[73917]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 (non-flash)
Aug 26 19:09:56 user nova-compute[73917]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 (non-flash)
Aug 26 19:09:56 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:56 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:56 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:56 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:56 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:56 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:56 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:09:56 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:09:56 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:09:56 user nova-compute[73917]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 (non-flash)
Aug 26 19:09:56 user nova-compute[73917]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 (non-flash)
Aug 26 19:09:56 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:09:56 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:09:56 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:09:56 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:09:56 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:09:56 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:09:56 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:09:56 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b985ffac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170'): ({'sdk'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Removing single pathed devices sdk {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e9afa3-3420-4b2e-81dc-423e6928fa8f]: (4, ('path checker states:\nup                  10\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[025b64b6-adf7-4d88-9965-c85ab5461653]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Flushing IO for device /dev/sdk {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f6afda-ea4d-4e8c-a75e-01ffd6d5cbb4]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:09:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.047s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[086fde04-651e-4b4c-a0ba-d17efc98fca9]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] SCSI volumes sdk have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eed9c9c-b13a-4a30-90e8-91c465c1fd1c]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 --logout" returned: 0 in 0.102s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6eb6fa-5d0b-4542-9873-f8bf1a9ee8b3]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170, portal: 172.16.0.220,3260]
Aug 26 19:09:57 user nova-compute[73917]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170, portal: 172.16.0.220,3260] successful.
Aug 26 19:09:57 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb4f2fe8-9529-4c56-8d50-543771708170 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[953b2794-0dd6-48be-8442-fbf507ba8e08]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] <== disconnect_volume: return (1859ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Updating instance_info_cache with network_info: [{"id": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "address": "fa:16:3e:9c:f5:38", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b11e5e-5c", "ovs_interfaceid": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-fd801f18-34b6-4682-8d43-edf82bd216c2" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] No BDM found with device name hda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] No VIF found with MAC fa:16:3e:b3:2d:13, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:09:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG nova.objects.instance [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lazy-loading 'flavor' on Instance uuid c8f0be92-c7bf-49cd-a4a4-23e625603081 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c4f0f1c6-b124-4319-a76e-19e1c2e061d0 tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "c8f0be92-c7bf-49cd-a4a4-23e625603081" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.279s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-412ad13a-ff60-402c-9c84-736d6aee2583 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "86937c34-db86-44a9-8196-3cae0d7ce400" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.867s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Acquiring lock "c8f0be92-c7bf-49cd-a4a4-23e625603081" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "c8f0be92-c7bf-49cd-a4a4-23e625603081" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Acquiring lock "c8f0be92-c7bf-49cd-a4a4-23e625603081-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "c8f0be92-c7bf-49cd-a4a4-23e625603081-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "c8f0be92-c7bf-49cd-a4a4-23e625603081-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:58 user nova-compute[73917]: INFO nova.compute.manager [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Terminating instance
Aug 26 19:09:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG nova.compute.manager [req-23ef5d61-f812-4f14-98de-609153ed7ddc req-849cc2ba-931f-4de9-bb27-f5bfc1e7a4c7 service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Received event network-vif-unplugged-c20cdde4-5ebd-4878-8eb2-4c62493255b9 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-23ef5d61-f812-4f14-98de-609153ed7ddc req-849cc2ba-931f-4de9-bb27-f5bfc1e7a4c7 service nova] Acquiring lock "c8f0be92-c7bf-49cd-a4a4-23e625603081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-23ef5d61-f812-4f14-98de-609153ed7ddc req-849cc2ba-931f-4de9-bb27-f5bfc1e7a4c7 service nova] Lock "c8f0be92-c7bf-49cd-a4a4-23e625603081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-23ef5d61-f812-4f14-98de-609153ed7ddc req-849cc2ba-931f-4de9-bb27-f5bfc1e7a4c7 service nova] Lock "c8f0be92-c7bf-49cd-a4a4-23e625603081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG nova.compute.manager [req-23ef5d61-f812-4f14-98de-609153ed7ddc req-849cc2ba-931f-4de9-bb27-f5bfc1e7a4c7 service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] No waiting events found dispatching network-vif-unplugged-c20cdde4-5ebd-4878-8eb2-4c62493255b9 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG nova.compute.manager [req-23ef5d61-f812-4f14-98de-609153ed7ddc req-849cc2ba-931f-4de9-bb27-f5bfc1e7a4c7 service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Received event network-vif-unplugged-c20cdde4-5ebd-4878-8eb2-4c62493255b9 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:09:59 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Instance destroyed successfully.
Aug 26 19:09:59 user nova-compute[73917]: DEBUG nova.objects.instance [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lazy-loading 'resources' on Instance uuid c8f0be92-c7bf-49cd-a4a4-23e625603081 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:07:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1997346454',display_name='tempest-AttachSCSIVolumeTestJSON-server-1997346454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1997346454',id=9,image_ref='ab083d8d-3182-45d9-8920-1dd347b48cc6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtjTaeOhyu8EWv2fQ3T3febpsPDq6N+PyebXfl7/hvsL2VUPTa9SI7ckbetaovnCB7kLf1GeMIjYjkCyX4h8LsJ19EHnl2ixE+OKo6y1QBsVTCYHAq6NFvbTHMYhHPUVw==',key_name='tempest-keypair-1697502471',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ef2cfaaccb74aa1b6754a79dafbbfde',ramdisk_id='',reservation_id='r-0oflxl38',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ab083d8d-3182-45d9-8920-1dd347b48cc6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-770014971',owner_user_name='tempest-AttachSCSIVolumeTestJSON-770014971-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f51ff450150246de99a05ea52cacd147',uuid=c8f0be92-c7bf-49cd-a4a4-23e625603081,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "address": "fa:16:3e:be:0a:78", "network": {"id": "fef455a2-e475-421b-8d21-6ffa2b400885", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-784820277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef2cfaaccb74aa1b6754a79dafbbfde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20cdde4-5e", "ovs_interfaceid": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Converting VIF {"id": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "address": "fa:16:3e:be:0a:78", "network": {"id": "fef455a2-e475-421b-8d21-6ffa2b400885", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-784820277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef2cfaaccb74aa1b6754a79dafbbfde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20cdde4-5e", "ovs_interfaceid": "c20cdde4-5ebd-4878-8eb2-4c62493255b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:0a:78,bridge_name='br-int',has_traffic_filtering=True,id=c20cdde4-5ebd-4878-8eb2-4c62493255b9,network=Network(fef455a2-e475-421b-8d21-6ffa2b400885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20cdde4-5e') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG os_vif [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:0a:78,bridge_name='br-int',has_traffic_filtering=True,id=c20cdde4-5ebd-4878-8eb2-4c62493255b9,network=Network(fef455a2-e475-421b-8d21-6ffa2b400885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20cdde4-5e') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc20cdde4-5e, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:59 user nova-compute[73917]: INFO os_vif [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:0a:78,bridge_name='br-int',has_traffic_filtering=True,id=c20cdde4-5ebd-4878-8eb2-4c62493255b9,network=Network(fef455a2-e475-421b-8d21-6ffa2b400885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20cdde4-5e')
Aug 26 19:09:59 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Deleting instance files /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081_del
Aug 26 19:09:59 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Deletion of /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081_del complete
Aug 26 19:09:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdl (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:09:59 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000009, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/c8f0be92-c7bf-49cd-a4a4-23e625603081/disk
Aug 26 19:09:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:09:59 user nova-compute[73917]: INFO nova.compute.manager [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 26 19:09:59 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:09:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquiring lock "86937c34-db86-44a9-8196-3cae0d7ce400" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "86937c34-db86-44a9-8196-3cae0d7ce400" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:00 user nova-compute[73917]: INFO nova.compute.manager [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Detaching volume 3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0
Aug 26 19:10:00 user nova-compute[73917]: INFO nova.virt.block_device [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Attempting to driver detach volume 3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 from mountpoint /dev/vdb
Aug 26 19:10:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Attempting to detach device vdb from instance 86937c34-db86-44a9-8196-3cae0d7ce400 from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:10:00 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:10:00 user nova-compute[73917]:   <source dev="/dev/sdl"/>
Aug 26 19:10:00 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:10:00 user nova-compute[73917]:   <serial>3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0</serial>
Aug 26 19:10:00 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 19:10:00 user nova-compute[73917]: </disk>
Aug 26 19:10:00 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:10:00 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Successfully detached device vdb from instance 86937c34-db86-44a9-8196-3cae0d7ce400 from the persistent domain config.
Aug 26 19:10:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86937c34-db86-44a9-8196-3cae0d7ce400 from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:10:00 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:10:00 user nova-compute[73917]:   <source dev="/dev/sdl"/>
Aug 26 19:10:00 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:10:00 user nova-compute[73917]:   <serial>3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0</serial>
Aug 26 19:10:00 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 19:10:00 user nova-compute[73917]: </disk>
Aug 26 19:10:00 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693077000.55207, 86937c34-db86-44a9-8196-3cae0d7ce400 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86937c34-db86-44a9-8196-3cae0d7ce400 {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:10:00 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Successfully detached device vdb from instance 86937c34-db86-44a9-8196-3cae0d7ce400 from the live domain config.
Aug 26 19:10:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dhFzGETb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:10:00 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:10:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c24b8b-8de1-4a3a-99d6-3cce520e19e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[821f47ac-47fc-4220-a155-9d105c463e2c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:00 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:10:00 user nova-compute[73917]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 (non-flash)
Aug 26 19:10:00 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:00 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:00 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:00 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:00 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:00 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:00 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:00 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:00 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:10:00 user nova-compute[73917]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 (non-flash)
Aug 26 19:10:00 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:00 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:00 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:00 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:00 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:00 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:00 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:00 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b985d93f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0'): ({'sdl'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Removing single pathed devices sdl {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb4a8b1-3112-4a4d-a84e-f11b3ce9569d]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.060s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be43e58-5d67-4336-a976-289e3a78ee0c]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Flushing IO for device /dev/sdl {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b83e52f-f7d0-4713-9e02-2c114ee98362]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.043s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0a4eb7-e2c5-494d-8ef0-b7f2555ef0c5]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] SCSI volumes sdl have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c5f431-0019-4c28-8a2a-75b47d9220c2]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:10:00 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Took 1.12 seconds to deallocate network for instance.
Aug 26 19:10:00 user nova-compute[73917]: DEBUG nova.compute.manager [req-a5676acc-0822-4266-a700-ed6f5a0b3a5e req-88cb8886-bfaf-4558-9184-611f5f064286 service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Received event network-vif-deleted-c20cdde4-5ebd-4878-8eb2-4c62493255b9 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac90552-4991-4e7e-9272-e1aabc8dca0d]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0, portal: 172.16.0.220,3260]
Aug 26 19:10:00 user nova-compute[73917]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0, portal: 172.16.0.220,3260] successful.
Aug 26 19:10:00 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bce3fcf-d31f-4e1b-b96d-e690c25cd8e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5ad069-68b7-4625-8c0e-8dc9dec283d3]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] <== disconnect_volume: return (439ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] [instance: c5120da8-5837-420f-b472-572a088a4a27] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jZOYHtyV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:10:01 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:10:01 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:10:01 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f4c494-6843-4b08-98e6-9d63c75a09a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:10:01 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4556926-8f69-4561-a4f6-582d4e66b381]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5] added
Aug 26 19:10:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[504f8bae-cbd1-475a-b280-db4ac44aea54]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[106f51d9-d774-4d49-b0a3-4d62059b662d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jZOYHtyV {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jZOYHtyV" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ede7a99-455f-4f8f-bfba-94ae7db66851]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jZOYHtyV'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1a92d1-47b0-4948-9eb1-1e97f8193eab]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3451f73b-92ef-453c-83e8-576d9090f965]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.572s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG nova.compute.manager [req-436b47cf-1573-4875-82b1-1266a6cbde17 req-a7f19850-963a-4598-9f8e-206d2bf01d8f service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Received event network-vif-plugged-c20cdde4-5ebd-4878-8eb2-4c62493255b9 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-436b47cf-1573-4875-82b1-1266a6cbde17 req-a7f19850-963a-4598-9f8e-206d2bf01d8f service nova] Acquiring lock "c8f0be92-c7bf-49cd-a4a4-23e625603081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-436b47cf-1573-4875-82b1-1266a6cbde17 req-a7f19850-963a-4598-9f8e-206d2bf01d8f service nova] Lock "c8f0be92-c7bf-49cd-a4a4-23e625603081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-436b47cf-1573-4875-82b1-1266a6cbde17 req-a7f19850-963a-4598-9f8e-206d2bf01d8f service nova] Lock "c8f0be92-c7bf-49cd-a4a4-23e625603081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG nova.compute.manager [req-436b47cf-1573-4875-82b1-1266a6cbde17 req-a7f19850-963a-4598-9f8e-206d2bf01d8f service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] No waiting events found dispatching network-vif-plugged-c20cdde4-5ebd-4878-8eb2-4c62493255b9 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:10:01 user nova-compute[73917]: WARNING nova.compute.manager [req-436b47cf-1573-4875-82b1-1266a6cbde17 req-a7f19850-963a-4598-9f8e-206d2bf01d8f service nova] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Received unexpected event network-vif-plugged-c20cdde4-5ebd-4878-8eb2-4c62493255b9 for instance with vm_state deleted and task_state None.
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eed2701-b589-4c5c-b4d4-0f4d24d099eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5, portal: 172.16.0.220,3260]
Aug 26 19:10:01 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5, portal: 172.16.0.220,3260] successful.
Aug 26 19:10:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:01 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Deleted allocations for instance c8f0be92-c7bf-49cd-a4a4-23e625603081
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b2b9f1-5177-4ad7-9e73-298cd9194323]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cae68a4-07e4-4c8f-b414-913b6f2bbc6c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:01 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.402s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] HCTL ('42', '-', '-', 0) found on session 14 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2707748-67f9-41b8-9093-b335cf477c31]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Searching for a device in session 14 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jZOYHtyV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9707a4e1-5f0b-41ce-96f0-19842cf9e58d tempest-AttachSCSIVolumeTestJSON-770014971 tempest-AttachSCSIVolumeTestJSON-770014971-project-member] Lock "c8f0be92-c7bf-49cd-a4a4-23e625603081" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.972s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG nova.objects.instance [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lazy-loading 'flavor' on Instance uuid 86937c34-db86-44a9-8196-3cae0d7ce400 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-42d54cd1-8658-40a0-8798-246a08c76fc1 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "86937c34-db86-44a9-8196-3cae0d7ce400" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.983s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.576s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] <== connect_volume: return (1579ms) {'type': 'block', 'scsi_wwn': '23364613931636562', 'path': '/dev/sdk'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] [instance: c5120da8-5837-420f-b472-572a088a4a27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364613931636562', 'path': '/dev/sdk'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:10:02 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:10:02 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=6556MB free_disk=25.48556137084961GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquiring lock "interface-86937c34-db86-44a9-8196-3cae0d7ce400-27ca071c-c2bc-4907-a0fa-b48c52f62721" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "interface-86937c34-db86-44a9-8196-3cae0d7ce400-27ca071c-c2bc-4907-a0fa-b48c52f62721" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.objects.instance [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Lazy-loading 'flavor' on Instance uuid c5120da8-5837-420f-b472-572a088a4a27 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.objects.instance [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lazy-loading 'flavor' on Instance uuid 86937c34-db86-44a9-8196-3cae0d7ce400 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152870467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1152870467',id=10,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh0Gq1qVrt69OKjzmbhUuqTEU+L2JyHLQ3aEGP1I2l94+VWUqaxZlu45tMYdws2tmkIV0iudsUfn6jRdBXdutT2e0DfOoTHtyHz97pVCSRiDLTiyRN8NsP3m644FqnDUA==',key_name='tempest-keypair-2122776356',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cec3e3b818b54192b32d90bb8240515e',ramdisk_id='',reservation_id='r-8k2gu0ce',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1228202789',owner_user_name='tempest-TaggedAttachmentsTest-1228202789-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e883bb35273c4f9cacdc443695962e5d',uuid=86937c34-db86-44a9-8196-3cae0d7ce400,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "address": "fa:16:3e:94:38:8b", "network": {"id": "42af97c0-edd6-4ebf-ae4d-fe4632ea7c95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1764354394", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ca071c-c2", "ovs_interfaceid": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Converting VIF {"id": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "address": "fa:16:3e:94:38:8b", "network": {"id": "42af97c0-edd6-4ebf-ae4d-fe4632ea7c95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1764354394", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ca071c-c2", "ovs_interfaceid": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:38:8b,bridge_name='br-int',has_traffic_filtering=True,id=27ca071c-c2bc-4907-a0fa-b48c52f62721,network=Network(42af97c0-edd6-4ebf-ae4d-fe4632ea7c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27ca071c-c2') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] attach device xml: <disk type="block" device="disk">
Aug 26 19:10:02 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:10:02 user nova-compute[73917]:   <source dev="/dev/sdk"/>
Aug 26 19:10:02 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:10:02 user nova-compute[73917]:   <serial>ceff3905-f670-40df-b459-ddc1a92890a5</serial>
Aug 26 19:10:02 user nova-compute[73917]: </disk>
Aug 26 19:10:02 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:94:38:8b"/><model type="virtio"/><mtu size="1442"/><target dev="tap27ca071c-c2"/></interface> {{(pid=73917) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:94:38:8b"/><model type="virtio"/><mtu size="1442"/><target dev="tap27ca071c-c2"/></interface> {{(pid=73917) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Attempting to detach device tap27ca071c-c2 from instance 86937c34-db86-44a9-8196-3cae0d7ce400 from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] detach device xml: <interface type="ethernet">
Aug 26 19:10:02 user nova-compute[73917]:   <mac address="fa:16:3e:94:38:8b"/>
Aug 26 19:10:02 user nova-compute[73917]:   <model type="virtio"/>
Aug 26 19:10:02 user nova-compute[73917]:   <mtu size="1442"/>
Aug 26 19:10:02 user nova-compute[73917]:   <target dev="tap27ca071c-c2"/>
Aug 26 19:10:02 user nova-compute[73917]: </interface>
Aug 26 19:10:02 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:94:38:8b"/><model type="virtio"/><mtu size="1442"/><target dev="tap27ca071c-c2"/></interface> {{(pid=73917) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:94:38:8b"/><model type="virtio"/><mtu size="1442"/><target dev="tap27ca071c-c2"/></interface>not found in domain: <domain type='kvm' id='10'>
Aug 26 19:10:02 user nova-compute[73917]:   <name>instance-0000000a</name>
Aug 26 19:10:02 user nova-compute[73917]:   <uuid>86937c34-db86-44a9-8196-3cae0d7ce400</uuid>
Aug 26 19:10:02 user nova-compute[73917]:   <metadata>
Aug 26 19:10:02 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:10:02 user nova-compute[73917]:   <nova:package version="0.0.0"/>
Aug 26 19:10:02 user nova-compute[73917]:   <nova:name>tempest-device-tagging-server-1152870467</nova:name>
Aug 26 19:10:02 user nova-compute[73917]:   <nova:creationTime>2023-08-26 19:09:38</nova:creationTime>
Aug 26 19:10:02 user nova-compute[73917]:   <nova:flavor name="m1.tiny">
Aug 26 19:10:02 user nova-compute[73917]:     <nova:memory>512</nova:memory>
Aug 26 19:10:02 user nova-compute[73917]:     <nova:disk>1</nova:disk>
Aug 26 19:10:02 user nova-compute[73917]:     <nova:swap>0</nova:swap>
Aug 26 19:10:02 user nova-compute[73917]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:10:02 user nova-compute[73917]:     <nova:vcpus>1</nova:vcpus>
Aug 26 19:10:02 user nova-compute[73917]:   </nova:flavor>
Aug 26 19:10:02 user nova-compute[73917]:   <nova:owner>
Aug 26 19:10:02 user nova-compute[73917]:     <nova:user uuid="e883bb35273c4f9cacdc443695962e5d">tempest-TaggedAttachmentsTest-1228202789-project-member</nova:user>
Aug 26 19:10:02 user nova-compute[73917]:     <nova:project uuid="cec3e3b818b54192b32d90bb8240515e">tempest-TaggedAttachmentsTest-1228202789</nova:project>
Aug 26 19:10:02 user nova-compute[73917]:   </nova:owner>
Aug 26 19:10:02 user nova-compute[73917]:   <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:10:02 user nova-compute[73917]:   <nova:ports>
Aug 26 19:10:02 user nova-compute[73917]:     <nova:port uuid="0fd58968-f9e8-40f0-acff-8efea741379e">
Aug 26 19:10:02 user nova-compute[73917]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 19:10:02 user nova-compute[73917]:     </nova:port>
Aug 26 19:10:02 user nova-compute[73917]:     <nova:port uuid="27ca071c-c2bc-4907-a0fa-b48c52f62721">
Aug 26 19:10:02 user nova-compute[73917]:       <nova:ip type="fixed" address="10.10.10.177" ipVersion="4"/>
Aug 26 19:10:02 user nova-compute[73917]:     </nova:port>
Aug 26 19:10:02 user nova-compute[73917]:   </nova:ports>
Aug 26 19:10:02 user nova-compute[73917]: </nova:instance>
Aug 26 19:10:02 user nova-compute[73917]:   </metadata>
Aug 26 19:10:02 user nova-compute[73917]:   <memory unit='KiB'>524288</memory>
Aug 26 19:10:02 user nova-compute[73917]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 19:10:02 user nova-compute[73917]:   <vcpu placement='static'>1</vcpu>
Aug 26 19:10:02 user nova-compute[73917]:   <resource>
Aug 26 19:10:02 user nova-compute[73917]:     <partition>/machine</partition>
Aug 26 19:10:02 user nova-compute[73917]:   </resource>
Aug 26 19:10:02 user nova-compute[73917]:   <sysinfo type='smbios'>
Aug 26 19:10:02 user nova-compute[73917]:     <system>
Aug 26 19:10:02 user nova-compute[73917]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 19:10:02 user nova-compute[73917]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 19:10:02 user nova-compute[73917]:       <entry name='version'>0.0.0</entry>
Aug 26 19:10:02 user nova-compute[73917]:       <entry name='serial'>86937c34-db86-44a9-8196-3cae0d7ce400</entry>
Aug 26 19:10:02 user nova-compute[73917]:       <entry name='uuid'>86937c34-db86-44a9-8196-3cae0d7ce400</entry>
Aug 26 19:10:02 user nova-compute[73917]:       <entry name='family'>Virtual Machine</entry>
Aug 26 19:10:02 user nova-compute[73917]:     </system>
Aug 26 19:10:02 user nova-compute[73917]:   </sysinfo>
Aug 26 19:10:02 user nova-compute[73917]:   <os>
Aug 26 19:10:02 user nova-compute[73917]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 19:10:02 user nova-compute[73917]:     <boot dev='hd'/>
Aug 26 19:10:02 user nova-compute[73917]:     <smbios mode='sysinfo'/>
Aug 26 19:10:02 user nova-compute[73917]:   </os>
Aug 26 19:10:02 user nova-compute[73917]:   <features>
Aug 26 19:10:02 user nova-compute[73917]:     <acpi/>
Aug 26 19:10:02 user nova-compute[73917]:     <apic/>
Aug 26 19:10:02 user nova-compute[73917]:     <vmcoreinfo state='on'/>
Aug 26 19:10:02 user nova-compute[73917]:   </features>
Aug 26 19:10:02 user nova-compute[73917]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 19:10:02 user nova-compute[73917]:     <model fallback='forbid'>Nehalem</model>
Aug 26 19:10:02 user nova-compute[73917]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 19:10:02 user nova-compute[73917]:     <feature policy='require' name='vme'/>
Aug 26 19:10:02 user nova-compute[73917]:     <feature policy='require' name='x2apic'/>
Aug 26 19:10:02 user nova-compute[73917]:     <feature policy='require' name='hypervisor'/>
Aug 26 19:10:02 user nova-compute[73917]:   </cpu>
Aug 26 19:10:02 user nova-compute[73917]:   <clock offset='utc'>
Aug 26 19:10:02 user nova-compute[73917]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 19:10:02 user nova-compute[73917]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 19:10:02 user nova-compute[73917]:     <timer name='hpet' present='no'/>
Aug 26 19:10:02 user nova-compute[73917]:   </clock>
Aug 26 19:10:02 user nova-compute[73917]:   <on_poweroff>destroy</on_poweroff>
Aug 26 19:10:02 user nova-compute[73917]:   <on_reboot>restart</on_reboot>
Aug 26 19:10:02 user nova-compute[73917]:   <on_crash>destroy</on_crash>
Aug 26 19:10:02 user nova-compute[73917]:   <devices>
Aug 26 19:10:02 user nova-compute[73917]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 19:10:02 user nova-compute[73917]:     <disk type='file' device='disk'>
Aug 26 19:10:02 user nova-compute[73917]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 19:10:02 user nova-compute[73917]:       <source file='/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk' index='2'/>
Aug 26 19:10:02 user nova-compute[73917]:       <backingStore type='file' index='3'>
Aug 26 19:10:02 user nova-compute[73917]:         <format type='raw'/>
Aug 26 19:10:02 user nova-compute[73917]:         <source file='/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2'/>
Aug 26 19:10:02 user nova-compute[73917]:         <backingStore/>
Aug 26 19:10:02 user nova-compute[73917]:       </backingStore>
Aug 26 19:10:02 user nova-compute[73917]:       <target dev='vda' bus='virtio'/>
Aug 26 19:10:02 user nova-compute[73917]:       <alias name='virtio-disk0'/>
Aug 26 19:10:02 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 19:10:02 user nova-compute[73917]:     </disk>
Aug 26 19:10:02 user nova-compute[73917]:     <disk type='file' device='cdrom'>
Aug 26 19:10:02 user nova-compute[73917]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 19:10:02 user nova-compute[73917]:       <source file='/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk.config' index='1'/>
Aug 26 19:10:02 user nova-compute[73917]:       <backingStore/>
Aug 26 19:10:02 user nova-compute[73917]:       <target dev='hda' bus='ide'/>
Aug 26 19:10:02 user nova-compute[73917]:       <readonly/>
Aug 26 19:10:02 user nova-compute[73917]:       <alias name='ide0-0-0'/>
Aug 26 19:10:02 user nova-compute[73917]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 19:10:02 user nova-compute[73917]:     </disk>
Aug 26 19:10:02 user nova-compute[73917]:     <controller type='usb' index='0' model='none'>
Aug 26 19:10:02 user nova-compute[73917]:       <alias name='usb'/>
Aug 26 19:10:02 user nova-compute[73917]:     </controller>
Aug 26 19:10:02 user nova-compute[73917]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 19:10:02 user nova-compute[73917]:       <alias name='pci.0'/>
Aug 26 19:10:02 user nova-compute[73917]:     </controller>
Aug 26 19:10:02 user nova-compute[73917]:     <controller type='ide' index='0'>
Aug 26 19:10:02 user nova-compute[73917]:       <alias name='ide'/>
Aug 26 19:10:02 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 19:10:02 user nova-compute[73917]:     </controller>
Aug 26 19:10:02 user nova-compute[73917]:     <interface type='ethernet'>
Aug 26 19:10:02 user nova-compute[73917]:       <mac address='fa:16:3e:b3:2d:13'/>
Aug 26 19:10:02 user nova-compute[73917]:       <target dev='tap0fd58968-f9'/>
Aug 26 19:10:02 user nova-compute[73917]:       <model type='virtio'/>
Aug 26 19:10:02 user nova-compute[73917]:       <mtu size='1442'/>
Aug 26 19:10:02 user nova-compute[73917]:       <alias name='net0'/>
Aug 26 19:10:02 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 19:10:02 user nova-compute[73917]:     </interface>
Aug 26 19:10:02 user nova-compute[73917]:     <interface type='ethernet'>
Aug 26 19:10:02 user nova-compute[73917]:       <mac address='fa:16:3e:94:38:8b'/>
Aug 26 19:10:02 user nova-compute[73917]:       <target dev='tap27ca071c-c2'/>
Aug 26 19:10:02 user nova-compute[73917]:       <model type='virtio'/>
Aug 26 19:10:02 user nova-compute[73917]:       <mtu size='1442'/>
Aug 26 19:10:02 user nova-compute[73917]:       <alias name='net1'/>
Aug 26 19:10:02 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 26 19:10:02 user nova-compute[73917]:     </interface>
Aug 26 19:10:02 user nova-compute[73917]:     <serial type='pty'>
Aug 26 19:10:02 user nova-compute[73917]:       <source path='/dev/pts/9'/>
Aug 26 19:10:02 user nova-compute[73917]:       <log file='/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/console.log' append='off'/>
Aug 26 19:10:02 user nova-compute[73917]:       <target type='isa-serial' port='0'>
Aug 26 19:10:02 user nova-compute[73917]:         <model name='isa-serial'/>
Aug 26 19:10:02 user nova-compute[73917]:       </target>
Aug 26 19:10:02 user nova-compute[73917]:       <alias name='serial0'/>
Aug 26 19:10:02 user nova-compute[73917]:     </serial>
Aug 26 19:10:02 user nova-compute[73917]:     <console type='pty' tty='/dev/pts/9'>
Aug 26 19:10:02 user nova-compute[73917]:       <source path='/dev/pts/9'/>
Aug 26 19:10:02 user nova-compute[73917]:       <log file='/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/console.log' append='off'/>
Aug 26 19:10:02 user nova-compute[73917]:       <target type='serial' port='0'/>
Aug 26 19:10:02 user nova-compute[73917]:       <alias name='serial0'/>
Aug 26 19:10:02 user nova-compute[73917]:     </console>
Aug 26 19:10:02 user nova-compute[73917]:     <input type='mouse' bus='ps2'>
Aug 26 19:10:02 user nova-compute[73917]:       <alias name='input0'/>
Aug 26 19:10:02 user nova-compute[73917]:     </input>
Aug 26 19:10:02 user nova-compute[73917]:     <input type='keyboard' bus='ps2'>
Aug 26 19:10:02 user nova-compute[73917]:       <alias name='input1'/>
Aug 26 19:10:02 user nova-compute[73917]:     </input>
Aug 26 19:10:02 user nova-compute[73917]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Aug 26 19:10:02 user nova-compute[73917]:       <listen type='address' address='0.0.0.0'/>
Aug 26 19:10:02 user nova-compute[73917]:     </graphics>
Aug 26 19:10:02 user nova-compute[73917]:     <audio id='1' type='none'/>
Aug 26 19:10:02 user nova-compute[73917]:     <video>
Aug 26 19:10:02 user nova-compute[73917]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 19:10:02 user nova-compute[73917]:       <alias name='video0'/>
Aug 26 19:10:02 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 19:10:02 user nova-compute[73917]:     </video>
Aug 26 19:10:02 user nova-compute[73917]:     <memballoon model='virtio'>
Aug 26 19:10:02 user nova-compute[73917]:       <stats period='10'/>
Aug 26 19:10:02 user nova-compute[73917]:       <alias name='balloon0'/>
Aug 26 19:10:02 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 19:10:02 user nova-compute[73917]:     </memballoon>
Aug 26 19:10:02 user nova-compute[73917]:     <rng model='virtio'>
Aug 26 19:10:02 user nova-compute[73917]:       <backend model='random'>/dev/urandom</backend>
Aug 26 19:10:02 user nova-compute[73917]:       <alias name='rng0'/>
Aug 26 19:10:02 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 19:10:02 user nova-compute[73917]:     </rng>
Aug 26 19:10:02 user nova-compute[73917]:   </devices>
Aug 26 19:10:02 user nova-compute[73917]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 19:10:02 user nova-compute[73917]:     <label>libvirt-86937c34-db86-44a9-8196-3cae0d7ce400</label>
Aug 26 19:10:02 user nova-compute[73917]:     <imagelabel>libvirt-86937c34-db86-44a9-8196-3cae0d7ce400</imagelabel>
Aug 26 19:10:02 user nova-compute[73917]:   </seclabel>
Aug 26 19:10:02 user nova-compute[73917]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 19:10:02 user nova-compute[73917]:     <label>+64055:+108</label>
Aug 26 19:10:02 user nova-compute[73917]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 19:10:02 user nova-compute[73917]:   </seclabel>
Aug 26 19:10:02 user nova-compute[73917]: </domain>
Aug 26 19:10:02 user nova-compute[73917]:  {{(pid=73917) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 19:10:02 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Successfully detached device tap27ca071c-c2 from instance 86937c34-db86-44a9-8196-3cae0d7ce400 from the persistent domain config.
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] (1/8): Attempting to detach device tap27ca071c-c2 with device alias net1 from instance 86937c34-db86-44a9-8196-3cae0d7ce400 from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] detach device xml: <interface type="ethernet">
Aug 26 19:10:02 user nova-compute[73917]:   <mac address="fa:16:3e:94:38:8b"/>
Aug 26 19:10:02 user nova-compute[73917]:   <model type="virtio"/>
Aug 26 19:10:02 user nova-compute[73917]:   <mtu size="1442"/>
Aug 26 19:10:02 user nova-compute[73917]:   <target dev="tap27ca071c-c2"/>
Aug 26 19:10:02 user nova-compute[73917]: </interface>
Aug 26 19:10:02 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 5dd60c10-f99a-431d-a66f-936a7a7a1c55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance cc0ae046-2a39-4ab6-9327-2d9452c3035d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fd801f18-34b6-4682-8d43-edf82bd216c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fdfb377e-119e-41ce-b9e0-6e21053306cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f019c6c6-e76f-4a75-8ba4-8c566d9f5791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 86937c34-db86-44a9-8196-3cae0d7ce400 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c5120da8-5837-420f-b472-572a088a4a27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 54fd570d-421c-4a39-b4ae-772500b24cec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 2e449059-38d9-40bb-aa04-8b6c3865309b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:10:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693077003.2444296, 86937c34-db86-44a9-8196-3cae0d7ce400 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Start waiting for the detach event from libvirt for device tap27ca071c-c2 with device alias net1 for instance 86937c34-db86-44a9-8196-3cae0d7ce400 {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:94:38:8b"/><model type="virtio"/><mtu size="1442"/><target dev="tap27ca071c-c2"/></interface> {{(pid=73917) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:94:38:8b"/><model type="virtio"/><mtu size="1442"/><target dev="tap27ca071c-c2"/></interface>not found in domain: <domain type='kvm' id='10'>
Aug 26 19:10:03 user nova-compute[73917]:   <name>instance-0000000a</name>
Aug 26 19:10:03 user nova-compute[73917]:   <uuid>86937c34-db86-44a9-8196-3cae0d7ce400</uuid>
Aug 26 19:10:03 user nova-compute[73917]:   <metadata>
Aug 26 19:10:03 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:10:03 user nova-compute[73917]:   <nova:package version="0.0.0"/>
Aug 26 19:10:03 user nova-compute[73917]:   <nova:name>tempest-device-tagging-server-1152870467</nova:name>
Aug 26 19:10:03 user nova-compute[73917]:   <nova:creationTime>2023-08-26 19:09:38</nova:creationTime>
Aug 26 19:10:03 user nova-compute[73917]:   <nova:flavor name="m1.tiny">
Aug 26 19:10:03 user nova-compute[73917]:     <nova:memory>512</nova:memory>
Aug 26 19:10:03 user nova-compute[73917]:     <nova:disk>1</nova:disk>
Aug 26 19:10:03 user nova-compute[73917]:     <nova:swap>0</nova:swap>
Aug 26 19:10:03 user nova-compute[73917]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:10:03 user nova-compute[73917]:     <nova:vcpus>1</nova:vcpus>
Aug 26 19:10:03 user nova-compute[73917]:   </nova:flavor>
Aug 26 19:10:03 user nova-compute[73917]:   <nova:owner>
Aug 26 19:10:03 user nova-compute[73917]:     <nova:user uuid="e883bb35273c4f9cacdc443695962e5d">tempest-TaggedAttachmentsTest-1228202789-project-member</nova:user>
Aug 26 19:10:03 user nova-compute[73917]:     <nova:project uuid="cec3e3b818b54192b32d90bb8240515e">tempest-TaggedAttachmentsTest-1228202789</nova:project>
Aug 26 19:10:03 user nova-compute[73917]:   </nova:owner>
Aug 26 19:10:03 user nova-compute[73917]:   <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:10:03 user nova-compute[73917]:   <nova:ports>
Aug 26 19:10:03 user nova-compute[73917]:     <nova:port uuid="0fd58968-f9e8-40f0-acff-8efea741379e">
Aug 26 19:10:03 user nova-compute[73917]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 19:10:03 user nova-compute[73917]:     </nova:port>
Aug 26 19:10:03 user nova-compute[73917]:     <nova:port uuid="27ca071c-c2bc-4907-a0fa-b48c52f62721">
Aug 26 19:10:03 user nova-compute[73917]:       <nova:ip type="fixed" address="10.10.10.177" ipVersion="4"/>
Aug 26 19:10:03 user nova-compute[73917]:     </nova:port>
Aug 26 19:10:03 user nova-compute[73917]:   </nova:ports>
Aug 26 19:10:03 user nova-compute[73917]: </nova:instance>
Aug 26 19:10:03 user nova-compute[73917]:   </metadata>
Aug 26 19:10:03 user nova-compute[73917]:   <memory unit='KiB'>524288</memory>
Aug 26 19:10:03 user nova-compute[73917]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 19:10:03 user nova-compute[73917]:   <vcpu placement='static'>1</vcpu>
Aug 26 19:10:03 user nova-compute[73917]:   <resource>
Aug 26 19:10:03 user nova-compute[73917]:     <partition>/machine</partition>
Aug 26 19:10:03 user nova-compute[73917]:   </resource>
Aug 26 19:10:03 user nova-compute[73917]:   <sysinfo type='smbios'>
Aug 26 19:10:03 user nova-compute[73917]:     <system>
Aug 26 19:10:03 user nova-compute[73917]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 19:10:03 user nova-compute[73917]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 19:10:03 user nova-compute[73917]:       <entry name='version'>0.0.0</entry>
Aug 26 19:10:03 user nova-compute[73917]:       <entry name='serial'>86937c34-db86-44a9-8196-3cae0d7ce400</entry>
Aug 26 19:10:03 user nova-compute[73917]:       <entry name='uuid'>86937c34-db86-44a9-8196-3cae0d7ce400</entry>
Aug 26 19:10:03 user nova-compute[73917]:       <entry name='family'>Virtual Machine</entry>
Aug 26 19:10:03 user nova-compute[73917]:     </system>
Aug 26 19:10:03 user nova-compute[73917]:   </sysinfo>
Aug 26 19:10:03 user nova-compute[73917]:   <os>
Aug 26 19:10:03 user nova-compute[73917]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 19:10:03 user nova-compute[73917]:     <boot dev='hd'/>
Aug 26 19:10:03 user nova-compute[73917]:     <smbios mode='sysinfo'/>
Aug 26 19:10:03 user nova-compute[73917]:   </os>
Aug 26 19:10:03 user nova-compute[73917]:   <features>
Aug 26 19:10:03 user nova-compute[73917]:     <acpi/>
Aug 26 19:10:03 user nova-compute[73917]:     <apic/>
Aug 26 19:10:03 user nova-compute[73917]:     <vmcoreinfo state='on'/>
Aug 26 19:10:03 user nova-compute[73917]:   </features>
Aug 26 19:10:03 user nova-compute[73917]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 19:10:03 user nova-compute[73917]:     <model fallback='forbid'>Nehalem</model>
Aug 26 19:10:03 user nova-compute[73917]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 19:10:03 user nova-compute[73917]:     <feature policy='require' name='vme'/>
Aug 26 19:10:03 user nova-compute[73917]:     <feature policy='require' name='x2apic'/>
Aug 26 19:10:03 user nova-compute[73917]:     <feature policy='require' name='hypervisor'/>
Aug 26 19:10:03 user nova-compute[73917]:   </cpu>
Aug 26 19:10:03 user nova-compute[73917]:   <clock offset='utc'>
Aug 26 19:10:03 user nova-compute[73917]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 19:10:03 user nova-compute[73917]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 19:10:03 user nova-compute[73917]:     <timer name='hpet' present='no'/>
Aug 26 19:10:03 user nova-compute[73917]:   </clock>
Aug 26 19:10:03 user nova-compute[73917]:   <on_poweroff>destroy</on_poweroff>
Aug 26 19:10:03 user nova-compute[73917]:   <on_reboot>restart</on_reboot>
Aug 26 19:10:03 user nova-compute[73917]:   <on_crash>destroy</on_crash>
Aug 26 19:10:03 user nova-compute[73917]:   <devices>
Aug 26 19:10:03 user nova-compute[73917]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 19:10:03 user nova-compute[73917]:     <disk type='file' device='disk'>
Aug 26 19:10:03 user nova-compute[73917]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 19:10:03 user nova-compute[73917]:       <source file='/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk' index='2'/>
Aug 26 19:10:03 user nova-compute[73917]:       <backingStore type='file' index='3'>
Aug 26 19:10:03 user nova-compute[73917]:         <format type='raw'/>
Aug 26 19:10:03 user nova-compute[73917]:         <source file='/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2'/>
Aug 26 19:10:03 user nova-compute[73917]:         <backingStore/>
Aug 26 19:10:03 user nova-compute[73917]:       </backingStore>
Aug 26 19:10:03 user nova-compute[73917]:       <target dev='vda' bus='virtio'/>
Aug 26 19:10:03 user nova-compute[73917]:       <alias name='virtio-disk0'/>
Aug 26 19:10:03 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 19:10:03 user nova-compute[73917]:     </disk>
Aug 26 19:10:03 user nova-compute[73917]:     <disk type='file' device='cdrom'>
Aug 26 19:10:03 user nova-compute[73917]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 19:10:03 user nova-compute[73917]:       <source file='/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk.config' index='1'/>
Aug 26 19:10:03 user nova-compute[73917]:       <backingStore/>
Aug 26 19:10:03 user nova-compute[73917]:       <target dev='hda' bus='ide'/>
Aug 26 19:10:03 user nova-compute[73917]:       <readonly/>
Aug 26 19:10:03 user nova-compute[73917]:       <alias name='ide0-0-0'/>
Aug 26 19:10:03 user nova-compute[73917]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 19:10:03 user nova-compute[73917]:     </disk>
Aug 26 19:10:03 user nova-compute[73917]:     <controller type='usb' index='0' model='none'>
Aug 26 19:10:03 user nova-compute[73917]:       <alias name='usb'/>
Aug 26 19:10:03 user nova-compute[73917]:     </controller>
Aug 26 19:10:03 user nova-compute[73917]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 19:10:03 user nova-compute[73917]:       <alias name='pci.0'/>
Aug 26 19:10:03 user nova-compute[73917]:     </controller>
Aug 26 19:10:03 user nova-compute[73917]:     <controller type='ide' index='0'>
Aug 26 19:10:03 user nova-compute[73917]:       <alias name='ide'/>
Aug 26 19:10:03 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 19:10:03 user nova-compute[73917]:     </controller>
Aug 26 19:10:03 user nova-compute[73917]:     <interface type='ethernet'>
Aug 26 19:10:03 user nova-compute[73917]:       <mac address='fa:16:3e:b3:2d:13'/>
Aug 26 19:10:03 user nova-compute[73917]:       <target dev='tap0fd58968-f9'/>
Aug 26 19:10:03 user nova-compute[73917]:       <model type='virtio'/>
Aug 26 19:10:03 user nova-compute[73917]:       <mtu size='1442'/>
Aug 26 19:10:03 user nova-compute[73917]:       <alias name='net0'/>
Aug 26 19:10:03 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 19:10:03 user nova-compute[73917]:     </interface>
Aug 26 19:10:03 user nova-compute[73917]:     <serial type='pty'>
Aug 26 19:10:03 user nova-compute[73917]:       <source path='/dev/pts/9'/>
Aug 26 19:10:03 user nova-compute[73917]:       <log file='/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/console.log' append='off'/>
Aug 26 19:10:03 user nova-compute[73917]:       <target type='isa-serial' port='0'>
Aug 26 19:10:03 user nova-compute[73917]:         <model name='isa-serial'/>
Aug 26 19:10:03 user nova-compute[73917]:       </target>
Aug 26 19:10:03 user nova-compute[73917]:       <alias name='serial0'/>
Aug 26 19:10:03 user nova-compute[73917]:     </serial>
Aug 26 19:10:03 user nova-compute[73917]:     <console type='pty' tty='/dev/pts/9'>
Aug 26 19:10:03 user nova-compute[73917]:       <source path='/dev/pts/9'/>
Aug 26 19:10:03 user nova-compute[73917]:       <log file='/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/console.log' append='off'/>
Aug 26 19:10:03 user nova-compute[73917]:       <target type='serial' port='0'/>
Aug 26 19:10:03 user nova-compute[73917]:       <alias name='serial0'/>
Aug 26 19:10:03 user nova-compute[73917]:     </console>
Aug 26 19:10:03 user nova-compute[73917]:     <input type='mouse' bus='ps2'>
Aug 26 19:10:03 user nova-compute[73917]:       <alias name='input0'/>
Aug 26 19:10:03 user nova-compute[73917]:     </input>
Aug 26 19:10:03 user nova-compute[73917]:     <input type='keyboard' bus='ps2'>
Aug 26 19:10:03 user nova-compute[73917]:       <alias name='input1'/>
Aug 26 19:10:03 user nova-compute[73917]:     </input>
Aug 26 19:10:03 user nova-compute[73917]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Aug 26 19:10:03 user nova-compute[73917]:       <listen type='address' address='0.0.0.0'/>
Aug 26 19:10:03 user nova-compute[73917]:     </graphics>
Aug 26 19:10:03 user nova-compute[73917]:     <audio id='1' type='none'/>
Aug 26 19:10:03 user nova-compute[73917]:     <video>
Aug 26 19:10:03 user nova-compute[73917]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 19:10:03 user nova-compute[73917]:       <alias name='video0'/>
Aug 26 19:10:03 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 19:10:03 user nova-compute[73917]:     </video>
Aug 26 19:10:03 user nova-compute[73917]:     <memballoon model='virtio'>
Aug 26 19:10:03 user nova-compute[73917]:       <stats period='10'/>
Aug 26 19:10:03 user nova-compute[73917]:       <alias name='balloon0'/>
Aug 26 19:10:03 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 19:10:03 user nova-compute[73917]:     </memballoon>
Aug 26 19:10:03 user nova-compute[73917]:     <rng model='virtio'>
Aug 26 19:10:03 user nova-compute[73917]:       <backend model='random'>/dev/urandom</backend>
Aug 26 19:10:03 user nova-compute[73917]:       <alias name='rng0'/>
Aug 26 19:10:03 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 19:10:03 user nova-compute[73917]:     </rng>
Aug 26 19:10:03 user nova-compute[73917]:   </devices>
Aug 26 19:10:03 user nova-compute[73917]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 19:10:03 user nova-compute[73917]:     <label>libvirt-86937c34-db86-44a9-8196-3cae0d7ce400</label>
Aug 26 19:10:03 user nova-compute[73917]:     <imagelabel>libvirt-86937c34-db86-44a9-8196-3cae0d7ce400</imagelabel>
Aug 26 19:10:03 user nova-compute[73917]:   </seclabel>
Aug 26 19:10:03 user nova-compute[73917]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 19:10:03 user nova-compute[73917]:     <label>+64055:+108</label>
Aug 26 19:10:03 user nova-compute[73917]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 19:10:03 user nova-compute[73917]:   </seclabel>
Aug 26 19:10:03 user nova-compute[73917]: </domain>
Aug 26 19:10:03 user nova-compute[73917]:  {{(pid=73917) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 19:10:03 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Successfully detached device tap27ca071c-c2 from instance 86937c34-db86-44a9-8196-3cae0d7ce400 from the live domain config.
Aug 26 19:10:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152870467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1152870467',id=10,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh0Gq1qVrt69OKjzmbhUuqTEU+L2JyHLQ3aEGP1I2l94+VWUqaxZlu45tMYdws2tmkIV0iudsUfn6jRdBXdutT2e0DfOoTHtyHz97pVCSRiDLTiyRN8NsP3m644FqnDUA==',key_name='tempest-keypair-2122776356',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cec3e3b818b54192b32d90bb8240515e',ramdisk_id='',reservation_id='r-8k2gu0ce',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1228202789',owner_user_name='tempest-TaggedAttachmentsTest-1228202789-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e883bb35273c4f9cacdc443695962e5d',uuid=86937c34-db86-44a9-8196-3cae0d7ce400,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "address": "fa:16:3e:94:38:8b", "network": {"id": "42af97c0-edd6-4ebf-ae4d-fe4632ea7c95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1764354394", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ca071c-c2", "ovs_interfaceid": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Converting VIF {"id": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "address": "fa:16:3e:94:38:8b", "network": {"id": "42af97c0-edd6-4ebf-ae4d-fe4632ea7c95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1764354394", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ca071c-c2", "ovs_interfaceid": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:38:8b,bridge_name='br-int',has_traffic_filtering=True,id=27ca071c-c2bc-4907-a0fa-b48c52f62721,network=Network(42af97c0-edd6-4ebf-ae4d-fe4632ea7c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27ca071c-c2') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG os_vif [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:38:8b,bridge_name='br-int',has_traffic_filtering=True,id=27ca071c-c2bc-4907-a0fa-b48c52f62721,network=Network(42af97c0-edd6-4ebf-ae4d-fe4632ea7c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27ca071c-c2') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27ca071c-c2, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:03 user nova-compute[73917]: INFO os_vif [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:38:8b,bridge_name='br-int',has_traffic_filtering=True,id=27ca071c-c2bc-4907-a0fa-b48c52f62721,network=Network(42af97c0-edd6-4ebf-ae4d-fe4632ea7c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27ca071c-c2')
Aug 26 19:10:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:10:03 user nova-compute[73917]:   <nova:package version="0.0.0"/>
Aug 26 19:10:03 user nova-compute[73917]:   <nova:name>tempest-device-tagging-server-1152870467</nova:name>
Aug 26 19:10:03 user nova-compute[73917]:   <nova:creationTime>2023-08-26 19:10:03</nova:creationTime>
Aug 26 19:10:03 user nova-compute[73917]:   <nova:flavor name="m1.tiny">
Aug 26 19:10:03 user nova-compute[73917]:     <nova:memory>512</nova:memory>
Aug 26 19:10:03 user nova-compute[73917]:     <nova:disk>1</nova:disk>
Aug 26 19:10:03 user nova-compute[73917]:     <nova:swap>0</nova:swap>
Aug 26 19:10:03 user nova-compute[73917]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:10:03 user nova-compute[73917]:     <nova:vcpus>1</nova:vcpus>
Aug 26 19:10:03 user nova-compute[73917]:   </nova:flavor>
Aug 26 19:10:03 user nova-compute[73917]:   <nova:owner>
Aug 26 19:10:03 user nova-compute[73917]:     <nova:user uuid="e883bb35273c4f9cacdc443695962e5d">tempest-TaggedAttachmentsTest-1228202789-project-member</nova:user>
Aug 26 19:10:03 user nova-compute[73917]:     <nova:project uuid="cec3e3b818b54192b32d90bb8240515e">tempest-TaggedAttachmentsTest-1228202789</nova:project>
Aug 26 19:10:03 user nova-compute[73917]:   </nova:owner>
Aug 26 19:10:03 user nova-compute[73917]:   <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:10:03 user nova-compute[73917]:   <nova:ports>
Aug 26 19:10:03 user nova-compute[73917]:     <nova:port uuid="0fd58968-f9e8-40f0-acff-8efea741379e">
Aug 26 19:10:03 user nova-compute[73917]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 19:10:03 user nova-compute[73917]:     </nova:port>
Aug 26 19:10:03 user nova-compute[73917]:   </nova:ports>
Aug 26 19:10:03 user nova-compute[73917]: </nova:instance>
Aug 26 19:10:03 user nova-compute[73917]:  {{(pid=73917) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] No VIF found with MAC fa:16:3e:41:f3:a7, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.590s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6978cd37-20f8-495b-85f6-4895efa7bafc tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Lock "c5120da8-5837-420f-b472-572a088a4a27" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.918s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG nova.compute.manager [req-a5b4ad4b-e75a-42b1-9686-c895b21410ca req-f522984b-55e1-4673-8458-0e7685855f1b service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received event network-vif-unplugged-27ca071c-c2bc-4907-a0fa-b48c52f62721 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a5b4ad4b-e75a-42b1-9686-c895b21410ca req-f522984b-55e1-4673-8458-0e7685855f1b service nova] Acquiring lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a5b4ad4b-e75a-42b1-9686-c895b21410ca req-f522984b-55e1-4673-8458-0e7685855f1b service nova] Lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a5b4ad4b-e75a-42b1-9686-c895b21410ca req-f522984b-55e1-4673-8458-0e7685855f1b service nova] Lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:03 user nova-compute[73917]: DEBUG nova.compute.manager [req-a5b4ad4b-e75a-42b1-9686-c895b21410ca req-f522984b-55e1-4673-8458-0e7685855f1b service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] No waiting events found dispatching network-vif-unplugged-27ca071c-c2bc-4907-a0fa-b48c52f62721 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:10:03 user nova-compute[73917]: WARNING nova.compute.manager [req-a5b4ad4b-e75a-42b1-9686-c895b21410ca req-f522984b-55e1-4673-8458-0e7685855f1b service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received unexpected event network-vif-unplugged-27ca071c-c2bc-4907-a0fa-b48c52f62721 for instance with vm_state active and task_state None.
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.compute.manager [req-84168fb5-8257-45a9-80ad-2b0af6235ef9 req-0f2de12f-9ab8-42d0-ac09-a1d0edaf7bb0 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received event network-vif-deleted-27ca071c-c2bc-4907-a0fa-b48c52f62721 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:10:04 user nova-compute[73917]: INFO nova.compute.manager [req-84168fb5-8257-45a9-80ad-2b0af6235ef9 req-0f2de12f-9ab8-42d0-ac09-a1d0edaf7bb0 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Neutron deleted interface 27ca071c-c2bc-4907-a0fa-b48c52f62721; detaching it from the instance and deleting it from the info cache
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.network.neutron [req-84168fb5-8257-45a9-80ad-2b0af6235ef9 req-0f2de12f-9ab8-42d0-ac09-a1d0edaf7bb0 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Updating instance_info_cache with network_info: [{"id": "0fd58968-f9e8-40f0-acff-8efea741379e", "address": "fa:16:3e:b3:2d:13", "network": {"id": "02545642-9a23-4d7d-8ff0-231150ea7ced", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2072904890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd58968-f9", "ovs_interfaceid": "0fd58968-f9e8-40f0-acff-8efea741379e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquiring lock "refresh_cache-86937c34-db86-44a9-8196-3cae0d7ce400" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquired lock "refresh_cache-86937c34-db86-44a9-8196-3cae0d7ce400" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.network.neutron [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.objects.instance [req-84168fb5-8257-45a9-80ad-2b0af6235ef9 req-0f2de12f-9ab8-42d0-ac09-a1d0edaf7bb0 service nova] Lazy-loading 'system_metadata' on Instance uuid 86937c34-db86-44a9-8196-3cae0d7ce400 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.objects.instance [req-84168fb5-8257-45a9-80ad-2b0af6235ef9 req-0f2de12f-9ab8-42d0-ac09-a1d0edaf7bb0 service nova] Lazy-loading 'flavor' on Instance uuid 86937c34-db86-44a9-8196-3cae0d7ce400 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.objects.base [req-84168fb5-8257-45a9-80ad-2b0af6235ef9 req-0f2de12f-9ab8-42d0-ac09-a1d0edaf7bb0 service nova] Object Instance<86937c34-db86-44a9-8196-3cae0d7ce400> lazy-loaded attributes: system_metadata,flavor {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [req-84168fb5-8257-45a9-80ad-2b0af6235ef9 req-0f2de12f-9ab8-42d0-ac09-a1d0edaf7bb0 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152870467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1152870467',id=10,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh0Gq1qVrt69OKjzmbhUuqTEU+L2JyHLQ3aEGP1I2l94+VWUqaxZlu45tMYdws2tmkIV0iudsUfn6jRdBXdutT2e0DfOoTHtyHz97pVCSRiDLTiyRN8NsP3m644FqnDUA==',key_name='tempest-keypair-2122776356',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cec3e3b818b54192b32d90bb8240515e',ramdisk_id='',reservation_id='r-8k2gu0ce',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1228202789',owner_user_name='tempest-TaggedAttachmentsTest-1228202789-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e883bb35273c4f9cacdc443695962e5d',uuid=86937c34-db86-44a9-8196-3cae0d7ce400,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "address": "fa:16:3e:94:38:8b", "network": {"id": "42af97c0-edd6-4ebf-ae4d-fe4632ea7c95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1764354394", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ca071c-c2", "ovs_interfaceid": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.network.os_vif_util [req-84168fb5-8257-45a9-80ad-2b0af6235ef9 req-0f2de12f-9ab8-42d0-ac09-a1d0edaf7bb0 service nova] Converting VIF {"id": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "address": "fa:16:3e:94:38:8b", "network": {"id": "42af97c0-edd6-4ebf-ae4d-fe4632ea7c95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1764354394", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ca071c-c2", "ovs_interfaceid": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.network.os_vif_util [req-84168fb5-8257-45a9-80ad-2b0af6235ef9 req-0f2de12f-9ab8-42d0-ac09-a1d0edaf7bb0 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:38:8b,bridge_name='br-int',has_traffic_filtering=True,id=27ca071c-c2bc-4907-a0fa-b48c52f62721,network=Network(42af97c0-edd6-4ebf-ae4d-fe4632ea7c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27ca071c-c2') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [req-84168fb5-8257-45a9-80ad-2b0af6235ef9 req-0f2de12f-9ab8-42d0-ac09-a1d0edaf7bb0 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:94:38:8b"/><model type="virtio"/><mtu size="1442"/><target dev="tap27ca071c-c2"/></interface> {{(pid=73917) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [req-84168fb5-8257-45a9-80ad-2b0af6235ef9 req-0f2de12f-9ab8-42d0-ac09-a1d0edaf7bb0 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:94:38:8b"/><model type="virtio"/><mtu size="1442"/><target dev="tap27ca071c-c2"/></interface>not found in domain: <domain type='kvm' id='10'>
Aug 26 19:10:04 user nova-compute[73917]:   <name>instance-0000000a</name>
Aug 26 19:10:04 user nova-compute[73917]:   <uuid>86937c34-db86-44a9-8196-3cae0d7ce400</uuid>
Aug 26 19:10:04 user nova-compute[73917]:   <metadata>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:10:04 user nova-compute[73917]:   <nova:package version="0.0.0"/>
Aug 26 19:10:04 user nova-compute[73917]:   <nova:name>tempest-device-tagging-server-1152870467</nova:name>
Aug 26 19:10:04 user nova-compute[73917]:   <nova:creationTime>2023-08-26 19:10:03</nova:creationTime>
Aug 26 19:10:04 user nova-compute[73917]:   <nova:flavor name="m1.tiny">
Aug 26 19:10:04 user nova-compute[73917]:     <nova:memory>512</nova:memory>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:disk>1</nova:disk>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:swap>0</nova:swap>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:vcpus>1</nova:vcpus>
Aug 26 19:10:04 user nova-compute[73917]:   </nova:flavor>
Aug 26 19:10:04 user nova-compute[73917]:   <nova:owner>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:user uuid="e883bb35273c4f9cacdc443695962e5d">tempest-TaggedAttachmentsTest-1228202789-project-member</nova:user>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:project uuid="cec3e3b818b54192b32d90bb8240515e">tempest-TaggedAttachmentsTest-1228202789</nova:project>
Aug 26 19:10:04 user nova-compute[73917]:   </nova:owner>
Aug 26 19:10:04 user nova-compute[73917]:   <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:10:04 user nova-compute[73917]:   <nova:ports>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:port uuid="0fd58968-f9e8-40f0-acff-8efea741379e">
Aug 26 19:10:04 user nova-compute[73917]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 19:10:04 user nova-compute[73917]:     </nova:port>
Aug 26 19:10:04 user nova-compute[73917]:   </nova:ports>
Aug 26 19:10:04 user nova-compute[73917]: </nova:instance>
Aug 26 19:10:04 user nova-compute[73917]:   </metadata>
Aug 26 19:10:04 user nova-compute[73917]:   <memory unit='KiB'>524288</memory>
Aug 26 19:10:04 user nova-compute[73917]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 19:10:04 user nova-compute[73917]:   <vcpu placement='static'>1</vcpu>
Aug 26 19:10:04 user nova-compute[73917]:   <resource>
Aug 26 19:10:04 user nova-compute[73917]:     <partition>/machine</partition>
Aug 26 19:10:04 user nova-compute[73917]:   </resource>
Aug 26 19:10:04 user nova-compute[73917]:   <sysinfo type='smbios'>
Aug 26 19:10:04 user nova-compute[73917]:     <system>
Aug 26 19:10:04 user nova-compute[73917]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 19:10:04 user nova-compute[73917]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 19:10:04 user nova-compute[73917]:       <entry name='version'>0.0.0</entry>
Aug 26 19:10:04 user nova-compute[73917]:       <entry name='serial'>86937c34-db86-44a9-8196-3cae0d7ce400</entry>
Aug 26 19:10:04 user nova-compute[73917]:       <entry name='uuid'>86937c34-db86-44a9-8196-3cae0d7ce400</entry>
Aug 26 19:10:04 user nova-compute[73917]:       <entry name='family'>Virtual Machine</entry>
Aug 26 19:10:04 user nova-compute[73917]:     </system>
Aug 26 19:10:04 user nova-compute[73917]:   </sysinfo>
Aug 26 19:10:04 user nova-compute[73917]:   <os>
Aug 26 19:10:04 user nova-compute[73917]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 19:10:04 user nova-compute[73917]:     <boot dev='hd'/>
Aug 26 19:10:04 user nova-compute[73917]:     <smbios mode='sysinfo'/>
Aug 26 19:10:04 user nova-compute[73917]:   </os>
Aug 26 19:10:04 user nova-compute[73917]:   <features>
Aug 26 19:10:04 user nova-compute[73917]:     <acpi/>
Aug 26 19:10:04 user nova-compute[73917]:     <apic/>
Aug 26 19:10:04 user nova-compute[73917]:     <vmcoreinfo state='on'/>
Aug 26 19:10:04 user nova-compute[73917]:   </features>
Aug 26 19:10:04 user nova-compute[73917]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 19:10:04 user nova-compute[73917]:     <model fallback='forbid'>Nehalem</model>
Aug 26 19:10:04 user nova-compute[73917]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 19:10:04 user nova-compute[73917]:     <feature policy='require' name='vme'/>
Aug 26 19:10:04 user nova-compute[73917]:     <feature policy='require' name='x2apic'/>
Aug 26 19:10:04 user nova-compute[73917]:     <feature policy='require' name='hypervisor'/>
Aug 26 19:10:04 user nova-compute[73917]:   </cpu>
Aug 26 19:10:04 user nova-compute[73917]:   <clock offset='utc'>
Aug 26 19:10:04 user nova-compute[73917]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 19:10:04 user nova-compute[73917]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 19:10:04 user nova-compute[73917]:     <timer name='hpet' present='no'/>
Aug 26 19:10:04 user nova-compute[73917]:   </clock>
Aug 26 19:10:04 user nova-compute[73917]:   <on_poweroff>destroy</on_poweroff>
Aug 26 19:10:04 user nova-compute[73917]:   <on_reboot>restart</on_reboot>
Aug 26 19:10:04 user nova-compute[73917]:   <on_crash>destroy</on_crash>
Aug 26 19:10:04 user nova-compute[73917]:   <devices>
Aug 26 19:10:04 user nova-compute[73917]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 19:10:04 user nova-compute[73917]:     <disk type='file' device='disk'>
Aug 26 19:10:04 user nova-compute[73917]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 19:10:04 user nova-compute[73917]:       <source file='/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk' index='2'/>
Aug 26 19:10:04 user nova-compute[73917]:       <backingStore type='file' index='3'>
Aug 26 19:10:04 user nova-compute[73917]:         <format type='raw'/>
Aug 26 19:10:04 user nova-compute[73917]:         <source file='/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2'/>
Aug 26 19:10:04 user nova-compute[73917]:         <backingStore/>
Aug 26 19:10:04 user nova-compute[73917]:       </backingStore>
Aug 26 19:10:04 user nova-compute[73917]:       <target dev='vda' bus='virtio'/>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='virtio-disk0'/>
Aug 26 19:10:04 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </disk>
Aug 26 19:10:04 user nova-compute[73917]:     <disk type='file' device='cdrom'>
Aug 26 19:10:04 user nova-compute[73917]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 19:10:04 user nova-compute[73917]:       <source file='/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk.config' index='1'/>
Aug 26 19:10:04 user nova-compute[73917]:       <backingStore/>
Aug 26 19:10:04 user nova-compute[73917]:       <target dev='hda' bus='ide'/>
Aug 26 19:10:04 user nova-compute[73917]:       <readonly/>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='ide0-0-0'/>
Aug 26 19:10:04 user nova-compute[73917]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </disk>
Aug 26 19:10:04 user nova-compute[73917]:     <controller type='usb' index='0' model='none'>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='usb'/>
Aug 26 19:10:04 user nova-compute[73917]:     </controller>
Aug 26 19:10:04 user nova-compute[73917]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='pci.0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </controller>
Aug 26 19:10:04 user nova-compute[73917]:     <controller type='ide' index='0'>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='ide'/>
Aug 26 19:10:04 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 19:10:04 user nova-compute[73917]:     </controller>
Aug 26 19:10:04 user nova-compute[73917]:     <interface type='ethernet'>
Aug 26 19:10:04 user nova-compute[73917]:       <mac address='fa:16:3e:b3:2d:13'/>
Aug 26 19:10:04 user nova-compute[73917]:       <target dev='tap0fd58968-f9'/>
Aug 26 19:10:04 user nova-compute[73917]:       <model type='virtio'/>
Aug 26 19:10:04 user nova-compute[73917]:       <mtu size='1442'/>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='net0'/>
Aug 26 19:10:04 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </interface>
Aug 26 19:10:04 user nova-compute[73917]:     <serial type='pty'>
Aug 26 19:10:04 user nova-compute[73917]:       <source path='/dev/pts/9'/>
Aug 26 19:10:04 user nova-compute[73917]:       <log file='/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/console.log' append='off'/>
Aug 26 19:10:04 user nova-compute[73917]:       <target type='isa-serial' port='0'>
Aug 26 19:10:04 user nova-compute[73917]:         <model name='isa-serial'/>
Aug 26 19:10:04 user nova-compute[73917]:       </target>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='serial0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </serial>
Aug 26 19:10:04 user nova-compute[73917]:     <console type='pty' tty='/dev/pts/9'>
Aug 26 19:10:04 user nova-compute[73917]:       <source path='/dev/pts/9'/>
Aug 26 19:10:04 user nova-compute[73917]:       <log file='/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/console.log' append='off'/>
Aug 26 19:10:04 user nova-compute[73917]:       <target type='serial' port='0'/>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='serial0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </console>
Aug 26 19:10:04 user nova-compute[73917]:     <input type='mouse' bus='ps2'>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='input0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </input>
Aug 26 19:10:04 user nova-compute[73917]:     <input type='keyboard' bus='ps2'>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='input1'/>
Aug 26 19:10:04 user nova-compute[73917]:     </input>
Aug 26 19:10:04 user nova-compute[73917]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Aug 26 19:10:04 user nova-compute[73917]:       <listen type='address' address='0.0.0.0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </graphics>
Aug 26 19:10:04 user nova-compute[73917]:     <audio id='1' type='none'/>
Aug 26 19:10:04 user nova-compute[73917]:     <video>
Aug 26 19:10:04 user nova-compute[73917]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='video0'/>
Aug 26 19:10:04 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </video>
Aug 26 19:10:04 user nova-compute[73917]:     <memballoon model='virtio'>
Aug 26 19:10:04 user nova-compute[73917]:       <stats period='10'/>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='balloon0'/>
Aug 26 19:10:04 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </memballoon>
Aug 26 19:10:04 user nova-compute[73917]:     <rng model='virtio'>
Aug 26 19:10:04 user nova-compute[73917]:       <backend model='random'>/dev/urandom</backend>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='rng0'/>
Aug 26 19:10:04 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </rng>
Aug 26 19:10:04 user nova-compute[73917]:   </devices>
Aug 26 19:10:04 user nova-compute[73917]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 19:10:04 user nova-compute[73917]:     <label>libvirt-86937c34-db86-44a9-8196-3cae0d7ce400</label>
Aug 26 19:10:04 user nova-compute[73917]:     <imagelabel>libvirt-86937c34-db86-44a9-8196-3cae0d7ce400</imagelabel>
Aug 26 19:10:04 user nova-compute[73917]:   </seclabel>
Aug 26 19:10:04 user nova-compute[73917]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 19:10:04 user nova-compute[73917]:     <label>+64055:+108</label>
Aug 26 19:10:04 user nova-compute[73917]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 19:10:04 user nova-compute[73917]:   </seclabel>
Aug 26 19:10:04 user nova-compute[73917]: </domain>
Aug 26 19:10:04 user nova-compute[73917]:  {{(pid=73917) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [req-84168fb5-8257-45a9-80ad-2b0af6235ef9 req-0f2de12f-9ab8-42d0-ac09-a1d0edaf7bb0 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:94:38:8b"/><model type="virtio"/><mtu size="1442"/><target dev="tap27ca071c-c2"/></interface> {{(pid=73917) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [req-84168fb5-8257-45a9-80ad-2b0af6235ef9 req-0f2de12f-9ab8-42d0-ac09-a1d0edaf7bb0 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:94:38:8b"/><model type="virtio"/><mtu size="1442"/><target dev="tap27ca071c-c2"/></interface>not found in domain: <domain type='kvm' id='10'>
Aug 26 19:10:04 user nova-compute[73917]:   <name>instance-0000000a</name>
Aug 26 19:10:04 user nova-compute[73917]:   <uuid>86937c34-db86-44a9-8196-3cae0d7ce400</uuid>
Aug 26 19:10:04 user nova-compute[73917]:   <metadata>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:10:04 user nova-compute[73917]:   <nova:package version="0.0.0"/>
Aug 26 19:10:04 user nova-compute[73917]:   <nova:name>tempest-device-tagging-server-1152870467</nova:name>
Aug 26 19:10:04 user nova-compute[73917]:   <nova:creationTime>2023-08-26 19:10:03</nova:creationTime>
Aug 26 19:10:04 user nova-compute[73917]:   <nova:flavor name="m1.tiny">
Aug 26 19:10:04 user nova-compute[73917]:     <nova:memory>512</nova:memory>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:disk>1</nova:disk>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:swap>0</nova:swap>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:vcpus>1</nova:vcpus>
Aug 26 19:10:04 user nova-compute[73917]:   </nova:flavor>
Aug 26 19:10:04 user nova-compute[73917]:   <nova:owner>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:user uuid="e883bb35273c4f9cacdc443695962e5d">tempest-TaggedAttachmentsTest-1228202789-project-member</nova:user>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:project uuid="cec3e3b818b54192b32d90bb8240515e">tempest-TaggedAttachmentsTest-1228202789</nova:project>
Aug 26 19:10:04 user nova-compute[73917]:   </nova:owner>
Aug 26 19:10:04 user nova-compute[73917]:   <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:10:04 user nova-compute[73917]:   <nova:ports>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:port uuid="0fd58968-f9e8-40f0-acff-8efea741379e">
Aug 26 19:10:04 user nova-compute[73917]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 19:10:04 user nova-compute[73917]:     </nova:port>
Aug 26 19:10:04 user nova-compute[73917]:   </nova:ports>
Aug 26 19:10:04 user nova-compute[73917]: </nova:instance>
Aug 26 19:10:04 user nova-compute[73917]:   </metadata>
Aug 26 19:10:04 user nova-compute[73917]:   <memory unit='KiB'>524288</memory>
Aug 26 19:10:04 user nova-compute[73917]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 19:10:04 user nova-compute[73917]:   <vcpu placement='static'>1</vcpu>
Aug 26 19:10:04 user nova-compute[73917]:   <resource>
Aug 26 19:10:04 user nova-compute[73917]:     <partition>/machine</partition>
Aug 26 19:10:04 user nova-compute[73917]:   </resource>
Aug 26 19:10:04 user nova-compute[73917]:   <sysinfo type='smbios'>
Aug 26 19:10:04 user nova-compute[73917]:     <system>
Aug 26 19:10:04 user nova-compute[73917]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 19:10:04 user nova-compute[73917]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 19:10:04 user nova-compute[73917]:       <entry name='version'>0.0.0</entry>
Aug 26 19:10:04 user nova-compute[73917]:       <entry name='serial'>86937c34-db86-44a9-8196-3cae0d7ce400</entry>
Aug 26 19:10:04 user nova-compute[73917]:       <entry name='uuid'>86937c34-db86-44a9-8196-3cae0d7ce400</entry>
Aug 26 19:10:04 user nova-compute[73917]:       <entry name='family'>Virtual Machine</entry>
Aug 26 19:10:04 user nova-compute[73917]:     </system>
Aug 26 19:10:04 user nova-compute[73917]:   </sysinfo>
Aug 26 19:10:04 user nova-compute[73917]:   <os>
Aug 26 19:10:04 user nova-compute[73917]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 19:10:04 user nova-compute[73917]:     <boot dev='hd'/>
Aug 26 19:10:04 user nova-compute[73917]:     <smbios mode='sysinfo'/>
Aug 26 19:10:04 user nova-compute[73917]:   </os>
Aug 26 19:10:04 user nova-compute[73917]:   <features>
Aug 26 19:10:04 user nova-compute[73917]:     <acpi/>
Aug 26 19:10:04 user nova-compute[73917]:     <apic/>
Aug 26 19:10:04 user nova-compute[73917]:     <vmcoreinfo state='on'/>
Aug 26 19:10:04 user nova-compute[73917]:   </features>
Aug 26 19:10:04 user nova-compute[73917]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 19:10:04 user nova-compute[73917]:     <model fallback='forbid'>Nehalem</model>
Aug 26 19:10:04 user nova-compute[73917]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 19:10:04 user nova-compute[73917]:     <feature policy='require' name='vme'/>
Aug 26 19:10:04 user nova-compute[73917]:     <feature policy='require' name='x2apic'/>
Aug 26 19:10:04 user nova-compute[73917]:     <feature policy='require' name='hypervisor'/>
Aug 26 19:10:04 user nova-compute[73917]:   </cpu>
Aug 26 19:10:04 user nova-compute[73917]:   <clock offset='utc'>
Aug 26 19:10:04 user nova-compute[73917]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 19:10:04 user nova-compute[73917]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 19:10:04 user nova-compute[73917]:     <timer name='hpet' present='no'/>
Aug 26 19:10:04 user nova-compute[73917]:   </clock>
Aug 26 19:10:04 user nova-compute[73917]:   <on_poweroff>destroy</on_poweroff>
Aug 26 19:10:04 user nova-compute[73917]:   <on_reboot>restart</on_reboot>
Aug 26 19:10:04 user nova-compute[73917]:   <on_crash>destroy</on_crash>
Aug 26 19:10:04 user nova-compute[73917]:   <devices>
Aug 26 19:10:04 user nova-compute[73917]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 19:10:04 user nova-compute[73917]:     <disk type='file' device='disk'>
Aug 26 19:10:04 user nova-compute[73917]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 19:10:04 user nova-compute[73917]:       <source file='/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk' index='2'/>
Aug 26 19:10:04 user nova-compute[73917]:       <backingStore type='file' index='3'>
Aug 26 19:10:04 user nova-compute[73917]:         <format type='raw'/>
Aug 26 19:10:04 user nova-compute[73917]:         <source file='/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2'/>
Aug 26 19:10:04 user nova-compute[73917]:         <backingStore/>
Aug 26 19:10:04 user nova-compute[73917]:       </backingStore>
Aug 26 19:10:04 user nova-compute[73917]:       <target dev='vda' bus='virtio'/>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='virtio-disk0'/>
Aug 26 19:10:04 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </disk>
Aug 26 19:10:04 user nova-compute[73917]:     <disk type='file' device='cdrom'>
Aug 26 19:10:04 user nova-compute[73917]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 19:10:04 user nova-compute[73917]:       <source file='/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/disk.config' index='1'/>
Aug 26 19:10:04 user nova-compute[73917]:       <backingStore/>
Aug 26 19:10:04 user nova-compute[73917]:       <target dev='hda' bus='ide'/>
Aug 26 19:10:04 user nova-compute[73917]:       <readonly/>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='ide0-0-0'/>
Aug 26 19:10:04 user nova-compute[73917]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </disk>
Aug 26 19:10:04 user nova-compute[73917]:     <controller type='usb' index='0' model='none'>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='usb'/>
Aug 26 19:10:04 user nova-compute[73917]:     </controller>
Aug 26 19:10:04 user nova-compute[73917]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='pci.0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </controller>
Aug 26 19:10:04 user nova-compute[73917]:     <controller type='ide' index='0'>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='ide'/>
Aug 26 19:10:04 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 19:10:04 user nova-compute[73917]:     </controller>
Aug 26 19:10:04 user nova-compute[73917]:     <interface type='ethernet'>
Aug 26 19:10:04 user nova-compute[73917]:       <mac address='fa:16:3e:b3:2d:13'/>
Aug 26 19:10:04 user nova-compute[73917]:       <target dev='tap0fd58968-f9'/>
Aug 26 19:10:04 user nova-compute[73917]:       <model type='virtio'/>
Aug 26 19:10:04 user nova-compute[73917]:       <mtu size='1442'/>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='net0'/>
Aug 26 19:10:04 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </interface>
Aug 26 19:10:04 user nova-compute[73917]:     <serial type='pty'>
Aug 26 19:10:04 user nova-compute[73917]:       <source path='/dev/pts/9'/>
Aug 26 19:10:04 user nova-compute[73917]:       <log file='/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/console.log' append='off'/>
Aug 26 19:10:04 user nova-compute[73917]:       <target type='isa-serial' port='0'>
Aug 26 19:10:04 user nova-compute[73917]:         <model name='isa-serial'/>
Aug 26 19:10:04 user nova-compute[73917]:       </target>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='serial0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </serial>
Aug 26 19:10:04 user nova-compute[73917]:     <console type='pty' tty='/dev/pts/9'>
Aug 26 19:10:04 user nova-compute[73917]:       <source path='/dev/pts/9'/>
Aug 26 19:10:04 user nova-compute[73917]:       <log file='/opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400/console.log' append='off'/>
Aug 26 19:10:04 user nova-compute[73917]:       <target type='serial' port='0'/>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='serial0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </console>
Aug 26 19:10:04 user nova-compute[73917]:     <input type='mouse' bus='ps2'>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='input0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </input>
Aug 26 19:10:04 user nova-compute[73917]:     <input type='keyboard' bus='ps2'>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='input1'/>
Aug 26 19:10:04 user nova-compute[73917]:     </input>
Aug 26 19:10:04 user nova-compute[73917]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Aug 26 19:10:04 user nova-compute[73917]:       <listen type='address' address='0.0.0.0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </graphics>
Aug 26 19:10:04 user nova-compute[73917]:     <audio id='1' type='none'/>
Aug 26 19:10:04 user nova-compute[73917]:     <video>
Aug 26 19:10:04 user nova-compute[73917]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='video0'/>
Aug 26 19:10:04 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </video>
Aug 26 19:10:04 user nova-compute[73917]:     <memballoon model='virtio'>
Aug 26 19:10:04 user nova-compute[73917]:       <stats period='10'/>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='balloon0'/>
Aug 26 19:10:04 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </memballoon>
Aug 26 19:10:04 user nova-compute[73917]:     <rng model='virtio'>
Aug 26 19:10:04 user nova-compute[73917]:       <backend model='random'>/dev/urandom</backend>
Aug 26 19:10:04 user nova-compute[73917]:       <alias name='rng0'/>
Aug 26 19:10:04 user nova-compute[73917]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 19:10:04 user nova-compute[73917]:     </rng>
Aug 26 19:10:04 user nova-compute[73917]:   </devices>
Aug 26 19:10:04 user nova-compute[73917]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 19:10:04 user nova-compute[73917]:     <label>libvirt-86937c34-db86-44a9-8196-3cae0d7ce400</label>
Aug 26 19:10:04 user nova-compute[73917]:     <imagelabel>libvirt-86937c34-db86-44a9-8196-3cae0d7ce400</imagelabel>
Aug 26 19:10:04 user nova-compute[73917]:   </seclabel>
Aug 26 19:10:04 user nova-compute[73917]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 19:10:04 user nova-compute[73917]:     <label>+64055:+108</label>
Aug 26 19:10:04 user nova-compute[73917]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 19:10:04 user nova-compute[73917]:   </seclabel>
Aug 26 19:10:04 user nova-compute[73917]: </domain>
Aug 26 19:10:04 user nova-compute[73917]:  {{(pid=73917) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 19:10:04 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [req-84168fb5-8257-45a9-80ad-2b0af6235ef9 req-0f2de12f-9ab8-42d0-ac09-a1d0edaf7bb0 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Detaching interface fa:16:3e:94:38:8b failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap27ca071c-c2' not found.
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [req-84168fb5-8257-45a9-80ad-2b0af6235ef9 req-0f2de12f-9ab8-42d0-ac09-a1d0edaf7bb0 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152870467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1152870467',id=10,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh0Gq1qVrt69OKjzmbhUuqTEU+L2JyHLQ3aEGP1I2l94+VWUqaxZlu45tMYdws2tmkIV0iudsUfn6jRdBXdutT2e0DfOoTHtyHz97pVCSRiDLTiyRN8NsP3m644FqnDUA==',key_name='tempest-keypair-2122776356',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cec3e3b818b54192b32d90bb8240515e',ramdisk_id='',reservation_id='r-8k2gu0ce',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1228202789',owner_user_name='tempest-TaggedAttachmentsTest-1228202789-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e883bb35273c4f9cacdc443695962e5d',uuid=86937c34-db86-44a9-8196-3cae0d7ce400,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "address": "fa:16:3e:94:38:8b", "network": {"id": "42af97c0-edd6-4ebf-ae4d-fe4632ea7c95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1764354394", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ca071c-c2", "ovs_interfaceid": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.network.os_vif_util [req-84168fb5-8257-45a9-80ad-2b0af6235ef9 req-0f2de12f-9ab8-42d0-ac09-a1d0edaf7bb0 service nova] Converting VIF {"id": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "address": "fa:16:3e:94:38:8b", "network": {"id": "42af97c0-edd6-4ebf-ae4d-fe4632ea7c95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1764354394", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ca071c-c2", "ovs_interfaceid": "27ca071c-c2bc-4907-a0fa-b48c52f62721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.network.os_vif_util [req-84168fb5-8257-45a9-80ad-2b0af6235ef9 req-0f2de12f-9ab8-42d0-ac09-a1d0edaf7bb0 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:38:8b,bridge_name='br-int',has_traffic_filtering=True,id=27ca071c-c2bc-4907-a0fa-b48c52f62721,network=Network(42af97c0-edd6-4ebf-ae4d-fe4632ea7c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27ca071c-c2') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG os_vif [req-84168fb5-8257-45a9-80ad-2b0af6235ef9 req-0f2de12f-9ab8-42d0-ac09-a1d0edaf7bb0 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:38:8b,bridge_name='br-int',has_traffic_filtering=True,id=27ca071c-c2bc-4907-a0fa-b48c52f62721,network=Network(42af97c0-edd6-4ebf-ae4d-fe4632ea7c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27ca071c-c2') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27ca071c-c2, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:10:04 user nova-compute[73917]: INFO os_vif [req-84168fb5-8257-45a9-80ad-2b0af6235ef9 req-0f2de12f-9ab8-42d0-ac09-a1d0edaf7bb0 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:38:8b,bridge_name='br-int',has_traffic_filtering=True,id=27ca071c-c2bc-4907-a0fa-b48c52f62721,network=Network(42af97c0-edd6-4ebf-ae4d-fe4632ea7c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27ca071c-c2')
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [req-84168fb5-8257-45a9-80ad-2b0af6235ef9 req-0f2de12f-9ab8-42d0-ac09-a1d0edaf7bb0 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:10:04 user nova-compute[73917]:   <nova:package version="0.0.0"/>
Aug 26 19:10:04 user nova-compute[73917]:   <nova:name>tempest-device-tagging-server-1152870467</nova:name>
Aug 26 19:10:04 user nova-compute[73917]:   <nova:creationTime>2023-08-26 19:10:04</nova:creationTime>
Aug 26 19:10:04 user nova-compute[73917]:   <nova:flavor name="m1.tiny">
Aug 26 19:10:04 user nova-compute[73917]:     <nova:memory>512</nova:memory>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:disk>1</nova:disk>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:swap>0</nova:swap>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:vcpus>1</nova:vcpus>
Aug 26 19:10:04 user nova-compute[73917]:   </nova:flavor>
Aug 26 19:10:04 user nova-compute[73917]:   <nova:owner>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:user uuid="e883bb35273c4f9cacdc443695962e5d">tempest-TaggedAttachmentsTest-1228202789-project-member</nova:user>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:project uuid="cec3e3b818b54192b32d90bb8240515e">tempest-TaggedAttachmentsTest-1228202789</nova:project>
Aug 26 19:10:04 user nova-compute[73917]:   </nova:owner>
Aug 26 19:10:04 user nova-compute[73917]:   <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:10:04 user nova-compute[73917]:   <nova:ports>
Aug 26 19:10:04 user nova-compute[73917]:     <nova:port uuid="0fd58968-f9e8-40f0-acff-8efea741379e">
Aug 26 19:10:04 user nova-compute[73917]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 19:10:04 user nova-compute[73917]:     </nova:port>
Aug 26 19:10:04 user nova-compute[73917]:   </nova:ports>
Aug 26 19:10:04 user nova-compute[73917]: </nova:instance>
Aug 26 19:10:04 user nova-compute[73917]:  {{(pid=73917) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.network.neutron [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Updating instance_info_cache with network_info: [{"id": "0fd58968-f9e8-40f0-acff-8efea741379e", "address": "fa:16:3e:b3:2d:13", "network": {"id": "02545642-9a23-4d7d-8ff0-231150ea7ced", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2072904890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd58968-f9", "ovs_interfaceid": "0fd58968-f9e8-40f0-acff-8efea741379e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Releasing lock "refresh_cache-86937c34-db86-44a9-8196-3cae0d7ce400" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7db61f01-5583-4cf5-a797-cf589ee7ebcb tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "interface-86937c34-db86-44a9-8196-3cae0d7ce400-27ca071c-c2bc-4907-a0fa-b48c52f62721" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.859s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-10bf631c-8d82-4eaa-bd67-d406242a06f3 tempest-VolumesAssistedSnapshotsTest-411729287 tempest-VolumesAssistedSnapshotsTest-411729287-project] [instance: c5120da8-5837-420f-b472-572a088a4a27] volume_snapshot_create: create_info: {'snapshot_id': 'da632c6d-dc9a-4093-bbc8-9f8c3628a9b7', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73917) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-10bf631c-8d82-4eaa-bd67-d406242a06f3 tempest-VolumesAssistedSnapshotsTest-411729287 tempest-VolumesAssistedSnapshotsTest-411729287-project] [instance: c5120da8-5837-420f-b472-572a088a4a27] snap xml: <domainsnapshot>
Aug 26 19:10:04 user nova-compute[73917]:   <disks>
Aug 26 19:10:04 user nova-compute[73917]:     <disk name="/dev/sdk" snapshot="external" type="file">
Aug 26 19:10:04 user nova-compute[73917]:       <source file="/dev/new_file"/>
Aug 26 19:10:04 user nova-compute[73917]:     </disk>
Aug 26 19:10:04 user nova-compute[73917]:     <disk name="vda" snapshot="no"/>
Aug 26 19:10:04 user nova-compute[73917]:   </disks>
Aug 26 19:10:04 user nova-compute[73917]: </domainsnapshot>
Aug 26 19:10:04 user nova-compute[73917]:  {{(pid=73917) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 26 19:10:04 user nova-compute[73917]: DEBUG nova.objects.instance [None req-10bf631c-8d82-4eaa-bd67-d406242a06f3 tempest-VolumesAssistedSnapshotsTest-411729287 tempest-VolumesAssistedSnapshotsTest-411729287-project] Lazy-loading 'system_metadata' on Instance uuid c5120da8-5837-420f-b472-572a088a4a27 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:10:04 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-10bf631c-8d82-4eaa-bd67-d406242a06f3 tempest-VolumesAssistedSnapshotsTest-411729287 tempest-VolumesAssistedSnapshotsTest-411729287-project] [instance: c5120da8-5837-420f-b472-572a088a4a27] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [None req-10bf631c-8d82-4eaa-bd67-d406242a06f3 tempest-VolumesAssistedSnapshotsTest-411729287 tempest-VolumesAssistedSnapshotsTest-411729287-project] [instance: c5120da8-5837-420f-b472-572a088a4a27] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27] Traceback (most recent call last):
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]     rv = execute(f, *args, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]     six.reraise(c, e, tb)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]     raise value
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]     rv = meth(*args, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27] 
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [None req-10bf631c-8d82-4eaa-bd67-d406242a06f3 tempest-VolumesAssistedSnapshotsTest-411729287 tempest-VolumesAssistedSnapshotsTest-411729287-project] [instance: c5120da8-5837-420f-b472-572a088a4a27] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27] Traceback (most recent call last):
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]     self._volume_snapshot_create(context, instance, guest,
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]     rv = execute(f, *args, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]     six.reraise(c, e, tb)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]     raise value
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]     rv = meth(*args, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27] 
Aug 26 19:10:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-8592b173-abdd-40e9-a5e6-f53f46efc68e tempest-VolumesAssistedSnapshotsTest-411729287 tempest-VolumesAssistedSnapshotsTest-411729287-project] [instance: c5120da8-5837-420f-b472-572a088a4a27] volume_snapshot_delete: delete_info: {'volume_id': 'ceff3905-f670-40df-b459-ddc1a92890a5'} {{(pid=73917) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [None req-8592b173-abdd-40e9-a5e6-f53f46efc68e tempest-VolumesAssistedSnapshotsTest-411729287 tempest-VolumesAssistedSnapshotsTest-411729287-project] [instance: c5120da8-5837-420f-b472-572a088a4a27] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27] Traceback (most recent call last):
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27]     if delete_info['type'] != 'qcow2':
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27] KeyError: 'type'
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [instance: c5120da8-5837-420f-b472-572a088a4a27] 
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [None req-10bf631c-8d82-4eaa-bd67-d406242a06f3 tempest-VolumesAssistedSnapshotsTest-411729287 tempest-VolumesAssistedSnapshotsTest-411729287-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot da632c6d-dc9a-4093-bbc8-9f8c3628a9b7 could not be found.
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     raise value
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver 
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver 
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot da632c6d-dc9a-4093-bbc8-9f8c3628a9b7 could not be found. (HTTP 404) (Request-ID: req-6a4c2eca-3a33-4829-8c2e-1bd161167091)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver 
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver 
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot da632c6d-dc9a-4093-bbc8-9f8c3628a9b7 could not be found.
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver 
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server [None req-10bf631c-8d82-4eaa-bd67-d406242a06f3 tempest-VolumesAssistedSnapshotsTest-411729287 tempest-VolumesAssistedSnapshotsTest-411729287-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     raise value
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server 
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver [None req-8592b173-abdd-40e9-a5e6-f53f46efc68e tempest-VolumesAssistedSnapshotsTest-411729287 tempest-VolumesAssistedSnapshotsTest-411729287-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver 
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver 
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-b24a87c3-e946-43ed-aa6c-241158158a42)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver 
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver 
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 19:10:05 user nova-compute[73917]: ERROR nova.virt.libvirt.driver 
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server [None req-8592b173-abdd-40e9-a5e6-f53f46efc68e tempest-VolumesAssistedSnapshotsTest-411729287 tempest-VolumesAssistedSnapshotsTest-411729287-project] Exception during message handling: KeyError: 'type'
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 26 19:10:05 user nova-compute[73917]: ERROR oslo_messaging.rpc.server 
Aug 26 19:10:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Acquiring lock "c5120da8-5837-420f-b472-572a088a4a27" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Lock "c5120da8-5837-420f-b472-572a088a4a27" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:05 user nova-compute[73917]: INFO nova.compute.manager [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] [instance: c5120da8-5837-420f-b472-572a088a4a27] Detaching volume ceff3905-f670-40df-b459-ddc1a92890a5
Aug 26 19:10:05 user nova-compute[73917]: INFO nova.virt.block_device [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] [instance: c5120da8-5837-420f-b472-572a088a4a27] Attempting to driver detach volume ceff3905-f670-40df-b459-ddc1a92890a5 from mountpoint /dev/vdb
Aug 26 19:10:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Attempting to detach device vdb from instance c5120da8-5837-420f-b472-572a088a4a27 from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 19:10:05 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:10:05 user nova-compute[73917]:   <source dev="/dev/sdk"/>
Aug 26 19:10:05 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:10:05 user nova-compute[73917]:   <serial>ceff3905-f670-40df-b459-ddc1a92890a5</serial>
Aug 26 19:10:05 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:10:05 user nova-compute[73917]: </disk>
Aug 26 19:10:05 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:10:05 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Successfully detached device vdb from instance c5120da8-5837-420f-b472-572a088a4a27 from the persistent domain config.
Aug 26 19:10:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c5120da8-5837-420f-b472-572a088a4a27 from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 19:10:05 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:10:05 user nova-compute[73917]:   <source dev="/dev/sdk"/>
Aug 26 19:10:05 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:10:05 user nova-compute[73917]:   <serial>ceff3905-f670-40df-b459-ddc1a92890a5</serial>
Aug 26 19:10:05 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:10:05 user nova-compute[73917]: </disk>
Aug 26 19:10:05 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-b6cb00a6-bfc7-43af-83a3-07fd22a33931 req-768880b4-1cea-4952-a1e1-989c80cbdd80 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received event network-vif-plugged-27ca071c-c2bc-4907-a0fa-b48c52f62721 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b6cb00a6-bfc7-43af-83a3-07fd22a33931 req-768880b4-1cea-4952-a1e1-989c80cbdd80 service nova] Acquiring lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b6cb00a6-bfc7-43af-83a3-07fd22a33931 req-768880b4-1cea-4952-a1e1-989c80cbdd80 service nova] Lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b6cb00a6-bfc7-43af-83a3-07fd22a33931 req-768880b4-1cea-4952-a1e1-989c80cbdd80 service nova] Lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-b6cb00a6-bfc7-43af-83a3-07fd22a33931 req-768880b4-1cea-4952-a1e1-989c80cbdd80 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] No waiting events found dispatching network-vif-plugged-27ca071c-c2bc-4907-a0fa-b48c52f62721 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:10:05 user nova-compute[73917]: WARNING nova.compute.manager [req-b6cb00a6-bfc7-43af-83a3-07fd22a33931 req-768880b4-1cea-4952-a1e1-989c80cbdd80 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received unexpected event network-vif-plugged-27ca071c-c2bc-4907-a0fa-b48c52f62721 for instance with vm_state active and task_state None.
Aug 26 19:10:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693077005.9137902, c5120da8-5837-420f-b472-572a088a4a27 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c5120da8-5837-420f-b472-572a088a4a27 {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:10:05 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Successfully detached device vdb from instance c5120da8-5837-420f-b472-572a088a4a27 from the live domain config.
Aug 26 19:10:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] [instance: c5120da8-5837-420f-b472-572a088a4a27] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jZOYHtyV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:10:05 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:10:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6eb7bc-596f-4965-8f8f-d8d9f392c6f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00b3533-8b45-4b80-8cf3-f226f83c7759]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:05 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:10:05 user nova-compute[73917]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 (non-flash)
Aug 26 19:10:05 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:05 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:05 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:05 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:05 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:05 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:05 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:05 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:05 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:10:05 user nova-compute[73917]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 (non-flash)
Aug 26 19:10:05 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:05 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:05 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:05 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:05 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:05 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:05 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:05 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b98360dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5'): ({'sdk'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Removing single pathed devices sdk {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:10:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28a5e0f-4bae-4c73-b3f3-fa3b0fbff31f]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[142cc8f7-c074-4408-b27c-770ee3fcc506]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Flushing IO for device /dev/sdk {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[61546cf6-11ac-4714-ab78-d4e764a46b3b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.031s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0808f118-d98a-4e7c-8435-0b61f5001a77]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] SCSI volumes sdk have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e44184-20d2-4d67-ae74-25016cc4cb5b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ad7200-b8e7-4403-9bf7-f374172bd727]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5, portal: 172.16.0.220,3260]
Aug 26 19:10:06 user nova-compute[73917]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5, portal: 172.16.0.220,3260] successful.
Aug 26 19:10:06 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceff3905-f670-40df-b459-ddc1a92890a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5304129b-dd2a-4bb2-b5f0-65d210b7fb76]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] <== disconnect_volume: return (310ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] [instance: c5120da8-5837-420f-b472-572a088a4a27] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:10:06 user nova-compute[73917]: DEBUG nova.objects.instance [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Lazy-loading 'flavor' on Instance uuid c5120da8-5837-420f-b472-572a088a4a27 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c2b12dd7-c9e6-407b-aa19-3858ed505296 tempest-VolumesAssistedSnapshotsTest-1372993591 tempest-VolumesAssistedSnapshotsTest-1372993591-project-admin] Lock "c5120da8-5837-420f-b472-572a088a4a27" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.678s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPSqZscQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f019c6c6-e76f-4a75-8ba4-8c566d9f5791', 'attached_at': '', 'detached_at': '', 'volume_id': 'ebae4a7e-65a5-4ecc-b06d-450a84b90047', 'serial': 'ebae4a7e-65a5-4ecc-b06d-450a84b90047'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mznEgDVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'f019c6c6-e76f-4a75-8ba4-8c566d9f5791', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9c6466e-3525-42d6-8a7b-df107660ffd4', 'serial'} {{(pid=73917) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPSqZscQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:10:07 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:10:07 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:10:07 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[99653b0f-25ed-4479-9422-d0e040fe9dce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:10:07 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[38498c96-a18c-4718-80db-8e2ff0c3d74d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047] added
Aug 26 19:10:07 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc84021-e701-421f-b774-eefb8e4dcac1]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fe7afa-cff7-4925-8ade-72c505cb3a01]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FPSqZscQ {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FPSqZscQ" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac82476-8e24-4066-b337-b99c0a79b91b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FPSqZscQ'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[08484c80-8a05-44ef-8125-3b5f3840c94f]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[96769a25-af20-4d83-a15d-7a3c9c45a664]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:07 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:07 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9d965c-4ea9-4a87-afe2-e7ecd21da2ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047, portal: 172.16.0.220,3260]
Aug 26 19:10:07 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047, portal: 172.16.0.220,3260] successful.
Aug 26 19:10:07 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bb7690-7d67-40dd-8c5d-453592d44f12]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6635c42-938d-425d-a7fb-16d62d76c9e1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:07 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:07 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:07 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] HCTL ('42', '-', '-', 0) found on session 15 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:10:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:08 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e090f423-eb1f-4938-ac62-90be786635f1]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:08 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Searching for a device in session 15 and hctl ['42', '*', '*', 0] yield: None {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:10:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:09 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Searching for a device in session 15 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:10:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPSqZscQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:10:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:10:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23937646165326565', 'path': '/dev/sdk'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:10:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937646165326565', 'path': '/dev/sdk'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:10:09 user nova-compute[73917]: DEBUG nova.objects.instance [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Lazy-loading 'flavor' on Instance uuid f019c6c6-e76f-4a75-8ba4-8c566d9f5791 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:10:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:10:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] COPY block job progress, current cursor: 96468992 final cursor: 1073741824 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:10:10 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] COPY block job progress, current cursor: 179306496 final cursor: 1073741824 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:10:10 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] COPY block job progress, current cursor: 357564416 final cursor: 1073741824 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:10:11 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] COPY block job progress, current cursor: 432013312 final cursor: 1073741824 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:10:11 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] COPY block job progress, current cursor: 596639744 final cursor: 1073741824 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:10:12 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] COPY block job progress, current cursor: 730857472 final cursor: 1073741824 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:10:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:12 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] COPY block job progress, current cursor: 875560960 final cursor: 1073741824 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:10:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] COPY block job progress, current cursor: 1028653056 final cursor: 1073741824 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:10:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mznEgDVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:10:14 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:10:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[01851ed2-7d0a-4637-9007-eadc32b7faec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[453c9542-d9e5-4dae-80f7-13d9380b5c71]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:14 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:10:14 user nova-compute[73917]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 (non-flash)
Aug 26 19:10:14 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:14 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:14 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:14 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:14 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:14 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:14 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:14 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:14 user nova-compute[73917]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:10:14 user nova-compute[73917]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 (non-flash)
Aug 26 19:10:14 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:14 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:14 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:14 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:14 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:14 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:14 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:14 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b786a76d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4'): ({'sdj'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Removing single pathed devices sdj {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[605def09-6e7c-4daa-a58d-b969c55ea622]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[62253332-87d6-4c3c-82ec-c9981c4a5508]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Flushing IO for device /dev/sdj {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d73daf3-e9e7-4326-9a8e-28d07c7550d9]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.058s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d1dc6e-dafd-4fa7-89c3-8eac8370defc]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] SCSI volumes sdj have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa58f9f2-a4a1-4da4-a685-5bc85718456c]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a13181-0107-42ec-95e9-e48ec1520b77]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4, portal: 172.16.0.220,3260]
Aug 26 19:10:14 user nova-compute[73917]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4, portal: 172.16.0.220,3260] successful.
Aug 26 19:10:14 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[749beb9a-25c9-4cd1-9e71-72d66d0a5dd0]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] <== disconnect_volume: return (339ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPSqZscQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': 'f019c6c6-e76f-4a75-8ba4-8c566d9f5791', 'attached_at': '', 'detached_at': '', 'volume_id': 'ebae4a7e-65a5-4ecc-b06d-450a84b90047', 'serial'} {{(pid=73917) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] swap_volume: removing Cinder connection for volume c9c6466e-3525-42d6-8a7b-df107660ffd4 {{(pid=73917) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 26 19:10:14 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693076999.508574, c8f0be92-c7bf-49cd-a4a4-23e625603081 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:10:14 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] VM Stopped (Lifecycle Event)
Aug 26 19:10:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-e8a95d23-69e6-4d53-8569-72e667f92a27 None None] [instance: c8f0be92-c7bf-49cd-a4a4-23e625603081] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:10:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] swap_volume: Updating volume c9c6466e-3525-42d6-8a7b-df107660ffd4 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "FPSqZscQ", "auth_password": "lzfpt40OJBi5Ay", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "ebae4a7e-65a5-4ecc-b06d-450a84b90047"}, "status": "reserved", "instance": "f019c6c6-e76f-4a75-8ba4-8c566d9f5791", "attached_at": "", "detached_at": "", "volume_id": "ebae4a7e-65a5-4ecc-b06d-450a84b90047", "serial": "ebae4a7e-65a5-4ecc-b06d-450a84b90047"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ebae4a7e-65a5-4ecc-b06d-450a84b90047', 'no_device': None, 'attachment_id': 'b0c18046-305d-4f48-b6de-96ddb6edf806'} {{(pid=73917) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 26 19:10:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4163b977-38fa-404b-a60c-165c276fecde tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 23.450s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Acquiring lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG os_brick.utils [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadb2c7b-27c8-481d-9377-52b5cd2155ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd66c5e-08d9-402d-9972-0743305d6207]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[220960c0-5805-4027-88ac-b1b5abd4a815]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1893525-1abe-4825-9a34-58e565416ea7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:10:18 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:10:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f7f8e1-ec38-42bf-8d0a-7e13ab623931]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:10:18 user nova-compute[73917]: DEBUG os_brick.utils [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:10:18 user nova-compute[73917]: INFO nova.compute.manager [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Swapping volume ebae4a7e-65a5-4ecc-b06d-450a84b90047 for c9c6466e-3525-42d6-8a7b-df107660ffd4
Aug 26 19:10:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mznEgDVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f019c6c6-e76f-4a75-8ba4-8c566d9f5791', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9c6466e-3525-42d6-8a7b-df107660ffd4', 'serial': 'c9c6466e-3525-42d6-8a7b-df107660ffd4'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPSqZscQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'ebae4a7e-65a5-4ecc-b06d-450a84b90047'}, 'status': 'reserved', 'instance': 'f019c6c6-e76f-4a75-8ba4-8c566d9f5791', 'attached_at': '', 'detached_at': '', 'volume_id': 'ebae4a7e-65a5-4ecc-b06d-450a84b90047', 'serial'} {{(pid=73917) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mznEgDVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:10:31 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:10:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:10:31 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:10:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:10:31 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb4b38f-8f41-4009-a2e0-bf52dbb34d38]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:10:31 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb85d5c3-ac8b-4bd9-90b1-ccd7beb955e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4] added
Aug 26 19:10:31 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6aad3d-725d-4864-aa6c-9fe36f5927a1]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc6735b-82a2-4791-acf2-7c8b67a9e000]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mznEgDVt {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mznEgDVt" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f893acec-8a63-4441-9536-81c1f1faafac]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mznEgDVt'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[695b41c8-ca6f-4c1c-b28c-dd5dfbdbdc80]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1723e76-302b-450f-aced-8450e9daef00]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:31 user nova-compute[73917]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 (non-flash)
Aug 26 19:10:31 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:31 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:31 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:31 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:31 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:31 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:31 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:31 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:31 user nova-compute[73917]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 (non-flash)
Aug 26 19:10:31 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:31 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:31 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:31 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:31 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:31 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:31 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:31 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe1f841-3e8c-4b4d-878b-241fda351a9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4, portal: 172.16.0.220,3260]
Aug 26 19:10:32 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4, portal: 172.16.0.220,3260] successful.
Aug 26 19:10:32 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfba9e4-ef0a-4ace-bc3e-213745717091]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccd4b04-8269-4c99-9b8c-1f1d7a0cc647]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:32 user nova-compute[73917]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 (non-flash)
Aug 26 19:10:32 user nova-compute[73917]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:10:32 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:32 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:32 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:32 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:32 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:32 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:32 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:32 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:10:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:32 user nova-compute[73917]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 (non-flash)
Aug 26 19:10:32 user nova-compute[73917]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:10:32 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:32 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:32 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:32 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:32 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:32 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:32 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:32 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:10:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:10:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:10:32 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] HCTL ('41', '-', '-', 0) found on session 16 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:10:32 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:10:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f220330-abbc-472f-b11d-ee097cef054f]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:32 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Searching for a device in session 16 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:10:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mznEgDVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:10:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:33 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:10:33 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23464356637353662', 'path': '/dev/sdj'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:10:33 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464356637353662', 'path': '/dev/sdj'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:10:33 user nova-compute[73917]: DEBUG nova.objects.instance [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Lazy-loading 'flavor' on Instance uuid f019c6c6-e76f-4a75-8ba4-8c566d9f5791 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:10:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:33 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:10:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] COPY block job progress, current cursor: 158334976 final cursor: 1073741824 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:10:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] COPY block job progress, current cursor: 320864256 final cursor: 1073741824 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:10:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] COPY block job progress, current cursor: 483393536 final cursor: 1073741824 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:10:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] COPY block job progress, current cursor: 632291328 final cursor: 1073741824 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:10:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] COPY block job progress, current cursor: 791674880 final cursor: 1073741824 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:10:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] COPY block job progress, current cursor: 964689920 final cursor: 1073741824 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPSqZscQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'ebae4a7e-65a5-4ecc-b06d-450a84b90047'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:10:37 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:10:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca21b647-5f6b-47dc-98d7-345431fd2378]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c26400-112d-4a41-9fdf-d2628d5eba25]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:37 user nova-compute[73917]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 (non-flash)
Aug 26 19:10:37 user nova-compute[73917]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:10:37 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:37 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:37 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:37 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:37 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:37 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:37 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:37 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:37 user nova-compute[73917]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 (non-flash)
Aug 26 19:10:37 user nova-compute[73917]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:10:37 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:37 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:37 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:37 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:37 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:37 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:37 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:37 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b786431c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047'): ({'sdk'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Removing single pathed devices sdk {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf471b6-0def-48d5-a381-efe93c843cf0]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ca22c4-178c-46c8-937d-808a0c50b70c]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Flushing IO for device /dev/sdk {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.012s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f882cae3-5bb9-4c08-b914-739546a47728]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.054s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bd8176-321b-41f9-a76f-e8cf2a7e9cfb]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] SCSI volumes sdk have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc36f7a9-78c5-4fcf-9c80-1d434ce60425]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41bfb4f-2a8c-40cf-a50f-6e47deeda5c7]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047, portal: 172.16.0.220,3260]
Aug 26 19:10:37 user nova-compute[73917]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047, portal: 172.16.0.220,3260] successful.
Aug 26 19:10:37 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebae4a7e-65a5-4ecc-b06d-450a84b90047 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[71db518f-fab2-4274-b9c0-ed3145ec64d5]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] <== disconnect_volume: return (347ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mznEgDVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'f019c6c6-e76f-4a75-8ba4-8c566d9f5791', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9c6466e-3525-42d6-8a7b-df107660ffd4', 'serial'} {{(pid=73917) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] swap_volume: removing Cinder connection for volume ebae4a7e-65a5-4ecc-b06d-450a84b90047 {{(pid=73917) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 26 19:10:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:38 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] swap_volume: Updating volume ebae4a7e-65a5-4ecc-b06d-450a84b90047 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "mznEgDVt", "auth_password": "eLUvJgOGtV9D0d", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "c9c6466e-3525-42d6-8a7b-df107660ffd4"}, "status": "reserved", "instance": "f019c6c6-e76f-4a75-8ba4-8c566d9f5791", "attached_at": "", "detached_at": "", "volume_id": "c9c6466e-3525-42d6-8a7b-df107660ffd4", "serial": "c9c6466e-3525-42d6-8a7b-df107660ffd4"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'c9c6466e-3525-42d6-8a7b-df107660ffd4', 'no_device': None, 'attachment_id': 'e4e495ac-0c9d-4866-9b4d-1dc4649759e9'} {{(pid=73917) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 26 19:10:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3c420d4-78cc-4ef7-934f-71e37d20b748 tempest-TestVolumeSwap-2140532078 tempest-TestVolumeSwap-2140532078-project-admin] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.063s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Acquiring lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:39 user nova-compute[73917]: INFO nova.compute.manager [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Detaching volume c9c6466e-3525-42d6-8a7b-df107660ffd4
Aug 26 19:10:39 user nova-compute[73917]: INFO nova.virt.block_device [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Attempting to driver detach volume c9c6466e-3525-42d6-8a7b-df107660ffd4 from mountpoint /dev/vdb
Aug 26 19:10:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Attempting to detach device vdb from instance f019c6c6-e76f-4a75-8ba4-8c566d9f5791 from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:10:39 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:10:39 user nova-compute[73917]:   <source dev="/dev/sdj"/>
Aug 26 19:10:39 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:10:39 user nova-compute[73917]:   <serial>c9c6466e-3525-42d6-8a7b-df107660ffd4</serial>
Aug 26 19:10:39 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:10:39 user nova-compute[73917]: </disk>
Aug 26 19:10:39 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:10:39 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Successfully detached device vdb from instance f019c6c6-e76f-4a75-8ba4-8c566d9f5791 from the persistent domain config.
Aug 26 19:10:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f019c6c6-e76f-4a75-8ba4-8c566d9f5791 from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:10:39 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:10:39 user nova-compute[73917]:   <source dev="/dev/sdj"/>
Aug 26 19:10:39 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:10:39 user nova-compute[73917]:   <serial>c9c6466e-3525-42d6-8a7b-df107660ffd4</serial>
Aug 26 19:10:39 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:10:39 user nova-compute[73917]: </disk>
Aug 26 19:10:39 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693077039.8097901, f019c6c6-e76f-4a75-8ba4-8c566d9f5791 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f019c6c6-e76f-4a75-8ba4-8c566d9f5791 {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:10:39 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Successfully detached device vdb from instance f019c6c6-e76f-4a75-8ba4-8c566d9f5791 from the live domain config.
Aug 26 19:10:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mznEgDVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'c9c6466e-3525-42d6-8a7b-df107660ffd4'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:10:39 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:10:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[da628d34-cc67-43e7-a1f1-3f3ce1f69c48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdc5e6c-10b7-42c2-abcd-b376ce76093c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:39 user nova-compute[73917]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:10:39 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:39 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:39 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:39 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:39 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:39 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:39 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:39 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:39 user nova-compute[73917]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 (non-flash)
Aug 26 19:10:39 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:39 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:39 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:39 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:39 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:39 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:39 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:39 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b786437f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4'): ({'sdj'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Removing single pathed devices sdj {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5edfc4-ad79-48db-b257-42d950a51e9e]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d58810-af53-4182-8cfe-69233b7eed33]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Flushing IO for device /dev/sdj {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae5ef9d-dd10-4973-a597-6c6c9a82a732]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.045s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb3392a-56ce-41ac-886f-511ce1b635ef]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:10:39 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] SCSI volumes sdj have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:10:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:10:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e537d5-cbcb-4ff7-8036-b1cf7a3751b5]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a248ce-8b81-4e7c-b5a0-df0d6fab59b4]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4, portal: 172.16.0.220,3260]
Aug 26 19:10:40 user nova-compute[73917]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4, portal: 172.16.0.220,3260] successful.
Aug 26 19:10:40 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c6466e-3525-42d6-8a7b-df107660ffd4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ca344f-ee1d-4292-91cb-d9bed44da21a]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:10:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] <== disconnect_volume: return (324ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:10:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:10:40 user nova-compute[73917]: DEBUG nova.objects.instance [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lazy-loading 'flavor' on Instance uuid f019c6c6-e76f-4a75-8ba4-8c566d9f5791 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:10:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c76687e2-dead-4707-ba70-ecc6b25e97e6 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.669s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Acquiring lock "08ecabd0-f539-4068-9150-74e873809133" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "08ecabd0-f539-4068-9150-74e873809133" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:10:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:41 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:10:41 user nova-compute[73917]: INFO nova.compute.claims [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Claim successful on node user
Aug 26 19:10:42 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG nova.network.neutron [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:10:42 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:10:42 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:10:42 user nova-compute[73917]: INFO nova.virt.block_device [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Booting with volume b057f77a-308f-4ef1-ac20-bd064c4ca481 at /dev/vda
Aug 26 19:10:42 user nova-compute[73917]: DEBUG nova.policy [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ddca966a7694d04b252599a47f4078e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '820b033209b644249a7b064b4ca6c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG os_brick.utils [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86c0b10-928e-4470-8344-d45aa51a7896]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd31769-3b96-492a-9868-e980e92fc0c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1a58c7-6fdc-42a1-bb89-5ce8192ad67f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad804268-3bab-4cc7-8c56-a58aef0d68dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:10:42 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:10:42 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09a8273-3d32-4f36-8bd0-bb85dfafa6c6]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG os_brick.utils [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Updating existing volume attachment record: d54560f0-bac3-4458-a67d-83c672185c02 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:10:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:43 user nova-compute[73917]: DEBUG nova.network.neutron [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Successfully created port: 895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:10:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:43 user nova-compute[73917]: DEBUG nova.network.neutron [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Successfully updated port: 895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:10:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Acquiring lock "refresh_cache-08ecabd0-f539-4068-9150-74e873809133" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:10:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Acquired lock "refresh_cache-08ecabd0-f539-4068-9150-74e873809133" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:10:43 user nova-compute[73917]: DEBUG nova.network.neutron [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:10:43 user nova-compute[73917]: DEBUG nova.compute.manager [req-2ebbfaf4-9f8d-4aa0-9404-434c6be814fd req-ff6976b8-5234-4a41-ae24-f247dde4508e service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Received event network-changed-895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:10:43 user nova-compute[73917]: DEBUG nova.compute.manager [req-2ebbfaf4-9f8d-4aa0-9404-434c6be814fd req-ff6976b8-5234-4a41-ae24-f247dde4508e service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Refreshing instance network info cache due to event network-changed-895c0971-95b8-490f-95b5-386c50ba29c8. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:10:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2ebbfaf4-9f8d-4aa0-9404-434c6be814fd req-ff6976b8-5234-4a41-ae24-f247dde4508e service nova] Acquiring lock "refresh_cache-08ecabd0-f539-4068-9150-74e873809133" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:10:43 user nova-compute[73917]: DEBUG nova.network.neutron [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:10:44 user nova-compute[73917]: DEBUG nova.network.neutron [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Updating instance_info_cache with network_info: [{"id": "895c0971-95b8-490f-95b5-386c50ba29c8", "address": "fa:16:3e:b0:8c:eb", "network": {"id": "ad75441f-c776-426b-8ada-8fc89037e592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-909384262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820b033209b644249a7b064b4ca6c23f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895c0971-95", "ovs_interfaceid": "895c0971-95b8-490f-95b5-386c50ba29c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:10:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Releasing lock "refresh_cache-08ecabd0-f539-4068-9150-74e873809133" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:10:44 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Instance network_info: |[{"id": "895c0971-95b8-490f-95b5-386c50ba29c8", "address": "fa:16:3e:b0:8c:eb", "network": {"id": "ad75441f-c776-426b-8ada-8fc89037e592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-909384262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820b033209b644249a7b064b4ca6c23f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895c0971-95", "ovs_interfaceid": "895c0971-95b8-490f-95b5-386c50ba29c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:10:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2ebbfaf4-9f8d-4aa0-9404-434c6be814fd req-ff6976b8-5234-4a41-ae24-f247dde4508e service nova] Acquired lock "refresh_cache-08ecabd0-f539-4068-9150-74e873809133" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:10:44 user nova-compute[73917]: DEBUG nova.network.neutron [req-2ebbfaf4-9f8d-4aa0-9404-434c6be814fd req-ff6976b8-5234-4a41-ae24-f247dde4508e service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Refreshing network info cache for port 895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:10:44 user nova-compute[73917]: DEBUG nova.network.neutron [req-2ebbfaf4-9f8d-4aa0-9404-434c6be814fd req-ff6976b8-5234-4a41-ae24-f247dde4508e service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Updated VIF entry in instance network info cache for port 895c0971-95b8-490f-95b5-386c50ba29c8. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:10:44 user nova-compute[73917]: DEBUG nova.network.neutron [req-2ebbfaf4-9f8d-4aa0-9404-434c6be814fd req-ff6976b8-5234-4a41-ae24-f247dde4508e service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Updating instance_info_cache with network_info: [{"id": "895c0971-95b8-490f-95b5-386c50ba29c8", "address": "fa:16:3e:b0:8c:eb", "network": {"id": "ad75441f-c776-426b-8ada-8fc89037e592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-909384262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820b033209b644249a7b064b4ca6c23f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895c0971-95", "ovs_interfaceid": "895c0971-95b8-490f-95b5-386c50ba29c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:10:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2ebbfaf4-9f8d-4aa0-9404-434c6be814fd req-ff6976b8-5234-4a41-ae24-f247dde4508e service nova] Releasing lock "refresh_cache-08ecabd0-f539-4068-9150-74e873809133" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:10:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:10:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "c4218678-e287-4f07-8af1-59469bbcd6bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:10:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:10:51 user nova-compute[73917]: INFO nova.compute.claims [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Claim successful on node user
Aug 26 19:10:52 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:10:52 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:10:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:10:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:10:52 user nova-compute[73917]: DEBUG nova.network.neutron [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:10:52 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:10:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:10:52 user nova-compute[73917]: DEBUG nova.policy [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd1b7d3fe22c4b239cf03235866e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e09fe7b38e4bb991bfaaf5b4ad357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:10:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:10:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:10:52 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Creating image(s)
Aug 26 19:10:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "/opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "/opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.188s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.192s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk 1073741824" returned: 0 in 0.054s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquiring lock "86937c34-db86-44a9-8196-3cae0d7ce400" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "86937c34-db86-44a9-8196-3cae0d7ce400" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquiring lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:53 user nova-compute[73917]: INFO nova.compute.manager [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Terminating instance
Aug 26 19:10:53 user nova-compute[73917]: DEBUG nova.compute.manager [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG nova.network.neutron [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Successfully created port: faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.198s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Cannot resize image /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Ensure instance console log exists: /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-059a1401-a3d2-4b5d-9dfd-45d9d10b0b52 req-0e6c5e5c-f1c3-46f5-9a8e-49ea410040d4 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received event network-vif-unplugged-0fd58968-f9e8-40f0-acff-8efea741379e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-059a1401-a3d2-4b5d-9dfd-45d9d10b0b52 req-0e6c5e5c-f1c3-46f5-9a8e-49ea410040d4 service nova] Acquiring lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-059a1401-a3d2-4b5d-9dfd-45d9d10b0b52 req-0e6c5e5c-f1c3-46f5-9a8e-49ea410040d4 service nova] Lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-059a1401-a3d2-4b5d-9dfd-45d9d10b0b52 req-0e6c5e5c-f1c3-46f5-9a8e-49ea410040d4 service nova] Lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-059a1401-a3d2-4b5d-9dfd-45d9d10b0b52 req-0e6c5e5c-f1c3-46f5-9a8e-49ea410040d4 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] No waiting events found dispatching network-vif-unplugged-0fd58968-f9e8-40f0-acff-8efea741379e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-059a1401-a3d2-4b5d-9dfd-45d9d10b0b52 req-0e6c5e5c-f1c3-46f5-9a8e-49ea410040d4 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received event network-vif-unplugged-0fd58968-f9e8-40f0-acff-8efea741379e for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:10:53 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Instance destroyed successfully.
Aug 26 19:10:53 user nova-compute[73917]: DEBUG nova.objects.instance [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lazy-loading 'resources' on Instance uuid 86937c34-db86-44a9-8196-3cae0d7ce400 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152870467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1152870467',id=10,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh0Gq1qVrt69OKjzmbhUuqTEU+L2JyHLQ3aEGP1I2l94+VWUqaxZlu45tMYdws2tmkIV0iudsUfn6jRdBXdutT2e0DfOoTHtyHz97pVCSRiDLTiyRN8NsP3m644FqnDUA==',key_name='tempest-keypair-2122776356',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cec3e3b818b54192b32d90bb8240515e',ramdisk_id='',reservation_id='r-8k2gu0ce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1228202789',owner_user_name='tempest-TaggedAttachmentsTest-1228202789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e883bb35273c4f9cacdc443695962e5d',uuid=86937c34-db86-44a9-8196-3cae0d7ce400,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fd58968-f9e8-40f0-acff-8efea741379e", "address": "fa:16:3e:b3:2d:13", "network": {"id": "02545642-9a23-4d7d-8ff0-231150ea7ced", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2072904890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd58968-f9", "ovs_interfaceid": "0fd58968-f9e8-40f0-acff-8efea741379e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:10:53 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Converting VIF {"id": "0fd58968-f9e8-40f0-acff-8efea741379e", "address": "fa:16:3e:b3:2d:13", "network": {"id": "02545642-9a23-4d7d-8ff0-231150ea7ced", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2072904890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec3e3b818b54192b32d90bb8240515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd58968-f9", "ovs_interfaceid": "0fd58968-f9e8-40f0-acff-8efea741379e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:2d:13,bridge_name='br-int',has_traffic_filtering=True,id=0fd58968-f9e8-40f0-acff-8efea741379e,network=Network(02545642-9a23-4d7d-8ff0-231150ea7ced),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd58968-f9') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG os_vif [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:2d:13,bridge_name='br-int',has_traffic_filtering=True,id=0fd58968-f9e8-40f0-acff-8efea741379e,network=Network(02545642-9a23-4d7d-8ff0-231150ea7ced),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd58968-f9') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fd58968-f9, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:54 user nova-compute[73917]: INFO os_vif [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:2d:13,bridge_name='br-int',has_traffic_filtering=True,id=0fd58968-f9e8-40f0-acff-8efea741379e,network=Network(02545642-9a23-4d7d-8ff0-231150ea7ced),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd58968-f9')
Aug 26 19:10:54 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Deleting instance files /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400_del
Aug 26 19:10:54 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Deletion of /opt/stack/data/nova/instances/86937c34-db86-44a9-8196-3cae0d7ce400_del complete
Aug 26 19:10:54 user nova-compute[73917]: INFO nova.compute.manager [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 26 19:10:54 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.network.neutron [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Successfully updated port: faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "refresh_cache-c4218678-e287-4f07-8af1-59469bbcd6bd" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquired lock "refresh_cache-c4218678-e287-4f07-8af1-59469bbcd6bd" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.network.neutron [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.compute.manager [req-7ce51fe9-39de-4031-9368-100e23584369 req-c33f3f3e-b5c9-4d0b-b582-be5b19908223 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Received event network-changed-faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.compute.manager [req-7ce51fe9-39de-4031-9368-100e23584369 req-c33f3f3e-b5c9-4d0b-b582-be5b19908223 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Refreshing instance network info cache due to event network-changed-faf9dd57-b9f3-4eec-af4d-b95205ffea78. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-7ce51fe9-39de-4031-9368-100e23584369 req-c33f3f3e-b5c9-4d0b-b582-be5b19908223 service nova] Acquiring lock "refresh_cache-c4218678-e287-4f07-8af1-59469bbcd6bd" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.network.neutron [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.network.neutron [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Updating instance_info_cache with network_info: [{"id": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "address": "fa:16:3e:ee:57:64", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf9dd57-b9", "ovs_interfaceid": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Releasing lock "refresh_cache-c4218678-e287-4f07-8af1-59469bbcd6bd" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Instance network_info: |[{"id": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "address": "fa:16:3e:ee:57:64", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf9dd57-b9", "ovs_interfaceid": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-7ce51fe9-39de-4031-9368-100e23584369 req-c33f3f3e-b5c9-4d0b-b582-be5b19908223 service nova] Acquired lock "refresh_cache-c4218678-e287-4f07-8af1-59469bbcd6bd" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.network.neutron [req-7ce51fe9-39de-4031-9368-100e23584369 req-c33f3f3e-b5c9-4d0b-b582-be5b19908223 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Refreshing network info cache for port faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Start _get_guest_xml network_info=[{"id": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "address": "fa:16:3e:ee:57:64", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf9dd57-b9", "ovs_interfaceid": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:10:54 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:10:54 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-843239325',display_name='tempest-tempest.common.compute-instance-843239325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-843239325',id=16,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOklNSOL9r1q/zNv/+3lsUzJeS13Yy6booypQqav1LdRa4o4bUXxStD8Zbc/LQrFJOxHm0LxGHgW2WZ+4aH+DXEkJob/ZjlhQDrC3ATS52MugxelqEnl2LwwmyLXCgc3bw==',key_name='tempest-keypair-258176439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2e09fe7b38e4bb991bfaaf5b4ad357a',ramdisk_id='',reservation_id='r-cn28ztmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2069094918',owner_user_name='tempest-ServerActionsTestOtherA-2069094918-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:10:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd1b7d3fe22c4b239cf03235866e17d4',uuid=c4218678-e287-4f07-8af1-59469bbcd6bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "address": "fa:16:3e:ee:57:64", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf9dd57-b9", "ovs_interfaceid": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converting VIF {"id": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "address": "fa:16:3e:ee:57:64", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf9dd57-b9", "ovs_interfaceid": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:57:64,bridge_name='br-int',has_traffic_filtering=True,id=faf9dd57-b9f3-4eec-af4d-b95205ffea78,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf9dd57-b9') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.objects.instance [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lazy-loading 'pci_devices' on Instance uuid c4218678-e287-4f07-8af1-59469bbcd6bd {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:10:54 user nova-compute[73917]:   <uuid>c4218678-e287-4f07-8af1-59469bbcd6bd</uuid>
Aug 26 19:10:54 user nova-compute[73917]:   <name>instance-00000010</name>
Aug 26 19:10:54 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:10:54 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:10:54 user nova-compute[73917]:   <metadata>
Aug 26 19:10:54 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:10:54 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:10:54 user nova-compute[73917]:       <nova:name>tempest-tempest.common.compute-instance-843239325</nova:name>
Aug 26 19:10:54 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:10:54</nova:creationTime>
Aug 26 19:10:54 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:10:54 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:10:54 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:10:54 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:10:54 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:10:54 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:10:54 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:10:54 user nova-compute[73917]:       <nova:owner>
Aug 26 19:10:54 user nova-compute[73917]:         <nova:user uuid="cd1b7d3fe22c4b239cf03235866e17d4">tempest-ServerActionsTestOtherA-2069094918-project-member</nova:user>
Aug 26 19:10:54 user nova-compute[73917]:         <nova:project uuid="c2e09fe7b38e4bb991bfaaf5b4ad357a">tempest-ServerActionsTestOtherA-2069094918</nova:project>
Aug 26 19:10:54 user nova-compute[73917]:       </nova:owner>
Aug 26 19:10:54 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:10:54 user nova-compute[73917]:       <nova:ports>
Aug 26 19:10:54 user nova-compute[73917]:         <nova:port uuid="faf9dd57-b9f3-4eec-af4d-b95205ffea78">
Aug 26 19:10:54 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 19:10:54 user nova-compute[73917]:         </nova:port>
Aug 26 19:10:54 user nova-compute[73917]:       </nova:ports>
Aug 26 19:10:54 user nova-compute[73917]:     </nova:instance>
Aug 26 19:10:54 user nova-compute[73917]:   </metadata>
Aug 26 19:10:54 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:10:54 user nova-compute[73917]:     <system>
Aug 26 19:10:54 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:10:54 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:10:54 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:10:54 user nova-compute[73917]:       <entry name="serial">c4218678-e287-4f07-8af1-59469bbcd6bd</entry>
Aug 26 19:10:54 user nova-compute[73917]:       <entry name="uuid">c4218678-e287-4f07-8af1-59469bbcd6bd</entry>
Aug 26 19:10:54 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:10:54 user nova-compute[73917]:     </system>
Aug 26 19:10:54 user nova-compute[73917]:   </sysinfo>
Aug 26 19:10:54 user nova-compute[73917]:   <os>
Aug 26 19:10:54 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:10:54 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:10:54 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:10:54 user nova-compute[73917]:   </os>
Aug 26 19:10:54 user nova-compute[73917]:   <features>
Aug 26 19:10:54 user nova-compute[73917]:     <acpi/>
Aug 26 19:10:54 user nova-compute[73917]:     <apic/>
Aug 26 19:10:54 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:10:54 user nova-compute[73917]:   </features>
Aug 26 19:10:54 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:10:54 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:10:54 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:10:54 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:10:54 user nova-compute[73917]:   </clock>
Aug 26 19:10:54 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:10:54 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:10:54 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:10:54 user nova-compute[73917]:   </cpu>
Aug 26 19:10:54 user nova-compute[73917]:   <devices>
Aug 26 19:10:54 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:10:54 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:10:54 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk"/>
Aug 26 19:10:54 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:10:54 user nova-compute[73917]:     </disk>
Aug 26 19:10:54 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:10:54 user nova-compute[73917]:       <mac address="fa:16:3e:ee:57:64"/>
Aug 26 19:10:54 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:10:54 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:10:54 user nova-compute[73917]:       <target dev="tapfaf9dd57-b9"/>
Aug 26 19:10:54 user nova-compute[73917]:     </interface>
Aug 26 19:10:54 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:10:54 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/console.log" append="off"/>
Aug 26 19:10:54 user nova-compute[73917]:     </serial>
Aug 26 19:10:54 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:10:54 user nova-compute[73917]:     <video>
Aug 26 19:10:54 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:10:54 user nova-compute[73917]:     </video>
Aug 26 19:10:54 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:10:54 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:10:54 user nova-compute[73917]:     </rng>
Aug 26 19:10:54 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:10:54 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:10:54 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:10:54 user nova-compute[73917]:     </memballoon>
Aug 26 19:10:54 user nova-compute[73917]:   </devices>
Aug 26 19:10:54 user nova-compute[73917]: </domain>
Aug 26 19:10:54 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-843239325',display_name='tempest-tempest.common.compute-instance-843239325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-843239325',id=16,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOklNSOL9r1q/zNv/+3lsUzJeS13Yy6booypQqav1LdRa4o4bUXxStD8Zbc/LQrFJOxHm0LxGHgW2WZ+4aH+DXEkJob/ZjlhQDrC3ATS52MugxelqEnl2LwwmyLXCgc3bw==',key_name='tempest-keypair-258176439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2e09fe7b38e4bb991bfaaf5b4ad357a',ramdisk_id='',reservation_id='r-cn28ztmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2069094918',owner_user_name='tempest-ServerActionsTestOtherA-2069094918-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:10:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd1b7d3fe22c4b239cf03235866e17d4',uuid=c4218678-e287-4f07-8af1-59469bbcd6bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "address": "fa:16:3e:ee:57:64", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf9dd57-b9", "ovs_interfaceid": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converting VIF {"id": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "address": "fa:16:3e:ee:57:64", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf9dd57-b9", "ovs_interfaceid": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:57:64,bridge_name='br-int',has_traffic_filtering=True,id=faf9dd57-b9f3-4eec-af4d-b95205ffea78,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf9dd57-b9') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG os_vif [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:57:64,bridge_name='br-int',has_traffic_filtering=True,id=faf9dd57-b9f3-4eec-af4d-b95205ffea78,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf9dd57-b9') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfaf9dd57-b9, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfaf9dd57-b9, col_values=(('external_ids', {'iface-id': 'faf9dd57-b9f3-4eec-af4d-b95205ffea78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:57:64', 'vm-uuid': 'c4218678-e287-4f07-8af1-59469bbcd6bd'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:54 user nova-compute[73917]: INFO os_vif [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:57:64,bridge_name='br-int',has_traffic_filtering=True,id=faf9dd57-b9f3-4eec-af4d-b95205ffea78,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf9dd57-b9')
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:10:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] No VIF found with MAC fa:16:3e:ee:57:64, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.network.neutron [req-7ce51fe9-39de-4031-9368-100e23584369 req-c33f3f3e-b5c9-4d0b-b582-be5b19908223 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Updated VIF entry in instance network info cache for port faf9dd57-b9f3-4eec-af4d-b95205ffea78. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.network.neutron [req-7ce51fe9-39de-4031-9368-100e23584369 req-c33f3f3e-b5c9-4d0b-b582-be5b19908223 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Updating instance_info_cache with network_info: [{"id": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "address": "fa:16:3e:ee:57:64", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf9dd57-b9", "ovs_interfaceid": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-7ce51fe9-39de-4031-9368-100e23584369 req-c33f3f3e-b5c9-4d0b-b582-be5b19908223 service nova] Releasing lock "refresh_cache-c4218678-e287-4f07-8af1-59469bbcd6bd" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:10:55 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Took 1.05 seconds to deallocate network for instance.
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.480s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:10:55 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Creating image(s)
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Did not create local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Ensure instance console log exists: /opt/stack/data/nova/instances/08ecabd0-f539-4068-9150-74e873809133/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Start _get_guest_xml network_info=[{"id": "895c0971-95b8-490f-95b5-386c50ba29c8", "address": "fa:16:3e:b0:8c:eb", "network": {"id": "ad75441f-c776-426b-8ada-8fc89037e592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-909384262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820b033209b644249a7b064b4ca6c23f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895c0971-95", "ovs_interfaceid": "895c0971-95b8-490f-95b5-386c50ba29c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGkZoHXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '08ecabd0-f539-4068-9150-74e873809133', 'attached_at': '', 'detached_at': '', 'volume_id': 'b057f77a-308f-4ef1-ac20-bd064c4ca481', 'serial': 'b057f77a-308f-4ef1-ac20-bd064c4ca481'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'd54560f0-bac3-4458-a67d-83c672185c02', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:10:55 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Deleted allocations for instance 86937c34-db86-44a9-8196-3cae0d7ce400
Aug 26 19:10:55 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:10:55 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGkZoHXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:10:55 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:10:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:10:55 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:10:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:10:55 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a2a3d3-8065-43fe-8ff2-749ee32cd127]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:10:55 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6a5452c4-0014-48b2-8b81-34000d7f9c52 tempest-TaggedAttachmentsTest-1228202789 tempest-TaggedAttachmentsTest-1228202789-project-member] Lock "86937c34-db86-44a9-8196-3cae0d7ce400" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.676s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6391fa9e-7109-4572-82de-3165c65445b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481] added
Aug 26 19:10:55 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52e8ef0-3a4b-428e-ad25-a9c82dbdaf5f]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.compute.manager [req-640e39f5-2fa5-45b5-8d35-702688f55a77 req-90d6bf9f-54cb-4833-b681-d3e628523e96 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received event network-vif-plugged-0fd58968-f9e8-40f0-acff-8efea741379e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-640e39f5-2fa5-45b5-8d35-702688f55a77 req-90d6bf9f-54cb-4833-b681-d3e628523e96 service nova] Acquiring lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-640e39f5-2fa5-45b5-8d35-702688f55a77 req-90d6bf9f-54cb-4833-b681-d3e628523e96 service nova] Lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-640e39f5-2fa5-45b5-8d35-702688f55a77 req-90d6bf9f-54cb-4833-b681-d3e628523e96 service nova] Lock "86937c34-db86-44a9-8196-3cae0d7ce400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.compute.manager [req-640e39f5-2fa5-45b5-8d35-702688f55a77 req-90d6bf9f-54cb-4833-b681-d3e628523e96 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] No waiting events found dispatching network-vif-plugged-0fd58968-f9e8-40f0-acff-8efea741379e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:10:55 user nova-compute[73917]: WARNING nova.compute.manager [req-640e39f5-2fa5-45b5-8d35-702688f55a77 req-90d6bf9f-54cb-4833-b681-d3e628523e96 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received unexpected event network-vif-plugged-0fd58968-f9e8-40f0-acff-8efea741379e for instance with vm_state deleted and task_state None.
Aug 26 19:10:55 user nova-compute[73917]: DEBUG nova.compute.manager [req-640e39f5-2fa5-45b5-8d35-702688f55a77 req-90d6bf9f-54cb-4833-b681-d3e628523e96 service nova] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Received event network-vif-deleted-0fd58968-f9e8-40f0-acff-8efea741379e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b92b61-47cf-4552-9626-a46b087cb7c8]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sGkZoHXP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sGkZoHXP" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd77bc6-dc4e-4a48-a20d-819ef45e20c6]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sGkZoHXP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1e9d5c-8447-41f9-853f-ea4c7c82435e]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e5c81f-5964-49b9-a03b-98da867fbdc1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:56 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:56 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e55dc7-9e59-4194-835f-bcabb8af4e1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481, portal: 172.16.0.220,3260]
Aug 26 19:10:56 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481, portal: 172.16.0.220,3260] successful.
Aug 26 19:10:56 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca3d4f0-5a86-4d75-8345-c93b39f66d59]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9274afb7-9e95-40d4-ba1a-a4cf826b2383]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:56 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:10:56 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:10:56 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] HCTL ('41', '-', '-', 0) found on session 17 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[71df2abf-2dd6-4dd5-be83-cc79ec4d8769]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Searching for a device in session 17 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGkZoHXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG nova.objects.instance [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lazy-loading 'flavor' on Instance uuid 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:56 user nova-compute[73917]: INFO nova.compute.manager [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Attaching volume 1db76c5d-a93f-421a-a23d-797da93b388d to /dev/vdb
Aug 26 19:10:56 user nova-compute[73917]: DEBUG os_brick.utils [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf23e3c-4bf4-47c9-a1c2-6d801e122b2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdfaf09-bae1-4496-8127-bb98cf0e99f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7111f1e-0a5f-4051-8a76-e885e33430cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c89f96e-5850-43d0-86e0-511c793d4b16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:10:56 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:10:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90f215a-a12f-4600-80bb-a93eb4f38a93]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG os_brick.utils [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:10:56 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Updating existing volume attachment record: 8f543643-c637-4eb3-b55d-d55b2409acc7 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-fdfb377e-119e-41ce-b9e0-6e21053306cc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-fdfb377e-119e-41ce-b9e0-6e21053306cc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23133373834306630', 'path': '/dev/sdj'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133373834306630', 'path': '/dev/sdj'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-847741481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-847741481',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILuuKhhd8SBkV1rvvqP3lRG/pwSBnr43r+z6CsGpn0WvVX9OQC0V+eSZCDA4YsPtHza5LR1n8VcvXIU4KZevCoPCULj3dhrVlzQmOhcxjRhz3Cu3v86zWvhmqTkFn+daA==',key_name='tempest-keypair-1708956738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='820b033209b644249a7b064b4ca6c23f',ramdisk_id='',reservation_id='r-0arw7nc1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1172188124',owner_user_name='tempest-ServerActionsV293TestJSON-1172188124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ddca966a7694d04b252599a47f4078e',uuid=08ecabd0-f539-4068-9150-74e873809133,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "895c0971-95b8-490f-95b5-386c50ba29c8", "address": "fa:16:3e:b0:8c:eb", "network": {"id": "ad75441f-c776-426b-8ada-8fc89037e592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-909384262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820b033209b644249a7b064b4ca6c23f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895c0971-95", "ovs_interfaceid": "895c0971-95b8-490f-95b5-386c50ba29c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Converting VIF {"id": "895c0971-95b8-490f-95b5-386c50ba29c8", "address": "fa:16:3e:b0:8c:eb", "network": {"id": "ad75441f-c776-426b-8ada-8fc89037e592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-909384262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820b033209b644249a7b064b4ca6c23f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895c0971-95", "ovs_interfaceid": "895c0971-95b8-490f-95b5-386c50ba29c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=895c0971-95b8-490f-95b5-386c50ba29c8,network=Network(ad75441f-c776-426b-8ada-8fc89037e592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895c0971-95') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.objects.instance [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lazy-loading 'pci_devices' on Instance uuid 08ecabd0-f539-4068-9150-74e873809133 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:10:57 user nova-compute[73917]:   <uuid>08ecabd0-f539-4068-9150-74e873809133</uuid>
Aug 26 19:10:57 user nova-compute[73917]:   <name>instance-0000000f</name>
Aug 26 19:10:57 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:10:57 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:10:57 user nova-compute[73917]:   <metadata>
Aug 26 19:10:57 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:10:57 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:10:57 user nova-compute[73917]:       <nova:name>tempest-ServerActionsV293TestJSON-server-847741481</nova:name>
Aug 26 19:10:57 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:10:55</nova:creationTime>
Aug 26 19:10:57 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:10:57 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:10:57 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:10:57 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:10:57 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:10:57 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:10:57 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:10:57 user nova-compute[73917]:       <nova:owner>
Aug 26 19:10:57 user nova-compute[73917]:         <nova:user uuid="4ddca966a7694d04b252599a47f4078e">tempest-ServerActionsV293TestJSON-1172188124-project-member</nova:user>
Aug 26 19:10:57 user nova-compute[73917]:         <nova:project uuid="820b033209b644249a7b064b4ca6c23f">tempest-ServerActionsV293TestJSON-1172188124</nova:project>
Aug 26 19:10:57 user nova-compute[73917]:       </nova:owner>
Aug 26 19:10:57 user nova-compute[73917]:       <nova:ports>
Aug 26 19:10:57 user nova-compute[73917]:         <nova:port uuid="895c0971-95b8-490f-95b5-386c50ba29c8">
Aug 26 19:10:57 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 19:10:57 user nova-compute[73917]:         </nova:port>
Aug 26 19:10:57 user nova-compute[73917]:       </nova:ports>
Aug 26 19:10:57 user nova-compute[73917]:     </nova:instance>
Aug 26 19:10:57 user nova-compute[73917]:   </metadata>
Aug 26 19:10:57 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:10:57 user nova-compute[73917]:     <system>
Aug 26 19:10:57 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:10:57 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:10:57 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:10:57 user nova-compute[73917]:       <entry name="serial">08ecabd0-f539-4068-9150-74e873809133</entry>
Aug 26 19:10:57 user nova-compute[73917]:       <entry name="uuid">08ecabd0-f539-4068-9150-74e873809133</entry>
Aug 26 19:10:57 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:10:57 user nova-compute[73917]:     </system>
Aug 26 19:10:57 user nova-compute[73917]:   </sysinfo>
Aug 26 19:10:57 user nova-compute[73917]:   <os>
Aug 26 19:10:57 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:10:57 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:10:57 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:10:57 user nova-compute[73917]:   </os>
Aug 26 19:10:57 user nova-compute[73917]:   <features>
Aug 26 19:10:57 user nova-compute[73917]:     <acpi/>
Aug 26 19:10:57 user nova-compute[73917]:     <apic/>
Aug 26 19:10:57 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:10:57 user nova-compute[73917]:   </features>
Aug 26 19:10:57 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:10:57 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:10:57 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:10:57 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:10:57 user nova-compute[73917]:   </clock>
Aug 26 19:10:57 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:10:57 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:10:57 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:10:57 user nova-compute[73917]:   </cpu>
Aug 26 19:10:57 user nova-compute[73917]:   <devices>
Aug 26 19:10:57 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:10:57 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:10:57 user nova-compute[73917]:       <source dev="/dev/sdj"/>
Aug 26 19:10:57 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:10:57 user nova-compute[73917]:       <serial>b057f77a-308f-4ef1-ac20-bd064c4ca481</serial>
Aug 26 19:10:57 user nova-compute[73917]:     </disk>
Aug 26 19:10:57 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:10:57 user nova-compute[73917]:       <mac address="fa:16:3e:b0:8c:eb"/>
Aug 26 19:10:57 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:10:57 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:10:57 user nova-compute[73917]:       <target dev="tap895c0971-95"/>
Aug 26 19:10:57 user nova-compute[73917]:     </interface>
Aug 26 19:10:57 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:10:57 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/08ecabd0-f539-4068-9150-74e873809133/console.log" append="off"/>
Aug 26 19:10:57 user nova-compute[73917]:     </serial>
Aug 26 19:10:57 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:10:57 user nova-compute[73917]:     <video>
Aug 26 19:10:57 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:10:57 user nova-compute[73917]:     </video>
Aug 26 19:10:57 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:10:57 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:10:57 user nova-compute[73917]:     </rng>
Aug 26 19:10:57 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:10:57 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:10:57 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:10:57 user nova-compute[73917]:     </memballoon>
Aug 26 19:10:57 user nova-compute[73917]:   </devices>
Aug 26 19:10:57 user nova-compute[73917]: </domain>
Aug 26 19:10:57 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-847741481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-847741481',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILuuKhhd8SBkV1rvvqP3lRG/pwSBnr43r+z6CsGpn0WvVX9OQC0V+eSZCDA4YsPtHza5LR1n8VcvXIU4KZevCoPCULj3dhrVlzQmOhcxjRhz3Cu3v86zWvhmqTkFn+daA==',key_name='tempest-keypair-1708956738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='820b033209b644249a7b064b4ca6c23f',ramdisk_id='',reservation_id='r-0arw7nc1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1172188124',owner_user_name='tempest-ServerActionsV293TestJSON-1172188124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ddca966a7694d04b252599a47f4078e',uuid=08ecabd0-f539-4068-9150-74e873809133,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "895c0971-95b8-490f-95b5-386c50ba29c8", "address": "fa:16:3e:b0:8c:eb", "network": {"id": "ad75441f-c776-426b-8ada-8fc89037e592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-909384262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820b033209b644249a7b064b4ca6c23f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895c0971-95", "ovs_interfaceid": "895c0971-95b8-490f-95b5-386c50ba29c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Converting VIF {"id": "895c0971-95b8-490f-95b5-386c50ba29c8", "address": "fa:16:3e:b0:8c:eb", "network": {"id": "ad75441f-c776-426b-8ada-8fc89037e592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-909384262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820b033209b644249a7b064b4ca6c23f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895c0971-95", "ovs_interfaceid": "895c0971-95b8-490f-95b5-386c50ba29c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=895c0971-95b8-490f-95b5-386c50ba29c8,network=Network(ad75441f-c776-426b-8ada-8fc89037e592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895c0971-95') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG os_vif [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=895c0971-95b8-490f-95b5-386c50ba29c8,network=Network(ad75441f-c776-426b-8ada-8fc89037e592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895c0971-95') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap895c0971-95, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap895c0971-95, col_values=(('external_ids', {'iface-id': '895c0971-95b8-490f-95b5-386c50ba29c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:8c:eb', 'vm-uuid': '08ecabd0-f539-4068-9150-74e873809133'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:57 user nova-compute[73917]: INFO os_vif [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=895c0971-95b8-490f-95b5-386c50ba29c8,network=Network(ad75441f-c776-426b-8ada-8fc89037e592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895c0971-95')
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] No VIF found with MAC fa:16:3e:b0:8c:eb, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Updating instance_info_cache with network_info: [{"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-fdfb377e-119e-41ce-b9e0-6e21053306cc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.compute.manager [req-fb296354-b6c4-4c7d-aebe-05e534ea3ca7 req-01a6455e-ee74-4eef-be3a-610b850c0b96 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Received event network-vif-plugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fb296354-b6c4-4c7d-aebe-05e534ea3ca7 req-01a6455e-ee74-4eef-be3a-610b850c0b96 service nova] Acquiring lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fb296354-b6c4-4c7d-aebe-05e534ea3ca7 req-01a6455e-ee74-4eef-be3a-610b850c0b96 service nova] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fb296354-b6c4-4c7d-aebe-05e534ea3ca7 req-01a6455e-ee74-4eef-be3a-610b850c0b96 service nova] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.compute.manager [req-fb296354-b6c4-4c7d-aebe-05e534ea3ca7 req-01a6455e-ee74-4eef-be3a-610b850c0b96 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] No waiting events found dispatching network-vif-plugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:10:57 user nova-compute[73917]: WARNING nova.compute.manager [req-fb296354-b6c4-4c7d-aebe-05e534ea3ca7 req-01a6455e-ee74-4eef-be3a-610b850c0b96 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Received unexpected event network-vif-plugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 for instance with vm_state building and task_state spawning.
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.compute.manager [req-fb296354-b6c4-4c7d-aebe-05e534ea3ca7 req-01a6455e-ee74-4eef-be3a-610b850c0b96 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Received event network-vif-plugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fb296354-b6c4-4c7d-aebe-05e534ea3ca7 req-01a6455e-ee74-4eef-be3a-610b850c0b96 service nova] Acquiring lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fb296354-b6c4-4c7d-aebe-05e534ea3ca7 req-01a6455e-ee74-4eef-be3a-610b850c0b96 service nova] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fb296354-b6c4-4c7d-aebe-05e534ea3ca7 req-01a6455e-ee74-4eef-be3a-610b850c0b96 service nova] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:57 user nova-compute[73917]: DEBUG nova.compute.manager [req-fb296354-b6c4-4c7d-aebe-05e534ea3ca7 req-01a6455e-ee74-4eef-be3a-610b850c0b96 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] No waiting events found dispatching network-vif-plugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:10:57 user nova-compute[73917]: WARNING nova.compute.manager [req-fb296354-b6c4-4c7d-aebe-05e534ea3ca7 req-01a6455e-ee74-4eef-be3a-610b850c0b96 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Received unexpected event network-vif-plugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 for instance with vm_state building and task_state spawning.
Aug 26 19:10:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:10:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:10:58 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077058.25785, c4218678-e287-4f07-8af1-59469bbcd6bd => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:10:58 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] VM Resumed (Lifecycle Event)
Aug 26 19:10:58 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Instance spawned successfully.
Aug 26 19:10:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:10:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:10:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:10:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:10:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:10:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:10:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:10:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:10:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:10:58 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:10:58 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077058.2580886, c4218678-e287-4f07-8af1-59469bbcd6bd => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:10:58 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] VM Started (Lifecycle Event)
Aug 26 19:10:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:10:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:10:58 user nova-compute[73917]: INFO nova.compute.manager [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Took 5.72 seconds to spawn the instance on the hypervisor.
Aug 26 19:10:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:10:58 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:10:58 user nova-compute[73917]: INFO nova.compute.manager [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Took 6.56 seconds to build instance.
Aug 26 19:10:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bc26ae32-9fc7-41cd-aaa2-568c5a262a28 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.663s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:59 user nova-compute[73917]: DEBUG nova.compute.manager [req-1b958a57-2f72-420f-8137-b9c4dbe28458 req-c8742cef-3b48-44bc-8a66-7eaf6f8abdc4 service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Received event network-vif-plugged-895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:10:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1b958a57-2f72-420f-8137-b9c4dbe28458 req-c8742cef-3b48-44bc-8a66-7eaf6f8abdc4 service nova] Acquiring lock "08ecabd0-f539-4068-9150-74e873809133-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:10:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1b958a57-2f72-420f-8137-b9c4dbe28458 req-c8742cef-3b48-44bc-8a66-7eaf6f8abdc4 service nova] Lock "08ecabd0-f539-4068-9150-74e873809133-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:10:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1b958a57-2f72-420f-8137-b9c4dbe28458 req-c8742cef-3b48-44bc-8a66-7eaf6f8abdc4 service nova] Lock "08ecabd0-f539-4068-9150-74e873809133-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:10:59 user nova-compute[73917]: DEBUG nova.compute.manager [req-1b958a57-2f72-420f-8137-b9c4dbe28458 req-c8742cef-3b48-44bc-8a66-7eaf6f8abdc4 service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] No waiting events found dispatching network-vif-plugged-895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:10:59 user nova-compute[73917]: WARNING nova.compute.manager [req-1b958a57-2f72-420f-8137-b9c4dbe28458 req-c8742cef-3b48-44bc-8a66-7eaf6f8abdc4 service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Received unexpected event network-vif-plugged-895c0971-95b8-490f-95b5-386c50ba29c8 for instance with vm_state building and task_state spawning.
Aug 26 19:10:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:10:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077061.1968555, 08ecabd0-f539-4068-9150-74e873809133 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:11:01 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 08ecabd0-f539-4068-9150-74e873809133] VM Resumed (Lifecycle Event)
Aug 26 19:11:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:11:01 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 08ecabd0-f539-4068-9150-74e873809133] Instance spawned successfully.
Aug 26 19:11:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 08ecabd0-f539-4068-9150-74e873809133] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 08ecabd0-f539-4068-9150-74e873809133] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:11:01 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 08ecabd0-f539-4068-9150-74e873809133] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:11:01 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077061.2031965, 08ecabd0-f539-4068-9150-74e873809133 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:11:01 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 08ecabd0-f539-4068-9150-74e873809133] VM Started (Lifecycle Event)
Aug 26 19:11:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 08ecabd0-f539-4068-9150-74e873809133] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 08ecabd0-f539-4068-9150-74e873809133] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:11:01 user nova-compute[73917]: INFO nova.compute.manager [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Took 5.58 seconds to spawn the instance on the hypervisor.
Aug 26 19:11:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:11:01 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 08ecabd0-f539-4068-9150-74e873809133] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:11:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG nova.compute.manager [req-69a07246-f8d9-4583-808e-5f90cfb4e6ff req-c1cc5879-2f0b-476d-9ddc-935dc6f68f68 service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Received event network-vif-plugged-895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-69a07246-f8d9-4583-808e-5f90cfb4e6ff req-c1cc5879-2f0b-476d-9ddc-935dc6f68f68 service nova] Acquiring lock "08ecabd0-f539-4068-9150-74e873809133-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-69a07246-f8d9-4583-808e-5f90cfb4e6ff req-c1cc5879-2f0b-476d-9ddc-935dc6f68f68 service nova] Lock "08ecabd0-f539-4068-9150-74e873809133-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-69a07246-f8d9-4583-808e-5f90cfb4e6ff req-c1cc5879-2f0b-476d-9ddc-935dc6f68f68 service nova] Lock "08ecabd0-f539-4068-9150-74e873809133-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG nova.compute.manager [req-69a07246-f8d9-4583-808e-5f90cfb4e6ff req-c1cc5879-2f0b-476d-9ddc-935dc6f68f68 service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] No waiting events found dispatching network-vif-plugged-895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:01 user nova-compute[73917]: WARNING nova.compute.manager [req-69a07246-f8d9-4583-808e-5f90cfb4e6ff req-c1cc5879-2f0b-476d-9ddc-935dc6f68f68 service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Received unexpected event network-vif-plugged-895c0971-95b8-490f-95b5-386c50ba29c8 for instance with vm_state building and task_state spawning.
Aug 26 19:11:01 user nova-compute[73917]: INFO nova.compute.manager [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Took 19.61 seconds to build instance.
Aug 26 19:11:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4106753a-541a-4450-bcea-f9d07761ebdb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "08ecabd0-f539-4068-9150-74e873809133" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.733s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:11:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:11:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:11:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:11:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:11:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:11:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.264s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Acquiring lock "c5120da8-5837-420f-b472-572a088a4a27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Lock "c5120da8-5837-420f-b472-572a088a4a27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Acquiring lock "c5120da8-5837-420f-b472-572a088a4a27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Lock "c5120da8-5837-420f-b472-572a088a4a27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Lock "c5120da8-5837-420f-b472-572a088a4a27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:04 user nova-compute[73917]: INFO nova.compute.manager [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Terminating instance
Aug 26 19:11:04 user nova-compute[73917]: DEBUG nova.compute.manager [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:11:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-1eff763d-395b-412d-829d-fb1c15caeb53 req-4511ec7b-a3ff-4f18-b587-115cdd35c15f service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] Received event network-vif-unplugged-39a5bed1-340d-44b2-9312-9f797f781447 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1eff763d-395b-412d-829d-fb1c15caeb53 req-4511ec7b-a3ff-4f18-b587-115cdd35c15f service nova] Acquiring lock "c5120da8-5837-420f-b472-572a088a4a27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1eff763d-395b-412d-829d-fb1c15caeb53 req-4511ec7b-a3ff-4f18-b587-115cdd35c15f service nova] Lock "c5120da8-5837-420f-b472-572a088a4a27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1eff763d-395b-412d-829d-fb1c15caeb53 req-4511ec7b-a3ff-4f18-b587-115cdd35c15f service nova] Lock "c5120da8-5837-420f-b472-572a088a4a27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-1eff763d-395b-412d-829d-fb1c15caeb53 req-4511ec7b-a3ff-4f18-b587-115cdd35c15f service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] No waiting events found dispatching network-vif-unplugged-39a5bed1-340d-44b2-9312-9f797f781447 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-1eff763d-395b-412d-829d-fb1c15caeb53 req-4511ec7b-a3ff-4f18-b587-115cdd35c15f service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] Received event network-vif-unplugged-39a5bed1-340d-44b2-9312-9f797f781447 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:05 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: c5120da8-5837-420f-b472-572a088a4a27] Instance destroyed successfully.
Aug 26 19:11:05 user nova-compute[73917]: DEBUG nova.objects.instance [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Lazy-loading 'resources' on Instance uuid c5120da8-5837-420f-b472-572a088a4a27 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-290413173',display_name='tempest-VolumesAssistedSnapshotsTest-server-290413173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-290413173',id=11,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAZ0XuwhMYQD20wwnirKMU1msQN99FkCF2Ymk54ImrGX5Tj4XtXEfzcHHlY4ast1i7aG+nSliKRq5CjBiovV6vEM9hWlRge1oYmDpZKElvXLKITmIJc65WfCbY1WGC7lA==',key_name='tempest-keypair-508155102',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:08:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65039916cc424226be394dcb7abc714e',ramdisk_id='',reservation_id='r-de4rnykx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1979715060',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1979715060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:08:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5de04166b4a4eeaba3916c447a6ee69',uuid=c5120da8-5837-420f-b472-572a088a4a27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39a5bed1-340d-44b2-9312-9f797f781447", "address": "fa:16:3e:41:f3:a7", "network": {"id": "5d4fd3f9-2b4a-4416-8eaf-b1ee0a23f8f0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-676704280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65039916cc424226be394dcb7abc714e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a5bed1-34", "ovs_interfaceid": "39a5bed1-340d-44b2-9312-9f797f781447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Converting VIF {"id": "39a5bed1-340d-44b2-9312-9f797f781447", "address": "fa:16:3e:41:f3:a7", "network": {"id": "5d4fd3f9-2b4a-4416-8eaf-b1ee0a23f8f0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-676704280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65039916cc424226be394dcb7abc714e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a5bed1-34", "ovs_interfaceid": "39a5bed1-340d-44b2-9312-9f797f781447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:f3:a7,bridge_name='br-int',has_traffic_filtering=True,id=39a5bed1-340d-44b2-9312-9f797f781447,network=Network(5d4fd3f9-2b4a-4416-8eaf-b1ee0a23f8f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a5bed1-34') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG os_vif [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:f3:a7,bridge_name='br-int',has_traffic_filtering=True,id=39a5bed1-340d-44b2-9312-9f797f781447,network=Network(5d4fd3f9-2b4a-4416-8eaf-b1ee0a23f8f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a5bed1-34') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39a5bed1-34, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:05 user nova-compute[73917]: INFO os_vif [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:f3:a7,bridge_name='br-int',has_traffic_filtering=True,id=39a5bed1-340d-44b2-9312-9f797f781447,network=Network(5d4fd3f9-2b4a-4416-8eaf-b1ee0a23f8f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a5bed1-34')
Aug 26 19:11:05 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Deleting instance files /opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27_del
Aug 26 19:11:05 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Deletion of /opt/stack/data/nova/instances/c5120da8-5837-420f-b472-572a088a4a27_del complete
Aug 26 19:11:05 user nova-compute[73917]: INFO nova.compute.manager [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] [instance: c5120da8-5837-420f-b472-572a088a4a27] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 26 19:11:05 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: c5120da8-5837-420f-b472-572a088a4a27] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: c5120da8-5837-420f-b472-572a088a4a27] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:11:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:05 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Error from libvirt while getting description of instance-0000000b: [Error Code 42] Domain not found: no domain with matching uuid 'c5120da8-5837-420f-b472-572a088a4a27' (instance-0000000b): libvirt.libvirtError: Domain not found: no domain with matching uuid 'c5120da8-5837-420f-b472-572a088a4a27' (instance-0000000b)
Aug 26 19:11:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b/disk --force-share --output=json" returned: 0 in 0.336s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:11:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:11:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:11:07 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:11:07 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=7147MB free_disk=25.560874938964844GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: c5120da8-5837-420f-b472-572a088a4a27] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:07 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: c5120da8-5837-420f-b472-572a088a4a27] Took 1.49 seconds to deallocate network for instance.
Aug 26 19:11:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.manager [req-bd7f1f27-c0f8-409f-a10f-f5684b1b36e3 req-22a996ca-5eef-4342-8ea9-c2a165d3da3f service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] Received event network-vif-deleted-39a5bed1-340d-44b2-9312-9f797f781447 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 5dd60c10-f99a-431d-a66f-936a7a7a1c55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance cc0ae046-2a39-4ab6-9327-2d9452c3035d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fd801f18-34b6-4682-8d43-edf82bd216c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fdfb377e-119e-41ce-b9e0-6e21053306cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f019c6c6-e76f-4a75-8ba4-8c566d9f5791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c5120da8-5837-420f-b472-572a088a4a27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 54fd570d-421c-4a39-b4ae-772500b24cec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 2e449059-38d9-40bb-aa04-8b6c3865309b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 08ecabd0-f539-4068-9150-74e873809133 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c4218678-e287-4f07-8af1-59469bbcd6bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.manager [req-cd02f3cd-9546-404a-97b9-a5a118ee3c50 req-7743aa20-06d1-47c1-a9ce-00bdd6fb6221 service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] Received event network-vif-plugged-39a5bed1-340d-44b2-9312-9f797f781447 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cd02f3cd-9546-404a-97b9-a5a118ee3c50 req-7743aa20-06d1-47c1-a9ce-00bdd6fb6221 service nova] Acquiring lock "c5120da8-5837-420f-b472-572a088a4a27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cd02f3cd-9546-404a-97b9-a5a118ee3c50 req-7743aa20-06d1-47c1-a9ce-00bdd6fb6221 service nova] Lock "c5120da8-5837-420f-b472-572a088a4a27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cd02f3cd-9546-404a-97b9-a5a118ee3c50 req-7743aa20-06d1-47c1-a9ce-00bdd6fb6221 service nova] Lock "c5120da8-5837-420f-b472-572a088a4a27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.manager [req-cd02f3cd-9546-404a-97b9-a5a118ee3c50 req-7743aa20-06d1-47c1-a9ce-00bdd6fb6221 service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] No waiting events found dispatching network-vif-plugged-39a5bed1-340d-44b2-9312-9f797f781447 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:07 user nova-compute[73917]: WARNING nova.compute.manager [req-cd02f3cd-9546-404a-97b9-a5a118ee3c50 req-7743aa20-06d1-47c1-a9ce-00bdd6fb6221 service nova] [instance: c5120da8-5837-420f-b472-572a088a4a27] Received unexpected event network-vif-plugged-39a5bed1-340d-44b2-9312-9f797f781447 for instance with vm_state deleted and task_state None.
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.703s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.511s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:08 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:11:08 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:11:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.548s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:08 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Deleted allocations for instance c5120da8-5837-420f-b472-572a088a4a27
Aug 26 19:11:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e1c74b1d-3cb4-4904-b40c-be6fe0dd676a tempest-VolumesAssistedSnapshotsTest-1979715060 tempest-VolumesAssistedSnapshotsTest-1979715060-project-member] Lock "c5120da8-5837-420f-b472-572a088a4a27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.761s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:08 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077053.9729533, 86937c34-db86-44a9-8196-3cae0d7ce400 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:11:08 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] VM Stopped (Lifecycle Event)
Aug 26 19:11:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f86540b3-74d3-4c84-9534-0e1c166f7d42 None None] [instance: 86937c34-db86-44a9-8196-3cae0d7ce400] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:11:09 user nova-compute[73917]: DEBUG nova.compute.manager [req-a466bf1e-b04f-4c62-a6a2-f0f24d7fe2ef req-2fc256ba-20a7-4a64-94b8-942ef0458576 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-changed-9268e463-2367-4d84-be0e-f432a917b945 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:09 user nova-compute[73917]: DEBUG nova.compute.manager [req-a466bf1e-b04f-4c62-a6a2-f0f24d7fe2ef req-2fc256ba-20a7-4a64-94b8-942ef0458576 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Refreshing instance network info cache due to event network-changed-9268e463-2367-4d84-be0e-f432a917b945. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:11:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a466bf1e-b04f-4c62-a6a2-f0f24d7fe2ef req-2fc256ba-20a7-4a64-94b8-942ef0458576 service nova] Acquiring lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:11:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a466bf1e-b04f-4c62-a6a2-f0f24d7fe2ef req-2fc256ba-20a7-4a64-94b8-942ef0458576 service nova] Acquired lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:11:09 user nova-compute[73917]: DEBUG nova.network.neutron [req-a466bf1e-b04f-4c62-a6a2-f0f24d7fe2ef req-2fc256ba-20a7-4a64-94b8-942ef0458576 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Refreshing network info cache for port 9268e463-2367-4d84-be0e-f432a917b945 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:11:10 user nova-compute[73917]: DEBUG nova.compute.manager [req-0975e714-b20a-4e88-819b-e879bf71edbc req-7f06075f-9b22-4a2b-be12-ed2e94ad2b7f service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Received event network-changed-47597ca6-32f6-4311-b24d-2857c005fb86 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:10 user nova-compute[73917]: DEBUG nova.compute.manager [req-0975e714-b20a-4e88-819b-e879bf71edbc req-7f06075f-9b22-4a2b-be12-ed2e94ad2b7f service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Refreshing instance network info cache due to event network-changed-47597ca6-32f6-4311-b24d-2857c005fb86. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:11:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0975e714-b20a-4e88-819b-e879bf71edbc req-7f06075f-9b22-4a2b-be12-ed2e94ad2b7f service nova] Acquiring lock "refresh_cache-2e449059-38d9-40bb-aa04-8b6c3865309b" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:11:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0975e714-b20a-4e88-819b-e879bf71edbc req-7f06075f-9b22-4a2b-be12-ed2e94ad2b7f service nova] Acquired lock "refresh_cache-2e449059-38d9-40bb-aa04-8b6c3865309b" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:11:10 user nova-compute[73917]: DEBUG nova.network.neutron [req-0975e714-b20a-4e88-819b-e879bf71edbc req-7f06075f-9b22-4a2b-be12-ed2e94ad2b7f service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Refreshing network info cache for port 47597ca6-32f6-4311-b24d-2857c005fb86 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:11:10 user nova-compute[73917]: DEBUG nova.network.neutron [req-a466bf1e-b04f-4c62-a6a2-f0f24d7fe2ef req-2fc256ba-20a7-4a64-94b8-942ef0458576 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Updated VIF entry in instance network info cache for port 9268e463-2367-4d84-be0e-f432a917b945. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:11:10 user nova-compute[73917]: DEBUG nova.network.neutron [req-a466bf1e-b04f-4c62-a6a2-f0f24d7fe2ef req-2fc256ba-20a7-4a64-94b8-942ef0458576 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Updating instance_info_cache with network_info: [{"id": "9268e463-2367-4d84-be0e-f432a917b945", "address": "fa:16:3e:3c:5e:e6", "network": {"id": "b5165b66-cdc8-4b7f-ab73-feae1a655345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716155983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9268e463-23", "ovs_interfaceid": "9268e463-2367-4d84-be0e-f432a917b945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "address": "fa:16:3e:d7:d4:c6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc09729-80", "ovs_interfaceid": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22c864bd-81de-436b-9745-de2cf3cfffd5", "address": "fa:16:3e:2b:23:f6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c864bd-81", "ovs_interfaceid": "22c864bd-81de-436b-9745-de2cf3cfffd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "address": "fa:16:3e:ea:a2:cb", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1aa81-34", "ovs_interfaceid": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "address": "fa:16:3e:f6:f5:7c", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4bbc97-cf", "ovs_interfaceid": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19a44d0d-f673-49e9-8c62-014aff19769c", "address": "fa:16:3e:08:64:60", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a44d0d-f6", "ovs_interfaceid": "19a44d0d-f673-49e9-8c62-014aff19769c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "472badf6-8de1-4c67-8bfa-7105f672eff0", "address": "fa:16:3e:c9:52:16", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472badf6-8d", "ovs_interfaceid": "472badf6-8de1-4c67-8bfa-7105f672eff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a466bf1e-b04f-4c62-a6a2-f0f24d7fe2ef req-2fc256ba-20a7-4a64-94b8-942ef0458576 service nova] Releasing lock "refresh_cache-54fd570d-421c-4a39-b4ae-772500b24cec" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:11:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "2e449059-38d9-40bb-aa04-8b6c3865309b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "2e449059-38d9-40bb-aa04-8b6c3865309b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "2e449059-38d9-40bb-aa04-8b6c3865309b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "2e449059-38d9-40bb-aa04-8b6c3865309b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "2e449059-38d9-40bb-aa04-8b6c3865309b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:10 user nova-compute[73917]: INFO nova.compute.manager [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Terminating instance
Aug 26 19:11:10 user nova-compute[73917]: DEBUG nova.compute.manager [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:11:10 user nova-compute[73917]: DEBUG nova.network.neutron [req-0975e714-b20a-4e88-819b-e879bf71edbc req-7f06075f-9b22-4a2b-be12-ed2e94ad2b7f service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Updated VIF entry in instance network info cache for port 47597ca6-32f6-4311-b24d-2857c005fb86. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:11:10 user nova-compute[73917]: DEBUG nova.network.neutron [req-0975e714-b20a-4e88-819b-e879bf71edbc req-7f06075f-9b22-4a2b-be12-ed2e94ad2b7f service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Updating instance_info_cache with network_info: [{"id": "47597ca6-32f6-4311-b24d-2857c005fb86", "address": "fa:16:3e:e9:4e:c5", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47597ca6-32", "ovs_interfaceid": "47597ca6-32f6-4311-b24d-2857c005fb86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0975e714-b20a-4e88-819b-e879bf71edbc req-7f06075f-9b22-4a2b-be12-ed2e94ad2b7f service nova] Releasing lock "refresh_cache-2e449059-38d9-40bb-aa04-8b6c3865309b" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-19f5afe4-24dc-4dd3-b8e6-343c8ed2e5d9 req-a03abd28-c3c1-4a45-b345-52917686029c service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Received event network-vif-unplugged-47597ca6-32f6-4311-b24d-2857c005fb86 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-19f5afe4-24dc-4dd3-b8e6-343c8ed2e5d9 req-a03abd28-c3c1-4a45-b345-52917686029c service nova] Acquiring lock "2e449059-38d9-40bb-aa04-8b6c3865309b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-19f5afe4-24dc-4dd3-b8e6-343c8ed2e5d9 req-a03abd28-c3c1-4a45-b345-52917686029c service nova] Lock "2e449059-38d9-40bb-aa04-8b6c3865309b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-19f5afe4-24dc-4dd3-b8e6-343c8ed2e5d9 req-a03abd28-c3c1-4a45-b345-52917686029c service nova] Lock "2e449059-38d9-40bb-aa04-8b6c3865309b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-19f5afe4-24dc-4dd3-b8e6-343c8ed2e5d9 req-a03abd28-c3c1-4a45-b345-52917686029c service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] No waiting events found dispatching network-vif-unplugged-47597ca6-32f6-4311-b24d-2857c005fb86 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-19f5afe4-24dc-4dd3-b8e6-343c8ed2e5d9 req-a03abd28-c3c1-4a45-b345-52917686029c service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Received event network-vif-unplugged-47597ca6-32f6-4311-b24d-2857c005fb86 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:11:11 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Instance destroyed successfully.
Aug 26 19:11:11 user nova-compute[73917]: DEBUG nova.objects.instance [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lazy-loading 'resources' on Instance uuid 2e449059-38d9-40bb-aa04-8b6c3865309b {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:09:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-181003080',display_name='tempest-AttachVolumeNegativeTest-server-181003080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-181003080',id=14,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUsi9Pz8uXzuo584y/ESwFqG6J/kAl/D/5mwPFEr39hK4TZqXjrzvLpjbHgbaCKHGu1EM9FF5eZqtyVsxRtKG3BciTVJFk9GMWf6zcPzl7xmi/dCVatlzVQ2uBoAhcUPw==',key_name='tempest-keypair-1551013087',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:09:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b291bbf9aedc4414a1ab402602849140',ramdisk_id='',reservation_id='r-ntm60pjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2066333616',owner_user_name='tempest-AttachVolumeNegativeTest-2066333616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:09:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c64a5d226b8b4d60af840d49315bf60f',uuid=2e449059-38d9-40bb-aa04-8b6c3865309b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47597ca6-32f6-4311-b24d-2857c005fb86", "address": "fa:16:3e:e9:4e:c5", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47597ca6-32", "ovs_interfaceid": "47597ca6-32f6-4311-b24d-2857c005fb86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converting VIF {"id": "47597ca6-32f6-4311-b24d-2857c005fb86", "address": "fa:16:3e:e9:4e:c5", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47597ca6-32", "ovs_interfaceid": "47597ca6-32f6-4311-b24d-2857c005fb86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:4e:c5,bridge_name='br-int',has_traffic_filtering=True,id=47597ca6-32f6-4311-b24d-2857c005fb86,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47597ca6-32') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG os_vif [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:4e:c5,bridge_name='br-int',has_traffic_filtering=True,id=47597ca6-32f6-4311-b24d-2857c005fb86,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47597ca6-32') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47597ca6-32, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:11 user nova-compute[73917]: INFO os_vif [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:4e:c5,bridge_name='br-int',has_traffic_filtering=True,id=47597ca6-32f6-4311-b24d-2857c005fb86,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47597ca6-32')
Aug 26 19:11:11 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Deleting instance files /opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b_del
Aug 26 19:11:11 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Deletion of /opt/stack/data/nova/instances/2e449059-38d9-40bb-aa04-8b6c3865309b_del complete
Aug 26 19:11:11 user nova-compute[73917]: INFO nova.compute.manager [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Took 0.77 seconds to destroy the instance on the hypervisor.
Aug 26 19:11:11 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:11:11 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG nova.objects.instance [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'flavor' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "refresh_cache-fdfb377e-119e-41ce-b9e0-6e21053306cc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquired lock "refresh_cache-fdfb377e-119e-41ce-b9e0-6e21053306cc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG nova.network.neutron [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG nova.objects.instance [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'info_cache' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG nova.objects.base [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Object Instance<fdfb377e-119e-41ce-b9e0-6e21053306cc> lazy-loaded attributes: flavor,info_cache {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHCnuxqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:11:12 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:11:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:11:12 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:11:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:11:12 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260" returned: 21 in 0.041s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[309c0f0c-2a61-440b-831f-300475dd3bb3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:11:12 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "54fd570d-421c-4a39-b4ae-772500b24cec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:12 user nova-compute[73917]: INFO nova.compute.manager [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Terminating instance
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a610dd-f0c4-49a1-9d26-65a0c85959b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG nova.compute.manager [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d] added
Aug 26 19:11:12 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[24840b34-519a-45d1-afca-fd9d4194eb1e]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1d4d10-9bf4-4dc5-9952-502054e065a4]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sHCnuxqK {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sHCnuxqK" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8ddc79-014e-4751-bd2f-4c6d29d3ebba]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sHCnuxqK'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76d9139-0eee-4cfa-b317-467ca3cce20a]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3513b501-f92e-4e2e-a294-d4c8bab70a1f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:12 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:12 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:12 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:11:12 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:12 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:11:12 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:11:12 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:11:12 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:12 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:12 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:12 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:12 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:11:12 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:12 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:11:12 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:11:12 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:11:12 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:12 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e1c29f-b6e1-4b43-b4b1-058294d4b198]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d, portal: 172.16.0.220,3260]
Aug 26 19:11:13 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d, portal: 172.16.0.220,3260] successful.
Aug 26 19:11:13 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[105f8030-b192-4c60-b851-455b92d6650e]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.071s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5496e4-202a-4628-852e-1b35bdc295bb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:13 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:13 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:13 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:13 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:11:13 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:13 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:11:13 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:11:13 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:11:13 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:13 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:13 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:13 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:13 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:13 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:11:13 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:13 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:11:13 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:11:13 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:11:13 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:13 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.458s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] HCTL ('42', '-', '-', 0) found on session 18 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.031s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c9fe13-e347-4f8c-9289-c508f04397d9]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Searching for a device in session 18 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHCnuxqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-216d3cf4-4a50-4174-8519-cac5a1b9e556 req-da6bd0d0-0b74-49aa-99c4-1d10dcbcaa7b service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-unplugged-9268e463-2367-4d84-be0e-f432a917b945 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-216d3cf4-4a50-4174-8519-cac5a1b9e556 req-da6bd0d0-0b74-49aa-99c4-1d10dcbcaa7b service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-216d3cf4-4a50-4174-8519-cac5a1b9e556 req-da6bd0d0-0b74-49aa-99c4-1d10dcbcaa7b service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-216d3cf4-4a50-4174-8519-cac5a1b9e556 req-da6bd0d0-0b74-49aa-99c4-1d10dcbcaa7b service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-216d3cf4-4a50-4174-8519-cac5a1b9e556 req-da6bd0d0-0b74-49aa-99c4-1d10dcbcaa7b service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-unplugged-9268e463-2367-4d84-be0e-f432a917b945 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-216d3cf4-4a50-4174-8519-cac5a1b9e556 req-da6bd0d0-0b74-49aa-99c4-1d10dcbcaa7b service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-unplugged-9268e463-2367-4d84-be0e-f432a917b945 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-239ad8cd-97a4-4797-85f4-cc89e16caa66 req-16491eee-e13a-48ba-bed2-60755905e045 service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Received event network-vif-deleted-47597ca6-32f6-4311-b24d-2857c005fb86 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:13 user nova-compute[73917]: INFO nova.compute.manager [req-239ad8cd-97a4-4797-85f4-cc89e16caa66 req-16491eee-e13a-48ba-bed2-60755905e045 service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Neutron deleted interface 47597ca6-32f6-4311-b24d-2857c005fb86; detaching it from the instance and deleting it from the info cache
Aug 26 19:11:13 user nova-compute[73917]: DEBUG nova.network.neutron [req-239ad8cd-97a4-4797-85f4-cc89e16caa66 req-16491eee-e13a-48ba-bed2-60755905e045 service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:13 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Took 1.58 seconds to deallocate network for instance.
Aug 26 19:11:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-239ad8cd-97a4-4797-85f4-cc89e16caa66 req-16491eee-e13a-48ba-bed2-60755905e045 service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Detach interface failed, port_id=47597ca6-32f6-4311-b24d-2857c005fb86, reason: Instance 2e449059-38d9-40bb-aa04-8b6c3865309b could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-8c662aff-f32a-46a1-8b4c-92c4531e18ef req-c9968b8b-1a49-4a12-b621-b4b88f8e54a0 service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Received event network-vif-plugged-47597ca6-32f6-4311-b24d-2857c005fb86 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8c662aff-f32a-46a1-8b4c-92c4531e18ef req-c9968b8b-1a49-4a12-b621-b4b88f8e54a0 service nova] Acquiring lock "2e449059-38d9-40bb-aa04-8b6c3865309b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8c662aff-f32a-46a1-8b4c-92c4531e18ef req-c9968b8b-1a49-4a12-b621-b4b88f8e54a0 service nova] Lock "2e449059-38d9-40bb-aa04-8b6c3865309b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8c662aff-f32a-46a1-8b4c-92c4531e18ef req-c9968b8b-1a49-4a12-b621-b4b88f8e54a0 service nova] Lock "2e449059-38d9-40bb-aa04-8b6c3865309b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-8c662aff-f32a-46a1-8b4c-92c4531e18ef req-c9968b8b-1a49-4a12-b621-b4b88f8e54a0 service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] No waiting events found dispatching network-vif-plugged-47597ca6-32f6-4311-b24d-2857c005fb86 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:13 user nova-compute[73917]: WARNING nova.compute.manager [req-8c662aff-f32a-46a1-8b4c-92c4531e18ef req-c9968b8b-1a49-4a12-b621-b4b88f8e54a0 service nova] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Received unexpected event network-vif-plugged-47597ca6-32f6-4311-b24d-2857c005fb86 for instance with vm_state deleted and task_state None.
Aug 26 19:11:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG nova.network.neutron [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Updating instance_info_cache with network_info: [{"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Releasing lock "refresh_cache-fdfb377e-119e-41ce-b9e0-6e21053306cc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:13 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Instance destroyed successfully.
Aug 26 19:11:13 user nova-compute[73917]: DEBUG nova.objects.instance [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'resources' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG nova.objects.base [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Object Instance<fdfb377e-119e-41ce-b9e0-6e21053306cc> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-699122116',display_name='tempest-AttachVolumeTestJSON-server-699122116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-699122116',id=5,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHqeZabK3+K4aaugpyX8ly8/1rj5SN4GU9OQYd/thmmFlRmAKDNGqPnSs6iFVbJTbvqYDOtwahR3/8AlpHMnz55bssLgo5XLS59T+WFQ51mc2/usyY8DYb7AasV3fI19A==',key_name='tempest-keypair-67322035',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='abdcca8609e849618526a8b78385f77b',ramdisk_id='',reservation_id='r-mcpim35c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1084822713',owner_user_name='tempest-AttachVolumeTestJSON-1084822713-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47b6f8fcb8f49dfa2383dfbf37d6c30',uuid=fdfb377e-119e-41ce-b9e0-6e21053306cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converting VIF {"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG os_vif [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37aa792a-c3, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:13 user nova-compute[73917]: INFO os_vif [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3')
Aug 26 19:11:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hXixcyfT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:11:13 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:11:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:13 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.671s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:14 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Deleted allocations for instance 2e449059-38d9-40bb-aa04-8b6c3865309b
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.545s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] <== connect_volume: return (1546ms) {'type': 'block', 'scsi_wwn': '26333616437383331', 'path': '/dev/sdk'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333616437383331', 'path': '/dev/sdk'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.315s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.objects.instance [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lazy-loading 'flavor' on Instance uuid 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6e9b63f3-8882-41b1-9113-dd944e355dfa tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "2e449059-38d9-40bb-aa04-8b6c3865309b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.346s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.042s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc48e539-8a9b-4576-8ba2-c11077764ae6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:11:14 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:11:14 user nova-compute[73917]:   <source dev="/dev/sdk"/>
Aug 26 19:11:14 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:11:14 user nova-compute[73917]:   <serial>1db76c5d-a93f-421a-a23d-797da93b388d</serial>
Aug 26 19:11:14 user nova-compute[73917]: </disk>
Aug 26 19:11:14 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.056s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a695cee2-50b3-4933-abdc-b0db78c2b99e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:14 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:14 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:14 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:14 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:11:14 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:14 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:11:14 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:11:14 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:11:14 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:14 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:14 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:14 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:14 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:14 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:11:14 user nova-compute[73917]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:14 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:11:14 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:11:14 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:11:14 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:14 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b786af9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86'): ({'sde'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Removing single pathed devices sde {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f146fb-fd0d-495a-a285-d3c794dc8d3c]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f851ad8e-f558-46a0-907d-419896b484cb]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Flushing IO for device /dev/sde {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.034s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5544e86-b004-4265-971b-79f2fbb4435d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[531c7f0a-b5e8-4b20-8928-2d04f9124760]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] SCSI volumes sde have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[622ce8bc-9915-426a-a37c-e24e4f22684c]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.118s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[81395c2e-a292-48a1-b09c-831caba45d8b]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86, portal: 172.16.0.220,3260]
Aug 26 19:11:14 user nova-compute[73917]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86, portal: 172.16.0.220,3260] successful.
Aug 26 19:11:14 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4aa82e1-56d3-49e5-8f91-09a0366c71a5]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.520s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] <== disconnect_volume: return (835ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Start _get_guest_xml network_info=[{"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hXixcyfT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'fdfb377e-119e-41ce-b9e0-6e21053306cc', 'attached_at': '', 'detached_at': '', 'volume_id': '90b84430-2ecf-40e8-96de-912b95b5bf86', 'serial': '90b84430-2ecf-40e8-96de-912b95b5bf86'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': 'eb374e5a-a19c-4b28-9da3-e5beb440aa93', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.objects.instance [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'numa_topology' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.objects.base [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Object Instance<fdfb377e-119e-41ce-b9e0-6e21053306cc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:11:14 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:11:14 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.objects.instance [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'vcpu_model' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.objects.base [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Object Instance<fdfb377e-119e-41ce-b9e0-6e21053306cc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hXixcyfT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:11:14 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:11:14 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:11:14 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:14 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Instance destroyed successfully.
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.objects.instance [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lazy-loading 'resources' on Instance uuid 54fd570d-421c-4a39-b4ae-772500b24cec {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d8dbab-e76c-432c-928d-78426638728c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:11:14 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:09:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:09:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9268e463-2367-4d84-be0e-f432a917b945", "address": "fa:16:3e:3c:5e:e6", "network": {"id": "b5165b66-cdc8-4b7f-ab73-feae1a655345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716155983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9268e463-23", "ovs_interfaceid": "9268e463-2367-4d84-be0e-f432a917b945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "9268e463-2367-4d84-be0e-f432a917b945", "address": "fa:16:3e:3c:5e:e6", "network": {"id": "b5165b66-cdc8-4b7f-ab73-feae1a655345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716155983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9268e463-23", "ovs_interfaceid": "9268e463-2367-4d84-be0e-f432a917b945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:5e:e6,bridge_name='br-int',has_traffic_filtering=True,id=9268e463-2367-4d84-be0e-f432a917b945,network=Network(b5165b66-cdc8-4b7f-ab73-feae1a655345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9268e463-23') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:5e:e6,bridge_name='br-int',has_traffic_filtering=True,id=9268e463-2367-4d84-be0e-f432a917b945,network=Network(b5165b66-cdc8-4b7f-ab73-feae1a655345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9268e463-23') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9268e463-23, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef314acb-d486-41e4-9b26-f6744ca66fda]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86] added
Aug 26 19:11:14 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] No VIF found with MAC fa:16:3e:c9:58:2d, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c4c382-2c47-4aa5-a698-6a727af99823]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e0283d-b429-464a-ad9f-c8779f24c15f]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hXixcyfT {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:14 user nova-compute[73917]: INFO os_vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:5e:e6,bridge_name='br-int',has_traffic_filtering=True,id=9268e463-2367-4d84-be0e-f432a917b945,network=Network(b5165b66-cdc8-4b7f-ab73-feae1a655345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9268e463-23')
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:09:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:09:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "address": "fa:16:3e:d7:d4:c6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc09729-80", "ovs_interfaceid": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "address": "fa:16:3e:d7:d4:c6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc09729-80", "ovs_interfaceid": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d4:c6,bridge_name='br-int',has_traffic_filtering=True,id=dfc09729-80ce-463f-8ad4-4f16f8b304f2,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdfc09729-80') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG os_vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d4:c6,bridge_name='br-int',has_traffic_filtering=True,id=dfc09729-80ce-463f-8ad4-4f16f8b304f2,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdfc09729-80') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfc09729-80, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hXixcyfT" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[039c21c9-8bae-4491-8932-6be26b17e0a1]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hXixcyfT'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[959fdfbe-be94-4be0-a8ff-7b15f359b420]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:15 user nova-compute[73917]: INFO os_vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d4:c6,bridge_name='br-int',has_traffic_filtering=True,id=dfc09729-80ce-463f-8ad4-4f16f8b304f2,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdfc09729-80')
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:09:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:09:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22c864bd-81de-436b-9745-de2cf3cfffd5", "address": "fa:16:3e:2b:23:f6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c864bd-81", "ovs_interfaceid": "22c864bd-81de-436b-9745-de2cf3cfffd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "22c864bd-81de-436b-9745-de2cf3cfffd5", "address": "fa:16:3e:2b:23:f6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c864bd-81", "ovs_interfaceid": "22c864bd-81de-436b-9745-de2cf3cfffd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=22c864bd-81de-436b-9745-de2cf3cfffd5,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22c864bd-81') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=22c864bd-81de-436b-9745-de2cf3cfffd5,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22c864bd-81') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22c864bd-81, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87a1b13-936e-4839-985a-7df14dfd4f10]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:15 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:15 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4e8b0fcc-a929-4a8e-9544-9678eb8abfcf tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.442s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:15 user nova-compute[73917]: INFO os_vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=22c864bd-81de-436b-9745-de2cf3cfffd5,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22c864bd-81')
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:09:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:09:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "address": "fa:16:3e:ea:a2:cb", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1aa81-34", "ovs_interfaceid": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "address": "fa:16:3e:ea:a2:cb", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1aa81-34", "ovs_interfaceid": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a2:cb,bridge_name='br-int',has_traffic_filtering=True,id=eec1aa81-34b7-44ea-aa98-57b54a967dcc,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1aa81-34') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a2:cb,bridge_name='br-int',has_traffic_filtering=True,id=eec1aa81-34b7-44ea-aa98-57b54a967dcc,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1aa81-34') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeec1aa81-34, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:15 user nova-compute[73917]: INFO os_vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a2:cb,bridge_name='br-int',has_traffic_filtering=True,id=eec1aa81-34b7-44ea-aa98-57b54a967dcc,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1aa81-34')
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:09:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:09:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "address": "fa:16:3e:f6:f5:7c", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4bbc97-cf", "ovs_interfaceid": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "address": "fa:16:3e:f6:f5:7c", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4bbc97-cf", "ovs_interfaceid": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f5:7c,bridge_name='br-int',has_traffic_filtering=True,id=2d4bbc97-cf69-4155-8f62-0de77084cbdd,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d4bbc97-cf') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f5:7c,bridge_name='br-int',has_traffic_filtering=True,id=2d4bbc97-cf69-4155-8f62-0de77084cbdd,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d4bbc97-cf') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d4bbc97-cf, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --login" returned: 0 in 0.151s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3e6822-8982-460b-bbf6-0bde983c85a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86, portal: 172.16.0.220,3260]
Aug 26 19:11:15 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86, portal: 172.16.0.220,3260] successful.
Aug 26 19:11:15 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:15 user nova-compute[73917]: INFO os_vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f5:7c,bridge_name='br-int',has_traffic_filtering=True,id=2d4bbc97-cf69-4155-8f62-0de77084cbdd,network=Network(254b6d4e-6335-4a52-a0cb-8c4fdccef3a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d4bbc97-cf')
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:09:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:09:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19a44d0d-f673-49e9-8c62-014aff19769c", "address": "fa:16:3e:08:64:60", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a44d0d-f6", "ovs_interfaceid": "19a44d0d-f673-49e9-8c62-014aff19769c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "19a44d0d-f673-49e9-8c62-014aff19769c", "address": "fa:16:3e:08:64:60", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a44d0d-f6", "ovs_interfaceid": "19a44d0d-f673-49e9-8c62-014aff19769c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:64:60,bridge_name='br-int',has_traffic_filtering=True,id=19a44d0d-f673-49e9-8c62-014aff19769c,network=Network(df3ccd13-2ec7-4c92-94e4-82d953121d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a44d0d-f6') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:64:60,bridge_name='br-int',has_traffic_filtering=True,id=19a44d0d-f673-49e9-8c62-014aff19769c,network=Network(df3ccd13-2ec7-4c92-94e4-82d953121d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a44d0d-f6') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19a44d0d-f6, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fc7c39-e338-43de-bfbb-f5510d6cc285]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:15 user nova-compute[73917]: INFO os_vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:64:60,bridge_name='br-int',has_traffic_filtering=True,id=19a44d0d-f673-49e9-8c62-014aff19769c,network=Network(df3ccd13-2ec7-4c92-94e4-82d953121d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a44d0d-f6')
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-322773328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-322773328',id=12,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd5+rxabE1IwepMUsKFEqrlbja6XC/8NKJcPvEJuYntCAbCEYNRtfxfAGUHz+nTN2qye0UrFjOfBh8Kr56vCK9keBDFl7WOdQVBKTkwY6bSypkLOVmk9e85SmxkWSKxKw==',key_name='tempest-keypair-182844646',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:09:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a01f4bc78d87474a8a3027d928dc77e5',ramdisk_id='',reservation_id='r-i6qq0qww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-403565623',owner_user_name='tempest-TaggedBootDevicesTest-403565623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:09:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ff0ceab2aad4ddcbc5f76ee6a0858bf',uuid=54fd570d-421c-4a39-b4ae-772500b24cec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "472badf6-8de1-4c67-8bfa-7105f672eff0", "address": "fa:16:3e:c9:52:16", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472badf6-8d", "ovs_interfaceid": "472badf6-8de1-4c67-8bfa-7105f672eff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converting VIF {"id": "472badf6-8de1-4c67-8bfa-7105f672eff0", "address": "fa:16:3e:c9:52:16", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472badf6-8d", "ovs_interfaceid": "472badf6-8de1-4c67-8bfa-7105f672eff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:52:16,bridge_name='br-int',has_traffic_filtering=True,id=472badf6-8de1-4c67-8bfa-7105f672eff0,network=Network(df3ccd13-2ec7-4c92-94e4-82d953121d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472badf6-8d') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:52:16,bridge_name='br-int',has_traffic_filtering=True,id=472badf6-8de1-4c67-8bfa-7105f672eff0,network=Network(df3ccd13-2ec7-4c92-94e4-82d953121d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472badf6-8d') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-unplugged-dfc09729-80ce-463f-8ad4-4f16f8b304f2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-unplugged-dfc09729-80ce-463f-8ad4-4f16f8b304f2 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-unplugged-dfc09729-80ce-463f-8ad4-4f16f8b304f2 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-dfc09729-80ce-463f-8ad4-4f16f8b304f2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-dfc09729-80ce-463f-8ad4-4f16f8b304f2 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:15 user nova-compute[73917]: WARNING nova.compute.manager [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-dfc09729-80ce-463f-8ad4-4f16f8b304f2 for instance with vm_state active and task_state deleting.
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-unplugged-22c864bd-81de-436b-9745-de2cf3cfffd5 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-unplugged-22c864bd-81de-436b-9745-de2cf3cfffd5 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-unplugged-22c864bd-81de-436b-9745-de2cf3cfffd5 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-22c864bd-81de-436b-9745-de2cf3cfffd5 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-22c864bd-81de-436b-9745-de2cf3cfffd5 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:15 user nova-compute[73917]: WARNING nova.compute.manager [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-22c864bd-81de-436b-9745-de2cf3cfffd5 for instance with vm_state active and task_state deleting.
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-unplugged-472badf6-8de1-4c67-8bfa-7105f672eff0 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-unplugged-472badf6-8de1-4c67-8bfa-7105f672eff0 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-unplugged-472badf6-8de1-4c67-8bfa-7105f672eff0 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-472badf6-8de1-4c67-8bfa-7105f672eff0 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-472badf6-8de1-4c67-8bfa-7105f672eff0 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:15 user nova-compute[73917]: WARNING nova.compute.manager [req-03ea711b-2f0e-4cb8-af77-583299627cc7 req-dac333e3-fa96-403a-96e3-95628d4212f8 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-472badf6-8de1-4c67-8bfa-7105f672eff0 for instance with vm_state active and task_state deleting.
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-31423d18-e5a9-4ecf-be7c-0864801284d9 req-b0fdfd25-7470-4989-a253-25ccb6e3b763 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-9268e463-2367-4d84-be0e-f432a917b945 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-31423d18-e5a9-4ecf-be7c-0864801284d9 req-b0fdfd25-7470-4989-a253-25ccb6e3b763 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-31423d18-e5a9-4ecf-be7c-0864801284d9 req-b0fdfd25-7470-4989-a253-25ccb6e3b763 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-31423d18-e5a9-4ecf-be7c-0864801284d9 req-b0fdfd25-7470-4989-a253-25ccb6e3b763 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-31423d18-e5a9-4ecf-be7c-0864801284d9 req-b0fdfd25-7470-4989-a253-25ccb6e3b763 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-9268e463-2367-4d84-be0e-f432a917b945 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:15 user nova-compute[73917]: WARNING nova.compute.manager [req-31423d18-e5a9-4ecf-be7c-0864801284d9 req-b0fdfd25-7470-4989-a253-25ccb6e3b763 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-9268e463-2367-4d84-be0e-f432a917b945 for instance with vm_state active and task_state deleting.
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-31423d18-e5a9-4ecf-be7c-0864801284d9 req-b0fdfd25-7470-4989-a253-25ccb6e3b763 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-unplugged-2d4bbc97-cf69-4155-8f62-0de77084cbdd {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-31423d18-e5a9-4ecf-be7c-0864801284d9 req-b0fdfd25-7470-4989-a253-25ccb6e3b763 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-31423d18-e5a9-4ecf-be7c-0864801284d9 req-b0fdfd25-7470-4989-a253-25ccb6e3b763 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-31423d18-e5a9-4ecf-be7c-0864801284d9 req-b0fdfd25-7470-4989-a253-25ccb6e3b763 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-31423d18-e5a9-4ecf-be7c-0864801284d9 req-b0fdfd25-7470-4989-a253-25ccb6e3b763 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-unplugged-2d4bbc97-cf69-4155-8f62-0de77084cbdd {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-31423d18-e5a9-4ecf-be7c-0864801284d9 req-b0fdfd25-7470-4989-a253-25ccb6e3b763 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-unplugged-2d4bbc97-cf69-4155-8f62-0de77084cbdd for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-31423d18-e5a9-4ecf-be7c-0864801284d9 req-b0fdfd25-7470-4989-a253-25ccb6e3b763 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-2d4bbc97-cf69-4155-8f62-0de77084cbdd {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-31423d18-e5a9-4ecf-be7c-0864801284d9 req-b0fdfd25-7470-4989-a253-25ccb6e3b763 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-31423d18-e5a9-4ecf-be7c-0864801284d9 req-b0fdfd25-7470-4989-a253-25ccb6e3b763 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-31423d18-e5a9-4ecf-be7c-0864801284d9 req-b0fdfd25-7470-4989-a253-25ccb6e3b763 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-31423d18-e5a9-4ecf-be7c-0864801284d9 req-b0fdfd25-7470-4989-a253-25ccb6e3b763 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-2d4bbc97-cf69-4155-8f62-0de77084cbdd {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:15 user nova-compute[73917]: WARNING nova.compute.manager [req-31423d18-e5a9-4ecf-be7c-0864801284d9 req-b0fdfd25-7470-4989-a253-25ccb6e3b763 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-2d4bbc97-cf69-4155-8f62-0de77084cbdd for instance with vm_state active and task_state deleting.
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c22df7-571d-4f2e-8e45-51611e2de5c3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap472badf6-8d, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:15 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:11:15 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:15 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.486s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:11:15 user nova-compute[73917]: INFO os_vif [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:52:16,bridge_name='br-int',has_traffic_filtering=True,id=472badf6-8de1-4c67-8bfa-7105f672eff0,network=Network(df3ccd13-2ec7-4c92-94e4-82d953121d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472badf6-8d')
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QEyjfTiJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:11:15 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3001004d-5009-4e67-bf37-4dd59d8a56ac]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hXixcyfT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-unplugged-eec1aa81-34b7-44ea-aa98-57b54a967dcc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-unplugged-eec1aa81-34b7-44ea-aa98-57b54a967dcc {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-unplugged-eec1aa81-34b7-44ea-aa98-57b54a967dcc for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-eec1aa81-34b7-44ea-aa98-57b54a967dcc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-eec1aa81-34b7-44ea-aa98-57b54a967dcc {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:15 user nova-compute[73917]: WARNING nova.compute.manager [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-eec1aa81-34b7-44ea-aa98-57b54a967dcc for instance with vm_state active and task_state deleting.
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-unplugged-19a44d0d-f673-49e9-8c62-014aff19769c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-unplugged-19a44d0d-f673-49e9-8c62-014aff19769c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-unplugged-19a44d0d-f673-49e9-8c62-014aff19769c for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-plugged-19a44d0d-f673-49e9-8c62-014aff19769c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] Acquiring lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] Lock "54fd570d-421c-4a39-b4ae-772500b24cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] No waiting events found dispatching network-vif-plugged-19a44d0d-f673-49e9-8c62-014aff19769c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:15 user nova-compute[73917]: WARNING nova.compute.manager [req-259fea52-7d32-4cb0-bb16-534982e3039a req-b89cb6bf-695f-4d69-b1a3-2099f7baf757 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received unexpected event network-vif-plugged-19a44d0d-f673-49e9-8c62-014aff19769c for instance with vm_state active and task_state deleting.
Aug 26 19:11:15 user nova-compute[73917]: INFO nova.compute.manager [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Rescuing
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquired lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:11:15 user nova-compute[73917]: DEBUG nova.network.neutron [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG nova.network.neutron [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Updating instance_info_cache with network_info: [{"id": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "address": "fa:16:3e:c9:58:2d", "network": {"id": "4fb39591-1339-423b-a17d-cec979856e60", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09772507cd24e329e84aa3b9a3b9b7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245e99f5-fb", "ovs_interfaceid": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Releasing lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.530s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] <== connect_volume: return (1532ms) {'type': 'block', 'scsi_wwn': '26339336262316339', 'path': '/dev/sde'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339336262316339', 'path': '/dev/sde'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.028s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3aae77f-8478-437b-899d-ed3d0097827d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-699122116',display_name='tempest-AttachVolumeTestJSON-server-699122116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-699122116',id=5,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHqeZabK3+K4aaugpyX8ly8/1rj5SN4GU9OQYd/thmmFlRmAKDNGqPnSs6iFVbJTbvqYDOtwahR3/8AlpHMnz55bssLgo5XLS59T+WFQ51mc2/usyY8DYb7AasV3fI19A==',key_name='tempest-keypair-67322035',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='abdcca8609e849618526a8b78385f77b',ramdisk_id='',reservation_id='r-mcpim35c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1084822713',owner_user_name='tempest-AttachVolumeTestJSON-1084822713-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47b6f8fcb8f49dfa2383dfbf37d6c30',uuid=fdfb377e-119e-41ce-b9e0-6e21053306cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converting VIF {"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG nova.objects.instance [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'pci_devices' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG nova.objects.base [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Object Instance<fdfb377e-119e-41ce-b9e0-6e21053306cc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:11:16 user nova-compute[73917]:   <uuid>fdfb377e-119e-41ce-b9e0-6e21053306cc</uuid>
Aug 26 19:11:16 user nova-compute[73917]:   <name>instance-00000005</name>
Aug 26 19:11:16 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:11:16 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:11:16 user nova-compute[73917]:   <metadata>
Aug 26 19:11:16 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:11:16 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:11:16 user nova-compute[73917]:       <nova:name>tempest-AttachVolumeTestJSON-server-699122116</nova:name>
Aug 26 19:11:16 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:11:14</nova:creationTime>
Aug 26 19:11:16 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:11:16 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:11:16 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:11:16 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:11:16 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:11:16 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:11:16 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:11:16 user nova-compute[73917]:       <nova:owner>
Aug 26 19:11:16 user nova-compute[73917]:         <nova:user uuid="a47b6f8fcb8f49dfa2383dfbf37d6c30">tempest-AttachVolumeTestJSON-1084822713-project-member</nova:user>
Aug 26 19:11:16 user nova-compute[73917]:         <nova:project uuid="abdcca8609e849618526a8b78385f77b">tempest-AttachVolumeTestJSON-1084822713</nova:project>
Aug 26 19:11:16 user nova-compute[73917]:       </nova:owner>
Aug 26 19:11:16 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:11:16 user nova-compute[73917]:       <nova:ports>
Aug 26 19:11:16 user nova-compute[73917]:         <nova:port uuid="37aa792a-c367-4dfd-b814-cb9c32ef373c">
Aug 26 19:11:16 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 19:11:16 user nova-compute[73917]:         </nova:port>
Aug 26 19:11:16 user nova-compute[73917]:       </nova:ports>
Aug 26 19:11:16 user nova-compute[73917]:     </nova:instance>
Aug 26 19:11:16 user nova-compute[73917]:   </metadata>
Aug 26 19:11:16 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:11:16 user nova-compute[73917]:     <system>
Aug 26 19:11:16 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:11:16 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:11:16 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:11:16 user nova-compute[73917]:       <entry name="serial">fdfb377e-119e-41ce-b9e0-6e21053306cc</entry>
Aug 26 19:11:16 user nova-compute[73917]:       <entry name="uuid">fdfb377e-119e-41ce-b9e0-6e21053306cc</entry>
Aug 26 19:11:16 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:11:16 user nova-compute[73917]:     </system>
Aug 26 19:11:16 user nova-compute[73917]:   </sysinfo>
Aug 26 19:11:16 user nova-compute[73917]:   <os>
Aug 26 19:11:16 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:11:16 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:11:16 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:11:16 user nova-compute[73917]:   </os>
Aug 26 19:11:16 user nova-compute[73917]:   <features>
Aug 26 19:11:16 user nova-compute[73917]:     <acpi/>
Aug 26 19:11:16 user nova-compute[73917]:     <apic/>
Aug 26 19:11:16 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:11:16 user nova-compute[73917]:   </features>
Aug 26 19:11:16 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:11:16 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:11:16 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:11:16 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:11:16 user nova-compute[73917]:   </clock>
Aug 26 19:11:16 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:11:16 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:11:16 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:11:16 user nova-compute[73917]:   </cpu>
Aug 26 19:11:16 user nova-compute[73917]:   <devices>
Aug 26 19:11:16 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:11:16 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:11:16 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk"/>
Aug 26 19:11:16 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:11:16 user nova-compute[73917]:     </disk>
Aug 26 19:11:16 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:11:16 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:11:16 user nova-compute[73917]:       <source dev="/dev/sde"/>
Aug 26 19:11:16 user nova-compute[73917]:       <target dev="vdb" bus="virtio"/>
Aug 26 19:11:16 user nova-compute[73917]:       <serial>90b84430-2ecf-40e8-96de-912b95b5bf86</serial>
Aug 26 19:11:16 user nova-compute[73917]:     </disk>
Aug 26 19:11:16 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:11:16 user nova-compute[73917]:       <mac address="fa:16:3e:ce:ab:20"/>
Aug 26 19:11:16 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:11:16 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:11:16 user nova-compute[73917]:       <target dev="tap37aa792a-c3"/>
Aug 26 19:11:16 user nova-compute[73917]:     </interface>
Aug 26 19:11:16 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:11:16 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/console.log" append="off"/>
Aug 26 19:11:16 user nova-compute[73917]:     </serial>
Aug 26 19:11:16 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:11:16 user nova-compute[73917]:     <video>
Aug 26 19:11:16 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:11:16 user nova-compute[73917]:     </video>
Aug 26 19:11:16 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:11:16 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:11:16 user nova-compute[73917]:     </rng>
Aug 26 19:11:16 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:11:16 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:11:16 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:11:16 user nova-compute[73917]:     </memballoon>
Aug 26 19:11:16 user nova-compute[73917]:   </devices>
Aug 26 19:11:16 user nova-compute[73917]: </domain>
Aug 26 19:11:16 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66bd4aa-7fbc-4a03-b5fb-7afb2e5e04f1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:16 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:16 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:16 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:16 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:16 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:11:16 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:11:16 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:11:16 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:11:16 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:16 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:16 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:16 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:16 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:16 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:16 user nova-compute[73917]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a (non-flash)
Aug 26 19:11:16 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:11:16 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:11:16 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:11:16 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:16 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b784fcd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a'): ({'sdd'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Removing single pathed devices sdd {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ddb9e6-b72f-42f5-8d8c-5d8f9e0b5057]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[605cfeed-360a-400f-8ab0-9cd165198afa]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Flushing IO for device /dev/sdd {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a5edbe-f631-4073-94e3-7518f5cb0ee9]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e693b3-a4ff-462a-9aff-af28e516f028]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] SCSI volumes sdd have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.336s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c167127-8b3e-4eb3-b9e2-04d283b2799a]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.128s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5185ad-6886-4230-b97c-a1d537429f54]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a, portal: 172.16.0.220,3260]
Aug 26 19:11:17 user nova-compute[73917]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a, portal: 172.16.0.220,3260] successful.
Aug 26 19:11:17 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.objects.instance [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'trusted_certs' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f794151-249c-4191-990d-cee0e30d3a5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0185e726-33d7-48d7-a09a-4d655f525453]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.623s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] <== disconnect_volume: return (1650ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcHTzUrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:11:17 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.objects.base [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Object Instance<fdfb377e-119e-41ce-b9e0-6e21053306cc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d4fa17-c7a2-4cb5-8774-98d0fb50458e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dccfab9-781f-4cbd-a939-67f727f621ac]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:17 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:17 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b7870ad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c'): ({'sdf'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Removing single pathed devices sdf {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8f57ad-c171-48d6-ba27-75574bea307d]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[88905f45-207b-4ee0-b3ea-85e22e7b850d]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Flushing IO for device /dev/sdf {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5597afb-b7d1-401f-aed2-bf1396ea4789]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.224s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9abf0c1-f7e0-4225-9964-31818e14776f]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] SCSI volumes sdf have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd120e5-1c88-464b-bffd-85b57c81d730]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:17 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Instance destroyed successfully.
Aug 26 19:11:17 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Attempting a stable device rescue
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8eac45-1e12-41ed-9c73-8eda0e842dfa]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c, portal: 172.16.0.220,3260]
Aug 26 19:11:17 user nova-compute[73917]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c, portal: 172.16.0.220,3260] successful.
Aug 26 19:11:17 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Cannot resize image /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.objects.instance [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'migration_context' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1ea72-e543-43ea-bdeb-47608eefd15c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73917) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abbf511-a220-44c9-b823-1d72bc433bef]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.482s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] <== disconnect_volume: return (484ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Instance directory exists: not creating {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 19:11:17 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Creating image(s)
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "/opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "/opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "/opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.objects.instance [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btAlVdFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:11:17 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.objects.base [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Object Instance<fdfb377e-119e-41ce-b9e0-6e21053306cc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-699122116',display_name='tempest-AttachVolumeTestJSON-server-699122116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-699122116',id=5,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHqeZabK3+K4aaugpyX8ly8/1rj5SN4GU9OQYd/thmmFlRmAKDNGqPnSs6iFVbJTbvqYDOtwahR3/8AlpHMnz55bssLgo5XLS59T+WFQ51mc2/usyY8DYb7AasV3fI19A==',key_name='tempest-keypair-67322035',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='abdcca8609e849618526a8b78385f77b',ramdisk_id='',reservation_id='r-mcpim35c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1084822713',owner_user_name='tempest-AttachVolumeTestJSON-1084822713-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47b6f8fcb8f49dfa2383dfbf37d6c30',uuid=fdfb377e-119e-41ce-b9e0-6e21053306cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converting VIF {"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_vif [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "5dc0f4e2959123161326e2c98237673494d4d68b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "5dc0f4e2959123161326e2c98237673494d4d68b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37aa792a-c3, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37aa792a-c3, col_values=(('external_ids', {'iface-id': '37aa792a-c367-4dfd-b814-cb9c32ef373c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:ab:20', 'vm-uuid': 'fdfb377e-119e-41ce-b9e0-6e21053306cc'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f26e5b-bb8c-4d88-8451-6b0c6d1e814c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:17 user nova-compute[73917]: INFO os_vif [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3')
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c1b259-0624-4bef-99bd-860321745a49]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:17 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 (non-flash)
Aug 26 19:11:17 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:17 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b78749990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334'): ({'sdg'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Removing single pathed devices sdg {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.compute.manager [req-107126d0-f9e2-40cc-bcc3-c6bf9ff3dd9a req-0a1d0133-0ea3-49d6-9304-c5629178c9ed service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-vif-unplugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-107126d0-f9e2-40cc-bcc3-c6bf9ff3dd9a req-0a1d0133-0ea3-49d6-9304-c5629178c9ed service nova] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-107126d0-f9e2-40cc-bcc3-c6bf9ff3dd9a req-0a1d0133-0ea3-49d6-9304-c5629178c9ed service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-107126d0-f9e2-40cc-bcc3-c6bf9ff3dd9a req-0a1d0133-0ea3-49d6-9304-c5629178c9ed service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.compute.manager [req-107126d0-f9e2-40cc-bcc3-c6bf9ff3dd9a req-0a1d0133-0ea3-49d6-9304-c5629178c9ed service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] No waiting events found dispatching network-vif-unplugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:17 user nova-compute[73917]: WARNING nova.compute.manager [req-107126d0-f9e2-40cc-bcc3-c6bf9ff3dd9a req-0a1d0133-0ea3-49d6-9304-c5629178c9ed service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received unexpected event network-vif-unplugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc for instance with vm_state active and task_state rescuing.
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.compute.manager [req-107126d0-f9e2-40cc-bcc3-c6bf9ff3dd9a req-0a1d0133-0ea3-49d6-9304-c5629178c9ed service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-107126d0-f9e2-40cc-bcc3-c6bf9ff3dd9a req-0a1d0133-0ea3-49d6-9304-c5629178c9ed service nova] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-107126d0-f9e2-40cc-bcc3-c6bf9ff3dd9a req-0a1d0133-0ea3-49d6-9304-c5629178c9ed service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-107126d0-f9e2-40cc-bcc3-c6bf9ff3dd9a req-0a1d0133-0ea3-49d6-9304-c5629178c9ed service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:17 user nova-compute[73917]: DEBUG nova.compute.manager [req-107126d0-f9e2-40cc-bcc3-c6bf9ff3dd9a req-0a1d0133-0ea3-49d6-9304-c5629178c9ed service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] No waiting events found dispatching network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:17 user nova-compute[73917]: WARNING nova.compute.manager [req-107126d0-f9e2-40cc-bcc3-c6bf9ff3dd9a req-0a1d0133-0ea3-49d6-9304-c5629178c9ed service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received unexpected event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc for instance with vm_state active and task_state rescuing.
Aug 26 19:11:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dc0f4e2959123161326e2c98237673494d4d68b.part --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3afb2ab-27b5-4fbb-b115-744ecbc4778e]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.039s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[057786a4-ac17-45be-a796-5a860712f515]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Flushing IO for device /dev/sdg {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd60b52a-aa0e-4d66-8335-cad8410a4e21]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.056s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe122a54-5569-4027-b0e6-7835d8d8601a]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] SCSI volumes sdg have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dc0f4e2959123161326e2c98237673494d4d68b.part --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG nova.virt.images [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] fee1f5e4-d726-468d-bce1-8d0571d13850 was qcow2, converting to raw {{(pid=73917) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG nova.privsep.utils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73917) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5dc0f4e2959123161326e2c98237673494d4d68b.part /opt/stack/data/nova/instances/_base/5dc0f4e2959123161326e2c98237673494d4d68b.converted {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.207s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa60420-2406-47e3-84c0-7dcd81badb51]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 --logout" returned: 0 in 0.113s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfcb283-b049-4310-bb66-2c88d41f5553]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334, portal: 172.16.0.220,3260]
Aug 26 19:11:19 user nova-compute[73917]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334, portal: 172.16.0.220,3260] successful.
Aug 26 19:11:19 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b486c20-77b8-42e7-aa76-224979a67334 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d8042d-94c8-412f-96ed-4dc08f4e9352]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.579s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] <== disconnect_volume: return (1581ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:11:19 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Deleting instance files /opt/stack/data/nova/instances/54fd570d-421c-4a39-b4ae-772500b24cec_del
Aug 26 19:11:19 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Deletion of /opt/stack/data/nova/instances/54fd570d-421c-4a39-b4ae-772500b24cec_del complete
Aug 26 19:11:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:19 user nova-compute[73917]: INFO nova.compute.manager [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Took 6.49 seconds to destroy the instance on the hypervisor.
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5dc0f4e2959123161326e2c98237673494d4d68b.part /opt/stack/data/nova/instances/_base/5dc0f4e2959123161326e2c98237673494d4d68b.converted" returned: 0 in 0.426s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dc0f4e2959123161326e2c98237673494d4d68b.converted --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.compute.manager [req-b2f9ca6c-dd47-4302-ae4a-a2ed506bd09f req-a635d039-467e-4ae5-accf-277fbaf6963f service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b2f9ca6c-dd47-4302-ae4a-a2ed506bd09f req-a635d039-467e-4ae5-accf-277fbaf6963f service nova] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b2f9ca6c-dd47-4302-ae4a-a2ed506bd09f req-a635d039-467e-4ae5-accf-277fbaf6963f service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b2f9ca6c-dd47-4302-ae4a-a2ed506bd09f req-a635d039-467e-4ae5-accf-277fbaf6963f service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.compute.manager [req-b2f9ca6c-dd47-4302-ae4a-a2ed506bd09f req-a635d039-467e-4ae5-accf-277fbaf6963f service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] No waiting events found dispatching network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:19 user nova-compute[73917]: WARNING nova.compute.manager [req-b2f9ca6c-dd47-4302-ae4a-a2ed506bd09f req-a635d039-467e-4ae5-accf-277fbaf6963f service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received unexpected event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c for instance with vm_state stopped and task_state powering-on.
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dc0f4e2959123161326e2c98237673494d4d68b.converted --force-share --output=json" returned: 0 in 0.215s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "5dc0f4e2959123161326e2c98237673494d4d68b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.966s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "5dc0f4e2959123161326e2c98237673494d4d68b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "5dc0f4e2959123161326e2c98237673494d4d68b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dc0f4e2959123161326e2c98237673494d4d68b --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dc0f4e2959123161326e2c98237673494d4d68b --force-share --output=json" returned: 0 in 0.197s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dc0f4e2959123161326e2c98237673494d4d68b,backing_fmt=raw /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk.rescue {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dc0f4e2959123161326e2c98237673494d4d68b,backing_fmt=raw /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk.rescue" returned: 0 in 0.058s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "5dc0f4e2959123161326e2c98237673494d4d68b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.objects.instance [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lazy-loading 'migration_context' on Instance uuid 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.objects.base [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Object Instance<9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Start _get_guest_xml network_info=[{"id": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "address": "fa:16:3e:c9:58:2d", "network": {"id": "4fb39591-1339-423b-a17d-cec979856e60", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "vif_mac": "fa:16:3e:c9:58:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09772507cd24e329e84aa3b9a3b9b7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245e99f5-fb", "ovs_interfaceid": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fee1f5e4-d726-468d-bce1-8d0571d13850', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHCnuxqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6', 'attached_at': '', 'detached_at': '', 'volume_id': '1db76c5d-a93f-421a-a23d-797da93b388d', 'serial': '1db76c5d-a93f-421a-a23d-797da93b388d'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '8f543643-c637-4eb3-b55d-d55b2409acc7', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.objects.instance [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lazy-loading 'resources' on Instance uuid 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.objects.base [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Object Instance<9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.objects.instance [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lazy-loading 'numa_topology' on Instance uuid 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.objects.base [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Object Instance<9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:11:19 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:11:19 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:11:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.objects.instance [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.objects.base [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Object Instance<9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHCnuxqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:11:19 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:11:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:11:19 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:11:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:11:19 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3896f5d5-2e5c-4f78-adb0-cd4b4a2cd00b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = sHCnuxqK\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 19:11:19 user nova-compute[73917]: node.name = iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d
Aug 26 19:11:19 user nova-compute[73917]: node.tpgt = -1
Aug 26 19:11:19 user nova-compute[73917]: node.startup = automatic
Aug 26 19:11:19 user nova-compute[73917]: node.leading_login = No
Aug 26 19:11:19 user nova-compute[73917]: iface.iscsi_ifacename = default
Aug 26 19:11:19 user nova-compute[73917]: iface.net_ifacename = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.ipaddress = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.prefix_len = 0
Aug 26 19:11:19 user nova-compute[73917]: iface.hwaddress = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.transport_name = tcp
Aug 26 19:11:19 user nova-compute[73917]: iface.initiatorname = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.state = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.vlan_id = 0
Aug 26 19:11:19 user nova-compute[73917]: iface.vlan_priority = 0
Aug 26 19:11:19 user nova-compute[73917]: iface.vlan_state = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.iface_num = 0
Aug 26 19:11:19 user nova-compute[73917]: iface.mtu = 0
Aug 26 19:11:19 user nova-compute[73917]: iface.port = 0
Aug 26 19:11:19 user nova-compute[73917]: iface.bootproto = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.subnet_mask = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.gateway = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.dhcp_alt_client_id = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.dhcp_dns = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.dhcp_learn_iqn = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.dhcp_vendor_id_state = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.dhcp_vendor_id = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.dhcp_slp_da = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.fragmentation = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.gratuitous_arp = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.incoming_forwarding = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.tos_state = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.tos = 0
Aug 26 19:11:19 user nova-compute[73917]: iface.ttl = 0
Aug 26 19:11:19 user nova-compute[73917]: iface.delayed_ack = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.tcp_nagle = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.tcp_wsf_state = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.tcp_wsf = 0
Aug 26 19:11:19 user nova-compute[73917]: iface.tcp_timer_scale = 0
Aug 26 19:11:19 user nova-compute[73917]: iface.tcp_timestamp = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.redirect = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.def_task_mgmt_timeout = 0
Aug 26 19:11:19 user nova-compute[73917]: iface.header_digest = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.data_digest = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.immediate_data = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.initial_r2t = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.data_seq_inorder = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.data_pdu_inorder = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.erl = 0
Aug 26 19:11:19 user nova-compute[73917]: iface.max_receive_data_len = 0
Aug 26 19:11:19 user nova-compute[73917]: iface.first_burst_len = 0
Aug 26 19:11:19 user nova-compute[73917]: iface.max_outstanding_r2t = 0
Aug 26 19:11:19 user nova-compute[73917]: iface.max_burst_len = 0
Aug 26 19:11:19 user nova-compute[73917]: iface.chap_auth = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.bidi_chap = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.strict_login_compliance = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.discovery_auth = <empty>
Aug 26 19:11:19 user nova-compute[73917]: iface.discovery_logout = <empty>
Aug 26 19:11:19 user nova-compute[73917]: node.discovery_address = <empty>
Aug 26 19:11:19 user nova-compute[73917]: node.discovery_port = 0
Aug 26 19:11:19 user nova-compute[73917]: node.discovery_type = static
Aug 26 19:11:19 user nova-compute[73917]: node.session.initial_cmdsn = 0
Aug 26 19:11:19 user nova-compute[73917]: node.session.initial_login_retry_max = 8
Aug 26 19:11:19 user nova-compute[73917]: node.session.xmit_thread_priority = -20
Aug 26 19:11:19 user nova-compute[73917]: node.session.cmds_max = 128
Aug 26 19:11:19 user nova-compute[73917]: node.session.queue_depth = 32
Aug 26 19:11:19 user nova-compute[73917]: node.session.nr_sessions = 1
Aug 26 19:11:19 user nova-compute[73917]: node.session.auth.authmethod = CHAP
Aug 26 19:11:19 user nova-compute[73917]: node.session.auth.username = sHCnuxqK
Aug 26 19:11:19 user nova-compute[73917]: node.session.auth.password = ***
Aug 26 19:11:19 user nova-compute[73917]: node.session.auth.username_in = <empty>
Aug 26 19:11:19 user nova-compute[73917]: node.session.auth.password_in = <empty>
Aug 26 19:11:19 user nova-compute[73917]: node.session.auth.chap_algs = MD5
Aug 26 19:11:19 user nova-compute[73917]: node.session.timeo.replacement_timeout = 120
Aug 26 19:11:19 user nova-compute[73917]: node.session.err_timeo.abort_timeout = 15
Aug 26 19:11:19 user nova-compute[73917]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 19:11:19 user nova-compute[73917]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 19:11:19 user nova-compute[73917]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 19:11:19 user nova-compute[73917]: node.session.iscsi.FastAbort = Yes
Aug 26 19:11:19 user nova-compute[73917]: node.session.iscsi.InitialR2T = No
Aug 26 19:11:19 user nova-compute[73917]: node.session.iscsi.ImmediateData = Yes
Aug 26 19:11:19 user nova-compute[73917]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 19:11:19 user nova-compute[73917]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 19:11:19 user nova-compute[73917]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 19:11:19 user nova-compute[73917]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 19:11:19 user nova-compute[73917]: node.session.iscsi.MaxConnections = 1
Aug 26 19:11:19 user nova-compute[73917]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 19:11:19 user nova-compute[73917]: node.session.iscsi.ERL = 0
Aug 26 19:11:19 user nova-compute[73917]: node.session.scan = manual
Aug 26 19:11:19 user nova-compute[73917]: node.session.reopen_max = 0
Aug 26 19:11:19 user nova-compute[73917]: node.conn[0].address = 172.16.0.220
Aug 26 19:11:19 user nova-compute[73917]: node.conn[0].port = 3260
Aug 26 19:11:19 user nova-compute[73917]: node.conn[0].startup = manual
Aug 26 19:11:19 user nova-compute[73917]: node.conn[0].tcp.window_size = 524288
Aug 26 19:11:19 user nova-compute[73917]: node.conn[0].tcp.type_of_service = 0
Aug 26 19:11:19 user nova-compute[73917]: node.conn[0].timeo.logout_timeout = 15
Aug 26 19:11:19 user nova-compute[73917]: node.conn[0].timeo.login_timeout = 15
Aug 26 19:11:19 user nova-compute[73917]: node.conn[0].timeo.auth_timeout = 45
Aug 26 19:11:19 user nova-compute[73917]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 19:11:19 user nova-compute[73917]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 19:11:19 user nova-compute[73917]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 19:11:19 user nova-compute[73917]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 19:11:19 user nova-compute[73917]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 19:11:19 user nova-compute[73917]: node.conn[0].iscsi.DataDigest = None
Aug 26 19:11:19 user nova-compute[73917]: node.conn[0].iscsi.IFMarker = No
Aug 26 19:11:19 user nova-compute[73917]: node.conn[0].iscsi.OFMarker = No
Aug 26 19:11:19 user nova-compute[73917]: # END RECORD
Aug 26 19:11:19 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea760e89-d9b1-4d32-a492-975428dec993]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c965a4ae-3a37-493a-ab80-e626f2ef2adb]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sHCnuxqK {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sHCnuxqK" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[260a3de3-da7c-4288-9da7-7209e5ee9914]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sHCnuxqK'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bf7584-f2dc-4177-8c80-5ebcfd0b07bc]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc801455-a4a1-4cd2-928d-662441a11110]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:20 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:20 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:20 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:20 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:20 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:11:20 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:20 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:20 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:20 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:20 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:20 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:11:20 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.164s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] HCTL ('42', '0', '0', 0) found on session 18 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Scanning host 42 c: 0, t: 0, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[714c383a-5d5e-4ce2-9f44-b2916376f7ef]: (4, ('0 0 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Searching for a device in session 18 and hctl ('42', '0', '0', 0) yield: sdk {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHCnuxqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.189s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] <== connect_volume: return (191ms) {'type': 'block', 'scsi_wwn': '26333616437383331', 'path': '/dev/sdk'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333616437383331', 'path': '/dev/sdk'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-721860260',display_name='tempest-ServerStableDeviceRescueTest-server-721860260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-721860260',id=7,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJtE+qXdGZrkiAdBY0BxQ6ZEJ8XDZAjGtegAJ/SNt0X0lzJfk9WOgXrblFhQIglq06fSfLJPdWq+bnzSfz2VMsXVXqQKheHwQqItW7lqtTaiVh5HoXhBJLL+FVuuWpDjQ==',key_name='tempest-keypair-1387896357',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f09772507cd24e329e84aa3b9a3b9b7e',ramdisk_id='',reservation_id='r-0swkyi4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1025636115',owner_user_name='tempest-ServerStableDeviceRescueTest-1025636115-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:09:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34c97061bd0a4b3897fb03769884043c',uuid=9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "address": "fa:16:3e:c9:58:2d", "network": {"id": "4fb39591-1339-423b-a17d-cec979856e60", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "vif_mac": "fa:16:3e:c9:58:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09772507cd24e329e84aa3b9a3b9b7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245e99f5-fb", "ovs_interfaceid": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Converting VIF {"id": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "address": "fa:16:3e:c9:58:2d", "network": {"id": "4fb39591-1339-423b-a17d-cec979856e60", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "vif_mac": "fa:16:3e:c9:58:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09772507cd24e329e84aa3b9a3b9b7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245e99f5-fb", "ovs_interfaceid": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:58:2d,bridge_name='br-int',has_traffic_filtering=True,id=245e99f5-fb5c-4442-b5f7-c2b05207f2fc,network=Network(4fb39591-1339-423b-a17d-cec979856e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap245e99f5-fb') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG nova.objects.instance [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lazy-loading 'pci_devices' on Instance uuid 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG nova.objects.base [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Object Instance<9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:11:20 user nova-compute[73917]:   <uuid>9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6</uuid>
Aug 26 19:11:20 user nova-compute[73917]:   <name>instance-00000007</name>
Aug 26 19:11:20 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:11:20 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:11:20 user nova-compute[73917]:   <metadata>
Aug 26 19:11:20 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:11:20 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:11:20 user nova-compute[73917]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-721860260</nova:name>
Aug 26 19:11:20 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:11:19</nova:creationTime>
Aug 26 19:11:20 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:11:20 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:11:20 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:11:20 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:11:20 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:11:20 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:11:20 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:11:20 user nova-compute[73917]:       <nova:owner>
Aug 26 19:11:20 user nova-compute[73917]:         <nova:user uuid="34c97061bd0a4b3897fb03769884043c">tempest-ServerStableDeviceRescueTest-1025636115-project-member</nova:user>
Aug 26 19:11:20 user nova-compute[73917]:         <nova:project uuid="f09772507cd24e329e84aa3b9a3b9b7e">tempest-ServerStableDeviceRescueTest-1025636115</nova:project>
Aug 26 19:11:20 user nova-compute[73917]:       </nova:owner>
Aug 26 19:11:20 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:11:20 user nova-compute[73917]:       <nova:ports>
Aug 26 19:11:20 user nova-compute[73917]:         <nova:port uuid="245e99f5-fb5c-4442-b5f7-c2b05207f2fc">
Aug 26 19:11:20 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 19:11:20 user nova-compute[73917]:         </nova:port>
Aug 26 19:11:20 user nova-compute[73917]:       </nova:ports>
Aug 26 19:11:20 user nova-compute[73917]:     </nova:instance>
Aug 26 19:11:20 user nova-compute[73917]:   </metadata>
Aug 26 19:11:20 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:11:20 user nova-compute[73917]:     <system>
Aug 26 19:11:20 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:11:20 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:11:20 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:11:20 user nova-compute[73917]:       <entry name="serial">9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6</entry>
Aug 26 19:11:20 user nova-compute[73917]:       <entry name="uuid">9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6</entry>
Aug 26 19:11:20 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:11:20 user nova-compute[73917]:     </system>
Aug 26 19:11:20 user nova-compute[73917]:   </sysinfo>
Aug 26 19:11:20 user nova-compute[73917]:   <os>
Aug 26 19:11:20 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:11:20 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:11:20 user nova-compute[73917]:   </os>
Aug 26 19:11:20 user nova-compute[73917]:   <features>
Aug 26 19:11:20 user nova-compute[73917]:     <acpi/>
Aug 26 19:11:20 user nova-compute[73917]:     <apic/>
Aug 26 19:11:20 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:11:20 user nova-compute[73917]:   </features>
Aug 26 19:11:20 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:11:20 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:11:20 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:11:20 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:11:20 user nova-compute[73917]:   </clock>
Aug 26 19:11:20 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:11:20 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:11:20 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:11:20 user nova-compute[73917]:   </cpu>
Aug 26 19:11:20 user nova-compute[73917]:   <devices>
Aug 26 19:11:20 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:11:20 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:11:20 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk"/>
Aug 26 19:11:20 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:11:20 user nova-compute[73917]:     </disk>
Aug 26 19:11:20 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:11:20 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:11:20 user nova-compute[73917]:       <source dev="/dev/sdk"/>
Aug 26 19:11:20 user nova-compute[73917]:       <target dev="vdb" bus="virtio"/>
Aug 26 19:11:20 user nova-compute[73917]:       <serial>1db76c5d-a93f-421a-a23d-797da93b388d</serial>
Aug 26 19:11:20 user nova-compute[73917]:     </disk>
Aug 26 19:11:20 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:11:20 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:11:20 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk.rescue"/>
Aug 26 19:11:20 user nova-compute[73917]:       <target dev="vdc" bus="virtio"/>
Aug 26 19:11:20 user nova-compute[73917]:       <boot order="1"/>
Aug 26 19:11:20 user nova-compute[73917]:     </disk>
Aug 26 19:11:20 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:11:20 user nova-compute[73917]:       <mac address="fa:16:3e:c9:58:2d"/>
Aug 26 19:11:20 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:11:20 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:11:20 user nova-compute[73917]:       <target dev="tap245e99f5-fb"/>
Aug 26 19:11:20 user nova-compute[73917]:     </interface>
Aug 26 19:11:20 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:11:20 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/console.log" append="off"/>
Aug 26 19:11:20 user nova-compute[73917]:     </serial>
Aug 26 19:11:20 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:11:20 user nova-compute[73917]:     <video>
Aug 26 19:11:20 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:11:20 user nova-compute[73917]:     </video>
Aug 26 19:11:20 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:11:20 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:11:20 user nova-compute[73917]:     </rng>
Aug 26 19:11:20 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:11:20 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:11:20 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:11:20 user nova-compute[73917]:     </memballoon>
Aug 26 19:11:20 user nova-compute[73917]:   </devices>
Aug 26 19:11:20 user nova-compute[73917]: </domain>
Aug 26 19:11:20 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:11:20 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Instance destroyed successfully.
Aug 26 19:11:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] No VIF found with MAC fa:16:3e:c9:58:2d, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:11:20 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077065.5951195, c5120da8-5837-420f-b472-572a088a4a27 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:11:20 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: c5120da8-5837-420f-b472-572a088a4a27] VM Stopped (Lifecycle Event)
Aug 26 19:11:20 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4481955f-55ec-4f36-a6ca-b651f5ed796a None None] [instance: c5120da8-5837-420f-b472-572a088a4a27] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:11:21 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077081.2878075, fdfb377e-119e-41ce-b9e0-6e21053306cc => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:11:21 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] VM Resumed (Lifecycle Event)
Aug 26 19:11:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:11:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:11:21 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Instance rebooted successfully.
Aug 26 19:11:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-3b942553-f5a3-4f6c-b18c-a917d1d06864 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:11:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:11:21 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 19:11:21 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077081.2893083, fdfb377e-119e-41ce-b9e0-6e21053306cc => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:11:21 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] VM Started (Lifecycle Event)
Aug 26 19:11:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:11:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:11:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-1a5bf438-a0e3-4197-96a7-08ccb67deea0 req-23679f3c-2721-441c-a95f-859dda38951c service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1a5bf438-a0e3-4197-96a7-08ccb67deea0 req-23679f3c-2721-441c-a95f-859dda38951c service nova] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1a5bf438-a0e3-4197-96a7-08ccb67deea0 req-23679f3c-2721-441c-a95f-859dda38951c service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1a5bf438-a0e3-4197-96a7-08ccb67deea0 req-23679f3c-2721-441c-a95f-859dda38951c service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-1a5bf438-a0e3-4197-96a7-08ccb67deea0 req-23679f3c-2721-441c-a95f-859dda38951c service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] No waiting events found dispatching network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:21 user nova-compute[73917]: WARNING nova.compute.manager [req-1a5bf438-a0e3-4197-96a7-08ccb67deea0 req-23679f3c-2721-441c-a95f-859dda38951c service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received unexpected event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c for instance with vm_state active and task_state None.
Aug 26 19:11:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-f864cf96-42a9-443a-ad60-0937f4740ee0 req-84bb503f-0733-4257-8710-730fedcb2fac service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-changed-41ff38f9-7c92-4705-acd5-26e82e7d472d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-f864cf96-42a9-443a-ad60-0937f4740ee0 req-84bb503f-0733-4257-8710-730fedcb2fac service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Refreshing instance network info cache due to event network-changed-41ff38f9-7c92-4705-acd5-26e82e7d472d. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:11:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f864cf96-42a9-443a-ad60-0937f4740ee0 req-84bb503f-0733-4257-8710-730fedcb2fac service nova] Acquiring lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:11:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f864cf96-42a9-443a-ad60-0937f4740ee0 req-84bb503f-0733-4257-8710-730fedcb2fac service nova] Acquired lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:11:21 user nova-compute[73917]: DEBUG nova.network.neutron [req-f864cf96-42a9-443a-ad60-0937f4740ee0 req-84bb503f-0733-4257-8710-730fedcb2fac service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Refreshing network info cache for port 41ff38f9-7c92-4705-acd5-26e82e7d472d {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:11:22 user nova-compute[73917]: DEBUG nova.network.neutron [req-f864cf96-42a9-443a-ad60-0937f4740ee0 req-84bb503f-0733-4257-8710-730fedcb2fac service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Updated VIF entry in instance network info cache for port 41ff38f9-7c92-4705-acd5-26e82e7d472d. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:11:22 user nova-compute[73917]: DEBUG nova.network.neutron [req-f864cf96-42a9-443a-ad60-0937f4740ee0 req-84bb503f-0733-4257-8710-730fedcb2fac service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Updating instance_info_cache with network_info: [{"id": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "address": "fa:16:3e:90:51:54", "network": {"id": "ac76a379-a5c0-4a2e-af46-10ba88cc1bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1001642955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ff38f9-7c", "ovs_interfaceid": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "address": "fa:16:3e:04:13:20", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b34769-8c", "ovs_interfaceid": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "address": "fa:16:3e:d4:c6:e1", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0ca7bf-b7", "ovs_interfaceid": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "address": "fa:16:3e:ae:55:aa", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2e08fa-3f", "ovs_interfaceid": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "46f621b9-5715-4346-8832-94ec62dbaf26", "address": "fa:16:3e:84:7e:49", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f621b9-57", "ovs_interfaceid": "46f621b9-5715-4346-8832-94ec62dbaf26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "address": "fa:16:3e:58:d6:83", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a4a214-2e", "ovs_interfaceid": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "address": "fa:16:3e:6b:a4:c0", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc4ead3-a5", "ovs_interfaceid": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f864cf96-42a9-443a-ad60-0937f4740ee0 req-84bb503f-0733-4257-8710-730fedcb2fac service nova] Releasing lock "refresh_cache-06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:11:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-4e069b30-6778-4f82-b67d-7091bdd50e20 req-0d4d2558-c561-42bc-9432-1cbb3e02f8b6 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4e069b30-6778-4f82-b67d-7091bdd50e20 req-0d4d2558-c561-42bc-9432-1cbb3e02f8b6 service nova] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4e069b30-6778-4f82-b67d-7091bdd50e20 req-0d4d2558-c561-42bc-9432-1cbb3e02f8b6 service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4e069b30-6778-4f82-b67d-7091bdd50e20 req-0d4d2558-c561-42bc-9432-1cbb3e02f8b6 service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-4e069b30-6778-4f82-b67d-7091bdd50e20 req-0d4d2558-c561-42bc-9432-1cbb3e02f8b6 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] No waiting events found dispatching network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:23 user nova-compute[73917]: WARNING nova.compute.manager [req-4e069b30-6778-4f82-b67d-7091bdd50e20 req-0d4d2558-c561-42bc-9432-1cbb3e02f8b6 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received unexpected event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc for instance with vm_state active and task_state rescuing.
Aug 26 19:11:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-4e069b30-6778-4f82-b67d-7091bdd50e20 req-0d4d2558-c561-42bc-9432-1cbb3e02f8b6 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4e069b30-6778-4f82-b67d-7091bdd50e20 req-0d4d2558-c561-42bc-9432-1cbb3e02f8b6 service nova] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4e069b30-6778-4f82-b67d-7091bdd50e20 req-0d4d2558-c561-42bc-9432-1cbb3e02f8b6 service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4e069b30-6778-4f82-b67d-7091bdd50e20 req-0d4d2558-c561-42bc-9432-1cbb3e02f8b6 service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-4e069b30-6778-4f82-b67d-7091bdd50e20 req-0d4d2558-c561-42bc-9432-1cbb3e02f8b6 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] No waiting events found dispatching network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:23 user nova-compute[73917]: WARNING nova.compute.manager [req-4e069b30-6778-4f82-b67d-7091bdd50e20 req-0d4d2558-c561-42bc-9432-1cbb3e02f8b6 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received unexpected event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc for instance with vm_state active and task_state rescuing.
Aug 26 19:11:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-4e069b30-6778-4f82-b67d-7091bdd50e20 req-0d4d2558-c561-42bc-9432-1cbb3e02f8b6 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-deleted-19a44d0d-f673-49e9-8c62-014aff19769c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:23 user nova-compute[73917]: INFO nova.compute.manager [req-4e069b30-6778-4f82-b67d-7091bdd50e20 req-0d4d2558-c561-42bc-9432-1cbb3e02f8b6 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Neutron deleted interface 19a44d0d-f673-49e9-8c62-014aff19769c; detaching it from the instance and deleting it from the info cache
Aug 26 19:11:23 user nova-compute[73917]: DEBUG nova.network.neutron [req-4e069b30-6778-4f82-b67d-7091bdd50e20 req-0d4d2558-c561-42bc-9432-1cbb3e02f8b6 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Updating instance_info_cache with network_info: [{"id": "9268e463-2367-4d84-be0e-f432a917b945", "address": "fa:16:3e:3c:5e:e6", "network": {"id": "b5165b66-cdc8-4b7f-ab73-feae1a655345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716155983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9268e463-23", "ovs_interfaceid": "9268e463-2367-4d84-be0e-f432a917b945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "address": "fa:16:3e:d7:d4:c6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc09729-80", "ovs_interfaceid": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22c864bd-81de-436b-9745-de2cf3cfffd5", "address": "fa:16:3e:2b:23:f6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c864bd-81", "ovs_interfaceid": "22c864bd-81de-436b-9745-de2cf3cfffd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "address": "fa:16:3e:ea:a2:cb", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1aa81-34", "ovs_interfaceid": "eec1aa81-34b7-44ea-aa98-57b54a967dcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "address": "fa:16:3e:f6:f5:7c", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4bbc97-cf", "ovs_interfaceid": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "472badf6-8de1-4c67-8bfa-7105f672eff0", "address": "fa:16:3e:c9:52:16", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472badf6-8d", "ovs_interfaceid": "472badf6-8de1-4c67-8bfa-7105f672eff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-4e069b30-6778-4f82-b67d-7091bdd50e20 req-0d4d2558-c561-42bc-9432-1cbb3e02f8b6 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Detach interface failed, port_id=19a44d0d-f673-49e9-8c62-014aff19769c, reason: Instance 54fd570d-421c-4a39-b4ae-772500b24cec could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:11:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-4e069b30-6778-4f82-b67d-7091bdd50e20 req-0d4d2558-c561-42bc-9432-1cbb3e02f8b6 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-deleted-eec1aa81-34b7-44ea-aa98-57b54a967dcc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:23 user nova-compute[73917]: INFO nova.compute.manager [req-4e069b30-6778-4f82-b67d-7091bdd50e20 req-0d4d2558-c561-42bc-9432-1cbb3e02f8b6 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Neutron deleted interface eec1aa81-34b7-44ea-aa98-57b54a967dcc; detaching it from the instance and deleting it from the info cache
Aug 26 19:11:23 user nova-compute[73917]: DEBUG nova.network.neutron [req-4e069b30-6778-4f82-b67d-7091bdd50e20 req-0d4d2558-c561-42bc-9432-1cbb3e02f8b6 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Updating instance_info_cache with network_info: [{"id": "9268e463-2367-4d84-be0e-f432a917b945", "address": "fa:16:3e:3c:5e:e6", "network": {"id": "b5165b66-cdc8-4b7f-ab73-feae1a655345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716155983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9268e463-23", "ovs_interfaceid": "9268e463-2367-4d84-be0e-f432a917b945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "address": "fa:16:3e:d7:d4:c6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc09729-80", "ovs_interfaceid": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22c864bd-81de-436b-9745-de2cf3cfffd5", "address": "fa:16:3e:2b:23:f6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c864bd-81", "ovs_interfaceid": "22c864bd-81de-436b-9745-de2cf3cfffd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "address": "fa:16:3e:f6:f5:7c", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4bbc97-cf", "ovs_interfaceid": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "472badf6-8de1-4c67-8bfa-7105f672eff0", "address": "fa:16:3e:c9:52:16", "network": {"id": "df3ccd13-2ec7-4c92-94e4-82d953121d71", "bridge": "br-int", "label": "tempest-device-tagging-net2-1312266408", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472badf6-8d", "ovs_interfaceid": "472badf6-8de1-4c67-8bfa-7105f672eff0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-4e069b30-6778-4f82-b67d-7091bdd50e20 req-0d4d2558-c561-42bc-9432-1cbb3e02f8b6 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Detach interface failed, port_id=eec1aa81-34b7-44ea-aa98-57b54a967dcc, reason: Instance 54fd570d-421c-4a39-b4ae-772500b24cec could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:11:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Removed pending event for 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 due to event {{(pid=73917) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 19:11:24 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077084.08041, 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:11:24 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] VM Resumed (Lifecycle Event)
Aug 26 19:11:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5425ecf9-e678-4893-a23a-3eaa6f92ab0d tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:11:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:11:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:11:24 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 19:11:24 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077084.089158, 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:11:24 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] VM Started (Lifecycle Event)
Aug 26 19:11:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:11:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:11:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:24 user nova-compute[73917]: INFO nova.compute.manager [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Terminating instance
Aug 26 19:11:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:11:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-07a26fac-45fb-4181-81c7-1b676469d9d3 req-adbefac4-cf7e-4e81-b22c-9a3a8093e476 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-unplugged-13b34769-8c09-4cc2-a083-6fa9aef81a5e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-07a26fac-45fb-4181-81c7-1b676469d9d3 req-adbefac4-cf7e-4e81-b22c-9a3a8093e476 service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-07a26fac-45fb-4181-81c7-1b676469d9d3 req-adbefac4-cf7e-4e81-b22c-9a3a8093e476 service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-07a26fac-45fb-4181-81c7-1b676469d9d3 req-adbefac4-cf7e-4e81-b22c-9a3a8093e476 service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-07a26fac-45fb-4181-81c7-1b676469d9d3 req-adbefac4-cf7e-4e81-b22c-9a3a8093e476 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-unplugged-13b34769-8c09-4cc2-a083-6fa9aef81a5e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-07a26fac-45fb-4181-81c7-1b676469d9d3 req-adbefac4-cf7e-4e81-b22c-9a3a8093e476 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-unplugged-13b34769-8c09-4cc2-a083-6fa9aef81a5e for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-e50139fb-166d-4d2c-9eea-7a3af25f6376 req-92481d1d-ae8e-405e-991d-c6383697f0dc service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-unplugged-b8a4a214-2ed6-4e39-b408-e8636f7a5bc2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e50139fb-166d-4d2c-9eea-7a3af25f6376 req-92481d1d-ae8e-405e-991d-c6383697f0dc service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e50139fb-166d-4d2c-9eea-7a3af25f6376 req-92481d1d-ae8e-405e-991d-c6383697f0dc service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e50139fb-166d-4d2c-9eea-7a3af25f6376 req-92481d1d-ae8e-405e-991d-c6383697f0dc service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-e50139fb-166d-4d2c-9eea-7a3af25f6376 req-92481d1d-ae8e-405e-991d-c6383697f0dc service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-unplugged-b8a4a214-2ed6-4e39-b408-e8636f7a5bc2 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-e50139fb-166d-4d2c-9eea-7a3af25f6376 req-92481d1d-ae8e-405e-991d-c6383697f0dc service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-unplugged-b8a4a214-2ed6-4e39-b408-e8636f7a5bc2 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-f2ca9130-8ae6-4357-8f97-807c62586ad5 req-55016ba5-1b33-4b0e-b255-615f910728c9 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-deleted-472badf6-8de1-4c67-8bfa-7105f672eff0 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:25 user nova-compute[73917]: INFO nova.compute.manager [req-f2ca9130-8ae6-4357-8f97-807c62586ad5 req-55016ba5-1b33-4b0e-b255-615f910728c9 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Neutron deleted interface 472badf6-8de1-4c67-8bfa-7105f672eff0; detaching it from the instance and deleting it from the info cache
Aug 26 19:11:25 user nova-compute[73917]: DEBUG nova.network.neutron [req-f2ca9130-8ae6-4357-8f97-807c62586ad5 req-55016ba5-1b33-4b0e-b255-615f910728c9 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Updating instance_info_cache with network_info: [{"id": "9268e463-2367-4d84-be0e-f432a917b945", "address": "fa:16:3e:3c:5e:e6", "network": {"id": "b5165b66-cdc8-4b7f-ab73-feae1a655345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716155983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9268e463-23", "ovs_interfaceid": "9268e463-2367-4d84-be0e-f432a917b945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "address": "fa:16:3e:d7:d4:c6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc09729-80", "ovs_interfaceid": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22c864bd-81de-436b-9745-de2cf3cfffd5", "address": "fa:16:3e:2b:23:f6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c864bd-81", "ovs_interfaceid": "22c864bd-81de-436b-9745-de2cf3cfffd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "address": "fa:16:3e:f6:f5:7c", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4bbc97-cf", "ovs_interfaceid": "2d4bbc97-cf69-4155-8f62-0de77084cbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-f2ca9130-8ae6-4357-8f97-807c62586ad5 req-55016ba5-1b33-4b0e-b255-615f910728c9 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Detach interface failed, port_id=472badf6-8de1-4c67-8bfa-7105f672eff0, reason: Instance 54fd570d-421c-4a39-b4ae-772500b24cec could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-f2ca9130-8ae6-4357-8f97-807c62586ad5 req-55016ba5-1b33-4b0e-b255-615f910728c9 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-deleted-2d4bbc97-cf69-4155-8f62-0de77084cbdd {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:25 user nova-compute[73917]: INFO nova.compute.manager [req-f2ca9130-8ae6-4357-8f97-807c62586ad5 req-55016ba5-1b33-4b0e-b255-615f910728c9 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Neutron deleted interface 2d4bbc97-cf69-4155-8f62-0de77084cbdd; detaching it from the instance and deleting it from the info cache
Aug 26 19:11:25 user nova-compute[73917]: DEBUG nova.network.neutron [req-f2ca9130-8ae6-4357-8f97-807c62586ad5 req-55016ba5-1b33-4b0e-b255-615f910728c9 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Updating instance_info_cache with network_info: [{"id": "9268e463-2367-4d84-be0e-f432a917b945", "address": "fa:16:3e:3c:5e:e6", "network": {"id": "b5165b66-cdc8-4b7f-ab73-feae1a655345", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716155983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9268e463-23", "ovs_interfaceid": "9268e463-2367-4d84-be0e-f432a917b945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "address": "fa:16:3e:d7:d4:c6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc09729-80", "ovs_interfaceid": "dfc09729-80ce-463f-8ad4-4f16f8b304f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22c864bd-81de-436b-9745-de2cf3cfffd5", "address": "fa:16:3e:2b:23:f6", "network": {"id": "254b6d4e-6335-4a52-a0cb-8c4fdccef3a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-994593458", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a01f4bc78d87474a8a3027d928dc77e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c864bd-81", "ovs_interfaceid": "22c864bd-81de-436b-9745-de2cf3cfffd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-f2ca9130-8ae6-4357-8f97-807c62586ad5 req-55016ba5-1b33-4b0e-b255-615f910728c9 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Detach interface failed, port_id=2d4bbc97-cf69-4155-8f62-0de77084cbdd, reason: Instance 54fd570d-421c-4a39-b4ae-772500b24cec could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-f2ca9130-8ae6-4357-8f97-807c62586ad5 req-55016ba5-1b33-4b0e-b255-615f910728c9 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-unplugged-41ff38f9-7c92-4705-acd5-26e82e7d472d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f2ca9130-8ae6-4357-8f97-807c62586ad5 req-55016ba5-1b33-4b0e-b255-615f910728c9 service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f2ca9130-8ae6-4357-8f97-807c62586ad5 req-55016ba5-1b33-4b0e-b255-615f910728c9 service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f2ca9130-8ae6-4357-8f97-807c62586ad5 req-55016ba5-1b33-4b0e-b255-615f910728c9 service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-f2ca9130-8ae6-4357-8f97-807c62586ad5 req-55016ba5-1b33-4b0e-b255-615f910728c9 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-unplugged-41ff38f9-7c92-4705-acd5-26e82e7d472d {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-f2ca9130-8ae6-4357-8f97-807c62586ad5 req-55016ba5-1b33-4b0e-b255-615f910728c9 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-unplugged-41ff38f9-7c92-4705-acd5-26e82e7d472d for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:11:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:26 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Instance destroyed successfully.
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.objects.instance [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lazy-loading 'resources' on Instance uuid 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077071.5537999, 2e449059-38d9-40bb-aa04-8b6c3865309b => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:11:26 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] VM Stopped (Lifecycle Event)
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:09:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:09:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "address": "fa:16:3e:90:51:54", "network": {"id": "ac76a379-a5c0-4a2e-af46-10ba88cc1bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1001642955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ff38f9-7c", "ovs_interfaceid": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "address": "fa:16:3e:90:51:54", "network": {"id": "ac76a379-a5c0-4a2e-af46-10ba88cc1bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1001642955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ff38f9-7c", "ovs_interfaceid": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:51:54,bridge_name='br-int',has_traffic_filtering=True,id=41ff38f9-7c92-4705-acd5-26e82e7d472d,network=Network(ac76a379-a5c0-4a2e-af46-10ba88cc1bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41ff38f9-7c') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG os_vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:51:54,bridge_name='br-int',has_traffic_filtering=True,id=41ff38f9-7c92-4705-acd5-26e82e7d472d,network=Network(ac76a379-a5c0-4a2e-af46-10ba88cc1bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41ff38f9-7c') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41ff38f9-7c, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-543063bf-1a31-4581-8cd0-35a1eb9f7503 None None] [instance: 2e449059-38d9-40bb-aa04-8b6c3865309b] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:11:26 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Took 7.38 seconds to deallocate network for instance.
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:26 user nova-compute[73917]: INFO os_vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:51:54,bridge_name='br-int',has_traffic_filtering=True,id=41ff38f9-7c92-4705-acd5-26e82e7d472d,network=Network(ac76a379-a5c0-4a2e-af46-10ba88cc1bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41ff38f9-7c')
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:09:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:09:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "address": "fa:16:3e:04:13:20", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b34769-8c", "ovs_interfaceid": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "address": "fa:16:3e:04:13:20", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b34769-8c", "ovs_interfaceid": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:13:20,bridge_name='br-int',has_traffic_filtering=True,id=13b34769-8c09-4cc2-a083-6fa9aef81a5e,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13b34769-8c') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG os_vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:13:20,bridge_name='br-int',has_traffic_filtering=True,id=13b34769-8c09-4cc2-a083-6fa9aef81a5e,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13b34769-8c') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13b34769-8c, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:26 user nova-compute[73917]: INFO os_vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:13:20,bridge_name='br-int',has_traffic_filtering=True,id=13b34769-8c09-4cc2-a083-6fa9aef81a5e,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13b34769-8c')
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:09:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:09:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "address": "fa:16:3e:d4:c6:e1", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0ca7bf-b7", "ovs_interfaceid": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "address": "fa:16:3e:d4:c6:e1", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0ca7bf-b7", "ovs_interfaceid": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c6:e1,bridge_name='br-int',has_traffic_filtering=True,id=8b0ca7bf-b702-4c8a-9ba8-15d3d9725437,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b0ca7bf-b7') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG os_vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c6:e1,bridge_name='br-int',has_traffic_filtering=True,id=8b0ca7bf-b702-4c8a-9ba8-15d3d9725437,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b0ca7bf-b7') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b0ca7bf-b7, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:26 user nova-compute[73917]: INFO os_vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c6:e1,bridge_name='br-int',has_traffic_filtering=True,id=8b0ca7bf-b702-4c8a-9ba8-15d3d9725437,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b0ca7bf-b7')
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:09:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:09:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "address": "fa:16:3e:ae:55:aa", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2e08fa-3f", "ovs_interfaceid": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "address": "fa:16:3e:ae:55:aa", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2e08fa-3f", "ovs_interfaceid": "6d2e08fa-3f5c-4648-8702-e52284894e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:55:aa,bridge_name='br-int',has_traffic_filtering=True,id=6d2e08fa-3f5c-4648-8702-e52284894e6c,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2e08fa-3f') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG os_vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:55:aa,bridge_name='br-int',has_traffic_filtering=True,id=6d2e08fa-3f5c-4648-8702-e52284894e6c,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2e08fa-3f') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d2e08fa-3f, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:26 user nova-compute[73917]: INFO os_vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:55:aa,bridge_name='br-int',has_traffic_filtering=True,id=6d2e08fa-3f5c-4648-8702-e52284894e6c,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2e08fa-3f')
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:09:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:09:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46f621b9-5715-4346-8832-94ec62dbaf26", "address": "fa:16:3e:84:7e:49", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f621b9-57", "ovs_interfaceid": "46f621b9-5715-4346-8832-94ec62dbaf26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "46f621b9-5715-4346-8832-94ec62dbaf26", "address": "fa:16:3e:84:7e:49", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f621b9-57", "ovs_interfaceid": "46f621b9-5715-4346-8832-94ec62dbaf26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:7e:49,bridge_name='br-int',has_traffic_filtering=True,id=46f621b9-5715-4346-8832-94ec62dbaf26,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f621b9-57') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG os_vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:7e:49,bridge_name='br-int',has_traffic_filtering=True,id=46f621b9-5715-4346-8832-94ec62dbaf26,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f621b9-57') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46f621b9-57, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:26 user nova-compute[73917]: INFO os_vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:7e:49,bridge_name='br-int',has_traffic_filtering=True,id=46f621b9-5715-4346-8832-94ec62dbaf26,network=Network(7f61e6a6-dad2-4289-8a5c-92e45aaac030),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f621b9-57')
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:09:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:09:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "address": "fa:16:3e:58:d6:83", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a4a214-2e", "ovs_interfaceid": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "address": "fa:16:3e:58:d6:83", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a4a214-2e", "ovs_interfaceid": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:d6:83,bridge_name='br-int',has_traffic_filtering=True,id=b8a4a214-2ed6-4e39-b408-e8636f7a5bc2,network=Network(b97befdf-464c-4341-b12d-97b8e3b350ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a4a214-2e') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG os_vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:d6:83,bridge_name='br-int',has_traffic_filtering=True,id=b8a4a214-2ed6-4e39-b408-e8636f7a5bc2,network=Network(b97befdf-464c-4341-b12d-97b8e3b350ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a4a214-2e') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8a4a214-2e, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:26 user nova-compute[73917]: INFO os_vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:d6:83,bridge_name='br-int',has_traffic_filtering=True,id=b8a4a214-2ed6-4e39-b408-e8636f7a5bc2,network=Network(b97befdf-464c-4341-b12d-97b8e3b350ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a4a214-2e')
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T19:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570975378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-570975378',id=13,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34EMdjEu8AU9N82VLL0mHZJkOUdZDPapmwgvgnvRpWHLhr8QnVTh7QIwGZ+rRCN0A44W5VgKpbCPYjgDPZ0W834E8kKreB0jq6dNbsC5vJkXivPWGq4dfh3veFQpk4rg==',key_name='tempest-keypair-1881002831',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:09:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42c12b2a813a419ea0705659b402aff5',ramdisk_id='',reservation_id='r-0rl44cim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-541646257',owner_user_name='tempest-TaggedBootDevicesTest_v242-541646257-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:09:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='342283890ee8406f980c8637d7ce3cd6',uuid=06bdc5b6-c1cb-4006-a48f-73e762fdb7ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "address": "fa:16:3e:6b:a4:c0", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc4ead3-a5", "ovs_interfaceid": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converting VIF {"id": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "address": "fa:16:3e:6b:a4:c0", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc4ead3-a5", "ovs_interfaceid": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:a4:c0,bridge_name='br-int',has_traffic_filtering=True,id=fdc4ead3-a55c-4dcb-b62c-7cac780b2343,network=Network(b97befdf-464c-4341-b12d-97b8e3b350ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc4ead3-a5') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG os_vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:a4:c0,bridge_name='br-int',has_traffic_filtering=True,id=fdc4ead3-a55c-4dcb-b62c-7cac780b2343,network=Network(b97befdf-464c-4341-b12d-97b8e3b350ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc4ead3-a5') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdc4ead3-a5, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:11:26 user nova-compute[73917]: INFO os_vif [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:a4:c0,bridge_name='br-int',has_traffic_filtering=True,id=fdc4ead3-a55c-4dcb-b62c-7cac780b2343,network=Network(b97befdf-464c-4341-b12d-97b8e3b350ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc4ead3-a5')
Aug 26 19:11:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFWqzoui', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:11:26 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:11:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:11:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b822741-22e5-4974-ac00-480789aa9c4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2412a9-17c8-429f-9aed-958367939794]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:27 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:27 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b784ff5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646'): ({'sdc'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Removing single pathed devices sdc {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba2bb02-a3a1-48fe-a692-27b5fd9662b4]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[57198f01-1a88-4d21-bcc2-b6ca1f7d2df3]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Flushing IO for device /dev/sdc {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-13b34769-8c09-4cc2-a083-6fa9aef81a5e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-13b34769-8c09-4cc2-a083-6fa9aef81a5e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:27 user nova-compute[73917]: WARNING nova.compute.manager [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-13b34769-8c09-4cc2-a083-6fa9aef81a5e for instance with vm_state active and task_state deleting.
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-unplugged-6d2e08fa-3f5c-4648-8702-e52284894e6c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-unplugged-6d2e08fa-3f5c-4648-8702-e52284894e6c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-unplugged-6d2e08fa-3f5c-4648-8702-e52284894e6c for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-6d2e08fa-3f5c-4648-8702-e52284894e6c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-6d2e08fa-3f5c-4648-8702-e52284894e6c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:27 user nova-compute[73917]: WARNING nova.compute.manager [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-6d2e08fa-3f5c-4648-8702-e52284894e6c for instance with vm_state active and task_state deleting.
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-unplugged-46f621b9-5715-4346-8832-94ec62dbaf26 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-unplugged-46f621b9-5715-4346-8832-94ec62dbaf26 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-unplugged-46f621b9-5715-4346-8832-94ec62dbaf26 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-46f621b9-5715-4346-8832-94ec62dbaf26 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-46f621b9-5715-4346-8832-94ec62dbaf26 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:27 user nova-compute[73917]: WARNING nova.compute.manager [req-a8dbf57c-e2d0-43ea-9a3e-8a27a8f91cae req-7b1a50d2-d407-40eb-8b9b-5df74f5d04fb service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-46f621b9-5715-4346-8832-94ec62dbaf26 for instance with vm_state active and task_state deleting.
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df3dc24-f1f3-40d1-b5e7-11e46fee5239]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e9b632-9cee-44b4-b211-70a7184086c2]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d4139e-1fbf-40a5-8c70-97251fbe9b49]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b542a0fc-e0aa-4d6d-b311-74f3a759492e]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646, portal: 172.16.0.220,3260]
Aug 26 19:11:27 user nova-compute[73917]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646, portal: 172.16.0.220,3260] successful.
Aug 26 19:11:27 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d07ba6-5f5f-4479-a9e7-c7ea8fea1646 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4660c0-f7a4-4de0-a78d-bcdd49fe0b83]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] <== disconnect_volume: return (404ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVpoXjlb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:11:27 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[844792cc-b7b7-40e4-ac72-fc749656381e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b7c282-a8df-4c1a-80ae-39aa2d8e71f9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:27 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc (non-flash)
Aug 26 19:11:27 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b784ff5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc'): ({'sdh'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Removing single pathed devices sdh {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[52291262-bb65-48e2-a5f4-5c713f311782]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1455d2-85a9-48a8-96bc-2473fbe21c7c]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Flushing IO for device /dev/sdh {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa90ddc-ff03-40e1-ad78-b68694288e10]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f74a457-d800-4e26-9bcc-4c062bd9ec00]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] SCSI volumes sdh have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-9a68be38-d2e9-4984-bef2-4ef2e68f9973 req-749468e2-0a58-4769-8673-282e5bbb6bb9 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-b8a4a214-2ed6-4e39-b408-e8636f7a5bc2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9a68be38-d2e9-4984-bef2-4ef2e68f9973 req-749468e2-0a58-4769-8673-282e5bbb6bb9 service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9a68be38-d2e9-4984-bef2-4ef2e68f9973 req-749468e2-0a58-4769-8673-282e5bbb6bb9 service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9a68be38-d2e9-4984-bef2-4ef2e68f9973 req-749468e2-0a58-4769-8673-282e5bbb6bb9 service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-9a68be38-d2e9-4984-bef2-4ef2e68f9973 req-749468e2-0a58-4769-8673-282e5bbb6bb9 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-b8a4a214-2ed6-4e39-b408-e8636f7a5bc2 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:27 user nova-compute[73917]: WARNING nova.compute.manager [req-9a68be38-d2e9-4984-bef2-4ef2e68f9973 req-749468e2-0a58-4769-8673-282e5bbb6bb9 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-b8a4a214-2ed6-4e39-b408-e8636f7a5bc2 for instance with vm_state active and task_state deleting.
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-9a68be38-d2e9-4984-bef2-4ef2e68f9973 req-749468e2-0a58-4769-8673-282e5bbb6bb9 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-unplugged-fdc4ead3-a55c-4dcb-b62c-7cac780b2343 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9a68be38-d2e9-4984-bef2-4ef2e68f9973 req-749468e2-0a58-4769-8673-282e5bbb6bb9 service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9a68be38-d2e9-4984-bef2-4ef2e68f9973 req-749468e2-0a58-4769-8673-282e5bbb6bb9 service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9a68be38-d2e9-4984-bef2-4ef2e68f9973 req-749468e2-0a58-4769-8673-282e5bbb6bb9 service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-9a68be38-d2e9-4984-bef2-4ef2e68f9973 req-749468e2-0a58-4769-8673-282e5bbb6bb9 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-unplugged-fdc4ead3-a55c-4dcb-b62c-7cac780b2343 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-9a68be38-d2e9-4984-bef2-4ef2e68f9973 req-749468e2-0a58-4769-8673-282e5bbb6bb9 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-unplugged-fdc4ead3-a55c-4dcb-b62c-7cac780b2343 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-9a68be38-d2e9-4984-bef2-4ef2e68f9973 req-749468e2-0a58-4769-8673-282e5bbb6bb9 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-fdc4ead3-a55c-4dcb-b62c-7cac780b2343 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9a68be38-d2e9-4984-bef2-4ef2e68f9973 req-749468e2-0a58-4769-8673-282e5bbb6bb9 service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9a68be38-d2e9-4984-bef2-4ef2e68f9973 req-749468e2-0a58-4769-8673-282e5bbb6bb9 service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9a68be38-d2e9-4984-bef2-4ef2e68f9973 req-749468e2-0a58-4769-8673-282e5bbb6bb9 service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-9a68be38-d2e9-4984-bef2-4ef2e68f9973 req-749468e2-0a58-4769-8673-282e5bbb6bb9 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-fdc4ead3-a55c-4dcb-b62c-7cac780b2343 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:27 user nova-compute[73917]: WARNING nova.compute.manager [req-9a68be38-d2e9-4984-bef2-4ef2e68f9973 req-749468e2-0a58-4769-8673-282e5bbb6bb9 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-fdc4ead3-a55c-4dcb-b62c-7cac780b2343 for instance with vm_state active and task_state deleting.
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fee399-c587-4743-9668-150eff06fbf3]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd46414c-3f99-415f-8774-52ea9dc47667]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc, portal: 172.16.0.220,3260]
Aug 26 19:11:27 user nova-compute[73917]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc, portal: 172.16.0.220,3260] successful.
Aug 26 19:11:27 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85aa6bd1-1305-4063-99e0-70e1329a38cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddacf66-deb2-439b-a9b2-e89073b0f957]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] <== disconnect_volume: return (358ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zYiWXCrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:11:27 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[22754832-37cb-4510-a54f-b11862ffc676]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97ac890-1852-470e-b6a3-3f307763000e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:27 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:11:27 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:11:27 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b784ff5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb'): ({'sdi'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Removing single pathed devices sdi {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6482c28b-e6c6-4a41-b879-c0d36914539c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f52f529-36a6-4871-b274-0610f8852762]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Flushing IO for device /dev/sdi {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9654c652-90b3-42c8-8919-409962ba0529]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-d3ffe658-bf81-4653-9ecf-e037031eb884 req-cfd96711-08cc-4037-8dea-4858d9188150 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-41ff38f9-7c92-4705-acd5-26e82e7d472d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d3ffe658-bf81-4653-9ecf-e037031eb884 req-cfd96711-08cc-4037-8dea-4858d9188150 service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d3ffe658-bf81-4653-9ecf-e037031eb884 req-cfd96711-08cc-4037-8dea-4858d9188150 service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d3ffe658-bf81-4653-9ecf-e037031eb884 req-cfd96711-08cc-4037-8dea-4858d9188150 service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-d3ffe658-bf81-4653-9ecf-e037031eb884 req-cfd96711-08cc-4037-8dea-4858d9188150 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-41ff38f9-7c92-4705-acd5-26e82e7d472d {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:27 user nova-compute[73917]: WARNING nova.compute.manager [req-d3ffe658-bf81-4653-9ecf-e037031eb884 req-cfd96711-08cc-4037-8dea-4858d9188150 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-41ff38f9-7c92-4705-acd5-26e82e7d472d for instance with vm_state active and task_state deleting.
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-d3ffe658-bf81-4653-9ecf-e037031eb884 req-cfd96711-08cc-4037-8dea-4858d9188150 service nova] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Received event network-vif-deleted-9268e463-2367-4d84-be0e-f432a917b945 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-d3ffe658-bf81-4653-9ecf-e037031eb884 req-cfd96711-08cc-4037-8dea-4858d9188150 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-unplugged-8b0ca7bf-b702-4c8a-9ba8-15d3d9725437 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d3ffe658-bf81-4653-9ecf-e037031eb884 req-cfd96711-08cc-4037-8dea-4858d9188150 service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d3ffe658-bf81-4653-9ecf-e037031eb884 req-cfd96711-08cc-4037-8dea-4858d9188150 service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d3ffe658-bf81-4653-9ecf-e037031eb884 req-cfd96711-08cc-4037-8dea-4858d9188150 service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-d3ffe658-bf81-4653-9ecf-e037031eb884 req-cfd96711-08cc-4037-8dea-4858d9188150 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-unplugged-8b0ca7bf-b702-4c8a-9ba8-15d3d9725437 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-d3ffe658-bf81-4653-9ecf-e037031eb884 req-cfd96711-08cc-4037-8dea-4858d9188150 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-unplugged-8b0ca7bf-b702-4c8a-9ba8-15d3d9725437 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-d3ffe658-bf81-4653-9ecf-e037031eb884 req-cfd96711-08cc-4037-8dea-4858d9188150 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-plugged-8b0ca7bf-b702-4c8a-9ba8-15d3d9725437 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d3ffe658-bf81-4653-9ecf-e037031eb884 req-cfd96711-08cc-4037-8dea-4858d9188150 service nova] Acquiring lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d3ffe658-bf81-4653-9ecf-e037031eb884 req-cfd96711-08cc-4037-8dea-4858d9188150 service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d3ffe658-bf81-4653-9ecf-e037031eb884 req-cfd96711-08cc-4037-8dea-4858d9188150 service nova] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-d3ffe658-bf81-4653-9ecf-e037031eb884 req-cfd96711-08cc-4037-8dea-4858d9188150 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] No waiting events found dispatching network-vif-plugged-8b0ca7bf-b702-4c8a-9ba8-15d3d9725437 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:27 user nova-compute[73917]: WARNING nova.compute.manager [req-d3ffe658-bf81-4653-9ecf-e037031eb884 req-cfd96711-08cc-4037-8dea-4858d9188150 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received unexpected event network-vif-plugged-8b0ca7bf-b702-4c8a-9ba8-15d3d9725437 for instance with vm_state active and task_state deleting.
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.037s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[654e1e23-db48-40b6-976f-0e6d215fb4ce]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] SCSI volumes sdi have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[887e489c-9e4d-4ca0-9e5c-ab3c791c4427]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:28 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6e5a3d-6db3-49e3-b4eb-c2e9136bd3dc]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb, portal: 172.16.0.220,3260]
Aug 26 19:11:28 user nova-compute[73917]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb, portal: 172.16.0.220,3260] successful.
Aug 26 19:11:28 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f6874a-24b7-4e83-bd0d-01ea7bad1cdb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:28 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[44907b4a-c898-4af3-a547-2471fb154611]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:11:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:11:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:11:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] <== disconnect_volume: return (338ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:11:28 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:11:28 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Deleting instance files /opt/stack/data/nova/instances/06bdc5b6-c1cb-4006-a48f-73e762fdb7ed_del
Aug 26 19:11:28 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Deletion of /opt/stack/data/nova/instances/06bdc5b6-c1cb-4006-a48f-73e762fdb7ed_del complete
Aug 26 19:11:28 user nova-compute[73917]: INFO nova.compute.manager [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Took 3.74 seconds to destroy the instance on the hypervisor.
Aug 26 19:11:28 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:11:28 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:11:28 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:11:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Acquiring lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Acquiring lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:29 user nova-compute[73917]: INFO nova.compute.manager [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Terminating instance
Aug 26 19:11:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:11:29 user nova-compute[73917]: INFO nova.compute.manager [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Took 3.20 seconds to detach 3 volumes for instance.
Aug 26 19:11:29 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077074.8553429, 54fd570d-421c-4a39-b4ae-772500b24cec => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:11:29 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] VM Stopped (Lifecycle Event)
Aug 26 19:11:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-3510db15-2e0c-4b79-b4d2-752455f23d30 None None] [instance: 54fd570d-421c-4a39-b4ae-772500b24cec] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:11:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG nova.compute.manager [req-d1f971a3-862d-49f9-b858-770dd5b82e34 req-ca5d18c9-0831-4385-8ddf-8e2ccd2d8bc5 service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Received event network-vif-unplugged-2ad6ccc6-cb71-4105-88e4-cb48743f26ad {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d1f971a3-862d-49f9-b858-770dd5b82e34 req-ca5d18c9-0831-4385-8ddf-8e2ccd2d8bc5 service nova] Acquiring lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d1f971a3-862d-49f9-b858-770dd5b82e34 req-ca5d18c9-0831-4385-8ddf-8e2ccd2d8bc5 service nova] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d1f971a3-862d-49f9-b858-770dd5b82e34 req-ca5d18c9-0831-4385-8ddf-8e2ccd2d8bc5 service nova] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG nova.compute.manager [req-d1f971a3-862d-49f9-b858-770dd5b82e34 req-ca5d18c9-0831-4385-8ddf-8e2ccd2d8bc5 service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] No waiting events found dispatching network-vif-unplugged-2ad6ccc6-cb71-4105-88e4-cb48743f26ad {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG nova.compute.manager [req-d1f971a3-862d-49f9-b858-770dd5b82e34 req-ca5d18c9-0831-4385-8ddf-8e2ccd2d8bc5 service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Received event network-vif-unplugged-2ad6ccc6-cb71-4105-88e4-cb48743f26ad for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG nova.compute.manager [req-4083b9c0-1801-4dd5-82c7-aef802e8ba64 req-97831eba-3451-4cd6-ad7a-820feed1e005 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-deleted-6d2e08fa-3f5c-4648-8702-e52284894e6c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:30 user nova-compute[73917]: INFO nova.compute.manager [req-4083b9c0-1801-4dd5-82c7-aef802e8ba64 req-97831eba-3451-4cd6-ad7a-820feed1e005 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Neutron deleted interface 6d2e08fa-3f5c-4648-8702-e52284894e6c; detaching it from the instance and deleting it from the info cache
Aug 26 19:11:30 user nova-compute[73917]: DEBUG nova.network.neutron [req-4083b9c0-1801-4dd5-82c7-aef802e8ba64 req-97831eba-3451-4cd6-ad7a-820feed1e005 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Updating instance_info_cache with network_info: [{"id": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "address": "fa:16:3e:90:51:54", "network": {"id": "ac76a379-a5c0-4a2e-af46-10ba88cc1bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1001642955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ff38f9-7c", "ovs_interfaceid": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "address": "fa:16:3e:04:13:20", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b34769-8c", "ovs_interfaceid": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "address": "fa:16:3e:d4:c6:e1", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0ca7bf-b7", "ovs_interfaceid": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "46f621b9-5715-4346-8832-94ec62dbaf26", "address": "fa:16:3e:84:7e:49", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f621b9-57", "ovs_interfaceid": "46f621b9-5715-4346-8832-94ec62dbaf26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "address": "fa:16:3e:58:d6:83", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a4a214-2e", "ovs_interfaceid": "b8a4a214-2ed6-4e39-b408-e8636f7a5bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "address": "fa:16:3e:6b:a4:c0", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc4ead3-a5", "ovs_interfaceid": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG nova.compute.manager [req-4083b9c0-1801-4dd5-82c7-aef802e8ba64 req-97831eba-3451-4cd6-ad7a-820feed1e005 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Detach interface failed, port_id=6d2e08fa-3f5c-4648-8702-e52284894e6c, reason: Instance 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.576s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:30 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Deleted allocations for instance 54fd570d-421c-4a39-b4ae-772500b24cec
Aug 26 19:11:30 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Instance destroyed successfully.
Aug 26 19:11:30 user nova-compute[73917]: DEBUG nova.objects.instance [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lazy-loading 'resources' on Instance uuid f019c6c6-e76f-4a75-8ba4-8c566d9f5791 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1921623851',display_name='tempest-TestVolumeSwap-server-1921623851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1921623851',id=8,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4DxOeUrsWdoNPKwvW/Fztnax3C20SNZ4GuOmagGZ9rWi0hpw2iK9pfsOOl6n2MJwdLwGjNnl8umrV2gh6KR7RZvxM9RXZEymGUh/B6mB33DYqz/n9ycxSYBdRgxFcinQ==',key_name='tempest-keypair-702211707',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='145ef38260474f159e954ecfa742224d',ramdisk_id='',reservation_id='r-abb4ljok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1550182461',owner_user_name='tempest-TestVolumeSwap-1550182461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bea89f8fa9d469d818e732ebd61c270',uuid=f019c6c6-e76f-4a75-8ba4-8c566d9f5791,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "address": "fa:16:3e:90:3b:ae", "network": {"id": "d7f21c5c-fb69-4df5-aadb-b4712d9368cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-187373287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145ef38260474f159e954ecfa742224d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ad6ccc6-cb", "ovs_interfaceid": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Converting VIF {"id": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "address": "fa:16:3e:90:3b:ae", "network": {"id": "d7f21c5c-fb69-4df5-aadb-b4712d9368cf", "bridge": "br-int", "label": "tempest-TestVolumeSwap-187373287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145ef38260474f159e954ecfa742224d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ad6ccc6-cb", "ovs_interfaceid": "2ad6ccc6-cb71-4105-88e4-cb48743f26ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:3b:ae,bridge_name='br-int',has_traffic_filtering=True,id=2ad6ccc6-cb71-4105-88e4-cb48743f26ad,network=Network(d7f21c5c-fb69-4df5-aadb-b4712d9368cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ad6ccc6-cb') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG os_vif [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:3b:ae,bridge_name='br-int',has_traffic_filtering=True,id=2ad6ccc6-cb71-4105-88e4-cb48743f26ad,network=Network(d7f21c5c-fb69-4df5-aadb-b4712d9368cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ad6ccc6-cb') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ad6ccc6-cb, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:11:30 user nova-compute[73917]: INFO os_vif [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:3b:ae,bridge_name='br-int',has_traffic_filtering=True,id=2ad6ccc6-cb71-4105-88e4-cb48743f26ad,network=Network(d7f21c5c-fb69-4df5-aadb-b4712d9368cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ad6ccc6-cb')
Aug 26 19:11:30 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Deleting instance files /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791_del
Aug 26 19:11:30 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Deletion of /opt/stack/data/nova/instances/f019c6c6-e76f-4a75-8ba4-8c566d9f5791_del complete
Aug 26 19:11:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6711c0a8-f767-444f-9f89-224461ace723 tempest-TaggedBootDevicesTest-403565623 tempest-TaggedBootDevicesTest-403565623-project-member] Lock "54fd570d-421c-4a39-b4ae-772500b24cec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.956s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:30 user nova-compute[73917]: INFO nova.compute.manager [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 26 19:11:30 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:11:30 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:11:31 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-aaf92d65-76de-46b5-8a02-3c909cd7228a req-7091ca8e-d356-41a8-b966-49247c486cc2 service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Received event network-vif-deleted-2ad6ccc6-cb71-4105-88e4-cb48743f26ad {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:31 user nova-compute[73917]: INFO nova.compute.manager [req-aaf92d65-76de-46b5-8a02-3c909cd7228a req-7091ca8e-d356-41a8-b966-49247c486cc2 service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Neutron deleted interface 2ad6ccc6-cb71-4105-88e4-cb48743f26ad; detaching it from the instance and deleting it from the info cache
Aug 26 19:11:31 user nova-compute[73917]: DEBUG nova.network.neutron [req-aaf92d65-76de-46b5-8a02-3c909cd7228a req-7091ca8e-d356-41a8-b966-49247c486cc2 service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:31 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Took 1.14 seconds to deallocate network for instance.
Aug 26 19:11:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-aaf92d65-76de-46b5-8a02-3c909cd7228a req-7091ca8e-d356-41a8-b966-49247c486cc2 service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Detach interface failed, port_id=2ad6ccc6-cb71-4105-88e4-cb48743f26ad, reason: Instance f019c6c6-e76f-4a75-8ba4-8c566d9f5791 could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:11:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:32 user nova-compute[73917]: DEBUG nova.compute.manager [req-ec06974e-5bbb-4388-8c60-2401f7756064 req-b6e55379-2cad-457d-82c7-49c0f7552e9a service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Received event network-vif-plugged-2ad6ccc6-cb71-4105-88e4-cb48743f26ad {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ec06974e-5bbb-4388-8c60-2401f7756064 req-b6e55379-2cad-457d-82c7-49c0f7552e9a service nova] Acquiring lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ec06974e-5bbb-4388-8c60-2401f7756064 req-b6e55379-2cad-457d-82c7-49c0f7552e9a service nova] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ec06974e-5bbb-4388-8c60-2401f7756064 req-b6e55379-2cad-457d-82c7-49c0f7552e9a service nova] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:32 user nova-compute[73917]: DEBUG nova.compute.manager [req-ec06974e-5bbb-4388-8c60-2401f7756064 req-b6e55379-2cad-457d-82c7-49c0f7552e9a service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] No waiting events found dispatching network-vif-plugged-2ad6ccc6-cb71-4105-88e4-cb48743f26ad {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:32 user nova-compute[73917]: WARNING nova.compute.manager [req-ec06974e-5bbb-4388-8c60-2401f7756064 req-b6e55379-2cad-457d-82c7-49c0f7552e9a service nova] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Received unexpected event network-vif-plugged-2ad6ccc6-cb71-4105-88e4-cb48743f26ad for instance with vm_state deleted and task_state None.
Aug 26 19:11:32 user nova-compute[73917]: DEBUG nova.compute.manager [req-27dda072-f925-4bb0-8ec5-3654e05d499b req-f114e13d-e9ae-4bc7-8b67-ac23c2389356 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-deleted-b8a4a214-2ed6-4e39-b408-e8636f7a5bc2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:32 user nova-compute[73917]: INFO nova.compute.manager [req-27dda072-f925-4bb0-8ec5-3654e05d499b req-f114e13d-e9ae-4bc7-8b67-ac23c2389356 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Neutron deleted interface b8a4a214-2ed6-4e39-b408-e8636f7a5bc2; detaching it from the instance and deleting it from the info cache
Aug 26 19:11:32 user nova-compute[73917]: DEBUG nova.network.neutron [req-27dda072-f925-4bb0-8ec5-3654e05d499b req-f114e13d-e9ae-4bc7-8b67-ac23c2389356 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Updating instance_info_cache with network_info: [{"id": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "address": "fa:16:3e:90:51:54", "network": {"id": "ac76a379-a5c0-4a2e-af46-10ba88cc1bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1001642955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ff38f9-7c", "ovs_interfaceid": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "address": "fa:16:3e:04:13:20", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b34769-8c", "ovs_interfaceid": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "address": "fa:16:3e:d4:c6:e1", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0ca7bf-b7", "ovs_interfaceid": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "46f621b9-5715-4346-8832-94ec62dbaf26", "address": "fa:16:3e:84:7e:49", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f621b9-57", "ovs_interfaceid": "46f621b9-5715-4346-8832-94ec62dbaf26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "address": "fa:16:3e:6b:a4:c0", "network": {"id": "b97befdf-464c-4341-b12d-97b8e3b350ff", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388276606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc4ead3-a5", "ovs_interfaceid": "fdc4ead3-a55c-4dcb-b62c-7cac780b2343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:32 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:32 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Took 4.15 seconds to deallocate network for instance.
Aug 26 19:11:32 user nova-compute[73917]: DEBUG nova.compute.manager [req-27dda072-f925-4bb0-8ec5-3654e05d499b req-f114e13d-e9ae-4bc7-8b67-ac23c2389356 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Detach interface failed, port_id=b8a4a214-2ed6-4e39-b408-e8636f7a5bc2, reason: Instance 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:11:32 user nova-compute[73917]: DEBUG nova.compute.manager [req-27dda072-f925-4bb0-8ec5-3654e05d499b req-f114e13d-e9ae-4bc7-8b67-ac23c2389356 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-deleted-fdc4ead3-a55c-4dcb-b62c-7cac780b2343 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:32 user nova-compute[73917]: INFO nova.compute.manager [req-27dda072-f925-4bb0-8ec5-3654e05d499b req-f114e13d-e9ae-4bc7-8b67-ac23c2389356 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Neutron deleted interface fdc4ead3-a55c-4dcb-b62c-7cac780b2343; detaching it from the instance and deleting it from the info cache
Aug 26 19:11:32 user nova-compute[73917]: DEBUG nova.network.neutron [req-27dda072-f925-4bb0-8ec5-3654e05d499b req-f114e13d-e9ae-4bc7-8b67-ac23c2389356 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Updating instance_info_cache with network_info: [{"id": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "address": "fa:16:3e:90:51:54", "network": {"id": "ac76a379-a5c0-4a2e-af46-10ba88cc1bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1001642955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ff38f9-7c", "ovs_interfaceid": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "address": "fa:16:3e:04:13:20", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b34769-8c", "ovs_interfaceid": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "address": "fa:16:3e:d4:c6:e1", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0ca7bf-b7", "ovs_interfaceid": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "46f621b9-5715-4346-8832-94ec62dbaf26", "address": "fa:16:3e:84:7e:49", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f621b9-57", "ovs_interfaceid": "46f621b9-5715-4346-8832-94ec62dbaf26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:32 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:11:32 user nova-compute[73917]: DEBUG nova.compute.manager [req-27dda072-f925-4bb0-8ec5-3654e05d499b req-f114e13d-e9ae-4bc7-8b67-ac23c2389356 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Detach interface failed, port_id=fdc4ead3-a55c-4dcb-b62c-7cac780b2343, reason: Instance 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:11:32 user nova-compute[73917]: DEBUG nova.compute.manager [req-27dda072-f925-4bb0-8ec5-3654e05d499b req-f114e13d-e9ae-4bc7-8b67-ac23c2389356 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-deleted-46f621b9-5715-4346-8832-94ec62dbaf26 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:32 user nova-compute[73917]: INFO nova.compute.manager [req-27dda072-f925-4bb0-8ec5-3654e05d499b req-f114e13d-e9ae-4bc7-8b67-ac23c2389356 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Neutron deleted interface 46f621b9-5715-4346-8832-94ec62dbaf26; detaching it from the instance and deleting it from the info cache
Aug 26 19:11:32 user nova-compute[73917]: DEBUG nova.network.neutron [req-27dda072-f925-4bb0-8ec5-3654e05d499b req-f114e13d-e9ae-4bc7-8b67-ac23c2389356 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Updating instance_info_cache with network_info: [{"id": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "address": "fa:16:3e:90:51:54", "network": {"id": "ac76a379-a5c0-4a2e-af46-10ba88cc1bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1001642955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41ff38f9-7c", "ovs_interfaceid": "41ff38f9-7c92-4705-acd5-26e82e7d472d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "address": "fa:16:3e:04:13:20", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b34769-8c", "ovs_interfaceid": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "address": "fa:16:3e:d4:c6:e1", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0ca7bf-b7", "ovs_interfaceid": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:32 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:11:32 user nova-compute[73917]: DEBUG nova.compute.manager [req-27dda072-f925-4bb0-8ec5-3654e05d499b req-f114e13d-e9ae-4bc7-8b67-ac23c2389356 service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Detach interface failed, port_id=46f621b9-5715-4346-8832-94ec62dbaf26, reason: Instance 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:11:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.463s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:32 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Deleted allocations for instance f019c6c6-e76f-4a75-8ba4-8c566d9f5791
Aug 26 19:11:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-171b3561-3753-463d-a4b1-5cde8b83e5a4 tempest-TestVolumeSwap-1550182461 tempest-TestVolumeSwap-1550182461-project-member] Lock "f019c6c6-e76f-4a75-8ba4-8c566d9f5791" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.770s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-38543202-36fd-4477-84d9-5e3ec3e0c391 req-5cfe0c14-759d-4d8b-8cd1-2b4fc1594aab service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Received event network-vif-deleted-41ff38f9-7c92-4705-acd5-26e82e7d472d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:34 user nova-compute[73917]: INFO nova.compute.manager [req-38543202-36fd-4477-84d9-5e3ec3e0c391 req-5cfe0c14-759d-4d8b-8cd1-2b4fc1594aab service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Neutron deleted interface 41ff38f9-7c92-4705-acd5-26e82e7d472d; detaching it from the instance and deleting it from the info cache
Aug 26 19:11:34 user nova-compute[73917]: DEBUG nova.network.neutron [req-38543202-36fd-4477-84d9-5e3ec3e0c391 req-5cfe0c14-759d-4d8b-8cd1-2b4fc1594aab service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Updating instance_info_cache with network_info: [{"id": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "address": "fa:16:3e:04:13:20", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b34769-8c", "ovs_interfaceid": "13b34769-8c09-4cc2-a083-6fa9aef81a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "address": "fa:16:3e:d4:c6:e1", "network": {"id": "7f61e6a6-dad2-4289-8a5c-92e45aaac030", "bridge": "br-int", "label": "tempest-device-tagging-net1-1222344595", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42c12b2a813a419ea0705659b402aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0ca7bf-b7", "ovs_interfaceid": "8b0ca7bf-b702-4c8a-9ba8-15d3d9725437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-38543202-36fd-4477-84d9-5e3ec3e0c391 req-5cfe0c14-759d-4d8b-8cd1-2b4fc1594aab service nova] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Detach interface failed, port_id=41ff38f9-7c92-4705-acd5-26e82e7d472d, reason: Instance 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:11:35 user nova-compute[73917]: INFO nova.compute.manager [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Took 2.85 seconds to detach 3 volumes for instance.
Aug 26 19:11:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:35 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:11:35 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:11:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:35 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Deleted allocations for instance 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed
Aug 26 19:11:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe949a12-b435-4929-890f-f26c89cdab88 tempest-TaggedBootDevicesTest_v242-541646257 tempest-TaggedBootDevicesTest_v242-541646257-project-member] Lock "06bdc5b6-c1cb-4006-a48f-73e762fdb7ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.442s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:41 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077086.5034482, 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:11:41 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] VM Stopped (Lifecycle Event)
Aug 26 19:11:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-df246e29-5dfd-40fc-a2b6-e37c807451d4 None None] [instance: 06bdc5b6-c1cb-4006-a48f-73e762fdb7ed] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:11:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:43 user nova-compute[73917]: INFO nova.compute.manager [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Rescuing
Aug 26 19:11:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:11:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquired lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:11:43 user nova-compute[73917]: DEBUG nova.network.neutron [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:11:44 user nova-compute[73917]: DEBUG nova.network.neutron [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Updating instance_info_cache with network_info: [{"id": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "address": "fa:16:3e:89:79:8b", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8ac63b-61", "ovs_interfaceid": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:11:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Releasing lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:11:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:44 user nova-compute[73917]: DEBUG nova.compute.manager [req-d2ec928f-7351-42ce-a008-c50506787d1b req-5fc5793c-b4d3-4f87-9362-e13b13fe1bad service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received event network-vif-unplugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d2ec928f-7351-42ce-a008-c50506787d1b req-5fc5793c-b4d3-4f87-9362-e13b13fe1bad service nova] Acquiring lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d2ec928f-7351-42ce-a008-c50506787d1b req-5fc5793c-b4d3-4f87-9362-e13b13fe1bad service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d2ec928f-7351-42ce-a008-c50506787d1b req-5fc5793c-b4d3-4f87-9362-e13b13fe1bad service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:44 user nova-compute[73917]: DEBUG nova.compute.manager [req-d2ec928f-7351-42ce-a008-c50506787d1b req-5fc5793c-b4d3-4f87-9362-e13b13fe1bad service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] No waiting events found dispatching network-vif-unplugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:44 user nova-compute[73917]: WARNING nova.compute.manager [req-d2ec928f-7351-42ce-a008-c50506787d1b req-5fc5793c-b4d3-4f87-9362-e13b13fe1bad service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received unexpected event network-vif-unplugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b for instance with vm_state active and task_state rescuing.
Aug 26 19:11:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:45 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Instance destroyed successfully.
Aug 26 19:11:45 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Attempting rescue
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73917) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Instance directory exists: not creating {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 19:11:45 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Creating image(s)
Aug 26 19:11:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "/opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "/opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.objects.instance [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'trusted_certs' on Instance uuid cc0ae046-2a39-4ab6-9327-2d9452c3035d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk.rescue {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk.rescue" returned: 0 in 0.049s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.objects.instance [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'migration_context' on Instance uuid cc0ae046-2a39-4ab6-9327-2d9452c3035d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.objects.base [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Object Instance<cc0ae046-2a39-4ab6-9327-2d9452c3035d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Start _get_guest_xml network_info=[{"id": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "address": "fa:16:3e:89:79:8b", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "vif_mac": "fa:16:3e:89:79:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8ac63b-61", "ovs_interfaceid": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.objects.instance [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'resources' on Instance uuid cc0ae046-2a39-4ab6-9327-2d9452c3035d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.objects.base [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Object Instance<cc0ae046-2a39-4ab6-9327-2d9452c3035d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.objects.instance [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'numa_topology' on Instance uuid cc0ae046-2a39-4ab6-9327-2d9452c3035d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.objects.base [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Object Instance<cc0ae046-2a39-4ab6-9327-2d9452c3035d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:11:45 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:11:45 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.objects.instance [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'vcpu_model' on Instance uuid cc0ae046-2a39-4ab6-9327-2d9452c3035d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077090.5856671, f019c6c6-e76f-4a75-8ba4-8c566d9f5791 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:11:45 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] VM Stopped (Lifecycle Event)
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.objects.base [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Object Instance<cc0ae046-2a39-4ab6-9327-2d9452c3035d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1476169522',display_name='tempest-ServerRescueNegativeTestJSON-server-1476169522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1476169522',id=2,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1298aa7a6ca478fb973d5a6d7bea7be',ramdisk_id='',reservation_id='r-0yp9qq21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475026115',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475026115-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:07:16Z,user_data=None,user_id='118080e0f2fe4533a25e002e894b99f9',uuid=cc0ae046-2a39-4ab6-9327-2d9452c3035d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "address": "fa:16:3e:89:79:8b", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "vif_mac": "fa:16:3e:89:79:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8ac63b-61", "ovs_interfaceid": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converting VIF {"id": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "address": "fa:16:3e:89:79:8b", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "vif_mac": "fa:16:3e:89:79:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8ac63b-61", "ovs_interfaceid": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:79:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8ac63b-61') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.objects.instance [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'pci_devices' on Instance uuid cc0ae046-2a39-4ab6-9327-2d9452c3035d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-70248a38-899e-4dc8-9f02-6ef56fd3167a None None] [instance: f019c6c6-e76f-4a75-8ba4-8c566d9f5791] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.objects.base [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Object Instance<cc0ae046-2a39-4ab6-9327-2d9452c3035d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:11:45 user nova-compute[73917]:   <uuid>cc0ae046-2a39-4ab6-9327-2d9452c3035d</uuid>
Aug 26 19:11:45 user nova-compute[73917]:   <name>instance-00000002</name>
Aug 26 19:11:45 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:11:45 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:11:45 user nova-compute[73917]:   <metadata>
Aug 26 19:11:45 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:11:45 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:11:45 user nova-compute[73917]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1476169522</nova:name>
Aug 26 19:11:45 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:11:45</nova:creationTime>
Aug 26 19:11:45 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:11:45 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:11:45 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:11:45 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:11:45 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:11:45 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:11:45 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:11:45 user nova-compute[73917]:       <nova:owner>
Aug 26 19:11:45 user nova-compute[73917]:         <nova:user uuid="118080e0f2fe4533a25e002e894b99f9">tempest-ServerRescueNegativeTestJSON-1475026115-project-member</nova:user>
Aug 26 19:11:45 user nova-compute[73917]:         <nova:project uuid="d1298aa7a6ca478fb973d5a6d7bea7be">tempest-ServerRescueNegativeTestJSON-1475026115</nova:project>
Aug 26 19:11:45 user nova-compute[73917]:       </nova:owner>
Aug 26 19:11:45 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:11:45 user nova-compute[73917]:       <nova:ports>
Aug 26 19:11:45 user nova-compute[73917]:         <nova:port uuid="3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b">
Aug 26 19:11:45 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 19:11:45 user nova-compute[73917]:         </nova:port>
Aug 26 19:11:45 user nova-compute[73917]:       </nova:ports>
Aug 26 19:11:45 user nova-compute[73917]:     </nova:instance>
Aug 26 19:11:45 user nova-compute[73917]:   </metadata>
Aug 26 19:11:45 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:11:45 user nova-compute[73917]:     <system>
Aug 26 19:11:45 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:11:45 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:11:45 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:11:45 user nova-compute[73917]:       <entry name="serial">cc0ae046-2a39-4ab6-9327-2d9452c3035d</entry>
Aug 26 19:11:45 user nova-compute[73917]:       <entry name="uuid">cc0ae046-2a39-4ab6-9327-2d9452c3035d</entry>
Aug 26 19:11:45 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:11:45 user nova-compute[73917]:     </system>
Aug 26 19:11:45 user nova-compute[73917]:   </sysinfo>
Aug 26 19:11:45 user nova-compute[73917]:   <os>
Aug 26 19:11:45 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:11:45 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:11:45 user nova-compute[73917]:   </os>
Aug 26 19:11:45 user nova-compute[73917]:   <features>
Aug 26 19:11:45 user nova-compute[73917]:     <acpi/>
Aug 26 19:11:45 user nova-compute[73917]:     <apic/>
Aug 26 19:11:45 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:11:45 user nova-compute[73917]:   </features>
Aug 26 19:11:45 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:11:45 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:11:45 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:11:45 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:11:45 user nova-compute[73917]:   </clock>
Aug 26 19:11:45 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:11:45 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:11:45 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:11:45 user nova-compute[73917]:   </cpu>
Aug 26 19:11:45 user nova-compute[73917]:   <devices>
Aug 26 19:11:45 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:11:45 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:11:45 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk.rescue"/>
Aug 26 19:11:45 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:11:45 user nova-compute[73917]:     </disk>
Aug 26 19:11:45 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:11:45 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:11:45 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk"/>
Aug 26 19:11:45 user nova-compute[73917]:       <target dev="vdb" bus="virtio"/>
Aug 26 19:11:45 user nova-compute[73917]:     </disk>
Aug 26 19:11:45 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:11:45 user nova-compute[73917]:       <mac address="fa:16:3e:89:79:8b"/>
Aug 26 19:11:45 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:11:45 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:11:45 user nova-compute[73917]:       <target dev="tap3e8ac63b-61"/>
Aug 26 19:11:45 user nova-compute[73917]:     </interface>
Aug 26 19:11:45 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:11:45 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/console.log" append="off"/>
Aug 26 19:11:45 user nova-compute[73917]:     </serial>
Aug 26 19:11:45 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:11:45 user nova-compute[73917]:     <video>
Aug 26 19:11:45 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:11:45 user nova-compute[73917]:     </video>
Aug 26 19:11:45 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:11:45 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:11:45 user nova-compute[73917]:     </rng>
Aug 26 19:11:45 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:11:45 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:11:45 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:11:45 user nova-compute[73917]:     </memballoon>
Aug 26 19:11:45 user nova-compute[73917]:   </devices>
Aug 26 19:11:45 user nova-compute[73917]: </domain>
Aug 26 19:11:45 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:11:45 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Instance destroyed successfully.
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:11:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] No VIF found with MAC fa:16:3e:89:79:8b, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:11:47 user nova-compute[73917]: DEBUG nova.compute.manager [req-891ea0fe-58a4-435a-9948-a7b21cebbea6 req-4cc17359-25de-45c0-b096-9c67865bdb54 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received event network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-891ea0fe-58a4-435a-9948-a7b21cebbea6 req-4cc17359-25de-45c0-b096-9c67865bdb54 service nova] Acquiring lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-891ea0fe-58a4-435a-9948-a7b21cebbea6 req-4cc17359-25de-45c0-b096-9c67865bdb54 service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-891ea0fe-58a4-435a-9948-a7b21cebbea6 req-4cc17359-25de-45c0-b096-9c67865bdb54 service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:47 user nova-compute[73917]: DEBUG nova.compute.manager [req-891ea0fe-58a4-435a-9948-a7b21cebbea6 req-4cc17359-25de-45c0-b096-9c67865bdb54 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] No waiting events found dispatching network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:47 user nova-compute[73917]: WARNING nova.compute.manager [req-891ea0fe-58a4-435a-9948-a7b21cebbea6 req-4cc17359-25de-45c0-b096-9c67865bdb54 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received unexpected event network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b for instance with vm_state active and task_state rescuing.
Aug 26 19:11:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:49 user nova-compute[73917]: DEBUG nova.compute.manager [req-50db6a34-4484-4497-9a99-a160572ddcef req-6cc70269-c963-4632-a4f9-bdb311374271 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received event network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-50db6a34-4484-4497-9a99-a160572ddcef req-6cc70269-c963-4632-a4f9-bdb311374271 service nova] Acquiring lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-50db6a34-4484-4497-9a99-a160572ddcef req-6cc70269-c963-4632-a4f9-bdb311374271 service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-50db6a34-4484-4497-9a99-a160572ddcef req-6cc70269-c963-4632-a4f9-bdb311374271 service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:49 user nova-compute[73917]: DEBUG nova.compute.manager [req-50db6a34-4484-4497-9a99-a160572ddcef req-6cc70269-c963-4632-a4f9-bdb311374271 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] No waiting events found dispatching network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:49 user nova-compute[73917]: WARNING nova.compute.manager [req-50db6a34-4484-4497-9a99-a160572ddcef req-6cc70269-c963-4632-a4f9-bdb311374271 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received unexpected event network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b for instance with vm_state active and task_state rescuing.
Aug 26 19:11:49 user nova-compute[73917]: DEBUG nova.compute.manager [req-50db6a34-4484-4497-9a99-a160572ddcef req-6cc70269-c963-4632-a4f9-bdb311374271 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received event network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:11:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-50db6a34-4484-4497-9a99-a160572ddcef req-6cc70269-c963-4632-a4f9-bdb311374271 service nova] Acquiring lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:11:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-50db6a34-4484-4497-9a99-a160572ddcef req-6cc70269-c963-4632-a4f9-bdb311374271 service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:11:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-50db6a34-4484-4497-9a99-a160572ddcef req-6cc70269-c963-4632-a4f9-bdb311374271 service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:11:49 user nova-compute[73917]: DEBUG nova.compute.manager [req-50db6a34-4484-4497-9a99-a160572ddcef req-6cc70269-c963-4632-a4f9-bdb311374271 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] No waiting events found dispatching network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:11:49 user nova-compute[73917]: WARNING nova.compute.manager [req-50db6a34-4484-4497-9a99-a160572ddcef req-6cc70269-c963-4632-a4f9-bdb311374271 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received unexpected event network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b for instance with vm_state active and task_state rescuing.
Aug 26 19:11:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Removed pending event for cc0ae046-2a39-4ab6-9327-2d9452c3035d due to event {{(pid=73917) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 19:11:49 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077109.675173, cc0ae046-2a39-4ab6-9327-2d9452c3035d => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:11:49 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] VM Resumed (Lifecycle Event)
Aug 26 19:11:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2349ab05-ad1a-4255-b91f-0704ab371e35 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:11:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:11:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:11:49 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 19:11:49 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077109.6768985, cc0ae046-2a39-4ab6-9327-2d9452c3035d => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:11:49 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] VM Started (Lifecycle Event)
Aug 26 19:11:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:11:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:11:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:11:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:02 user nova-compute[73917]: INFO nova.compute.manager [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Detaching volume 6f35b01a-5495-493f-94e8-0f452a936a67
Aug 26 19:12:02 user nova-compute[73917]: INFO nova.virt.block_device [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Attempting to driver detach volume 6f35b01a-5495-493f-94e8-0f452a936a67 from mountpoint /dev/vdb
Aug 26 19:12:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Attempting to detach device vdb from instance 5dd60c10-f99a-431d-a66f-936a7a7a1c55 from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:12:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:12:02 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:12:02 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 19:12:02 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:12:02 user nova-compute[73917]:   <serial>6f35b01a-5495-493f-94e8-0f452a936a67</serial>
Aug 26 19:12:02 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:12:02 user nova-compute[73917]: </disk>
Aug 26 19:12:02 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:12:02 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Successfully detached device vdb from instance 5dd60c10-f99a-431d-a66f-936a7a7a1c55 from the persistent domain config.
Aug 26 19:12:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5dd60c10-f99a-431d-a66f-936a7a7a1c55 from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:12:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:12:02 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:12:02 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 19:12:02 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:12:02 user nova-compute[73917]:   <serial>6f35b01a-5495-493f-94e8-0f452a936a67</serial>
Aug 26 19:12:02 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:12:02 user nova-compute[73917]: </disk>
Aug 26 19:12:02 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693077123.4009664, 5dd60c10-f99a-431d-a66f-936a7a7a1c55 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5dd60c10-f99a-431d-a66f-936a7a7a1c55 {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:12:03 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Successfully detached device vdb from instance 5dd60c10-f99a-431d-a66f-936a7a7a1c55 from the live domain config.
Aug 26 19:12:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAIFloEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:12:03 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:12:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d662970-e038-4c0f-a855-7700877c8434]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5087e1b7-775d-4959-8c88-0d17ea865d89]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:12:03 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:12:03 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:12:03 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:12:03 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:12:03 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:12:03 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:12:03 user nova-compute[73917]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 (non-flash)
Aug 26 19:12:03 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b7858eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67'): ({'sdb'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Removing single pathed devices sdb {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[79298c12-0960-414a-9e68-84e4081bed3c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.037s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb70d90-77f9-4005-814f-b202f3d9157b]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Flushing IO for device /dev/sdb {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4f9004-971e-4ceb-b2db-f942d59016c2]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fa8e31-555e-4aea-b9bd-ab0554f10323]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3ddbc2-01f8-4036-8620-b639034d4e0e]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ea7f7a-8235-4f7e-8b02-8e79971f4f8a]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67, portal: 172.16.0.220,3260]
Aug 26 19:12:03 user nova-compute[73917]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67, portal: 172.16.0.220,3260] successful.
Aug 26 19:12:03 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f35b01a-5495-493f-94e8-0f452a936a67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e32dd6e-be81-4b51-a7a6-71bf3167d9c8]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] <== disconnect_volume: return (420ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:12:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:12:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:04 user nova-compute[73917]: DEBUG nova.objects.instance [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lazy-loading 'flavor' on Instance uuid 5dd60c10-f99a-431d-a66f-936a7a7a1c55 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:12:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c002f3c2-6da5-429d-b405-93eebc76adaf tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.343s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:07 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:12:07 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:12:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:12:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:12:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:12:08 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:12:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:09 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Updating instance_info_cache with network_info: [{"id": "2738a59b-9109-4fef-8868-920d458dfaa1", "address": "fa:16:3e:e9:a2:a3", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2738a59b-91", "ovs_interfaceid": "2738a59b-9109-4fef-8868-920d458dfaa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:12:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:12:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:12:09 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:12:09 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:12:09 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:12:09 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:12:09 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:12:09 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:12:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:12:09 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:12:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:09 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:12:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:10 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:12:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:10 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:12:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk.rescue --force-share --output=json" returned: 0 in 0.260s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:12 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:12:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:14 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:12:14 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:12:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=7334MB free_disk=25.496002197265625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 5dd60c10-f99a-431d-a66f-936a7a7a1c55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance cc0ae046-2a39-4ab6-9327-2d9452c3035d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fd801f18-34b6-4682-8d43-edf82bd216c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fdfb377e-119e-41ce-b9e0-6e21053306cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 08ecabd0-f539-4068-9150-74e873809133 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c4218678-e287-4f07-8af1-59469bbcd6bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Acquiring lock "481cc682-2004-434d-b4eb-1688b0b07dd6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "481cc682-2004-434d-b4eb-1688b0b07dd6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:14 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:12:14 user nova-compute[73917]: INFO nova.compute.claims [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Claim successful on node user
Aug 26 19:12:15 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:12:15 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:12:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:15 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:12:15 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:12:15 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:12:15 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:12:15 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:12:15 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:12:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:12:15 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Creating image(s)
Aug 26 19:12:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Acquiring lock "/opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "/opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "/opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:15 user nova-compute[73917]: DEBUG nova.policy [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '811ce763d55a4aefb116079215d01fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae04a1daa9c34775b7edfbce043b47c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:12:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.199s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.204s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk 1073741824" returned: 0 in 0.054s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.173s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:16 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:12:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:16 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Cannot resize image /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:12:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:12:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Ensure instance console log exists: /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:12:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:16 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Successfully created port: d85d1b22-c0c9-4405-a446-6c6480502b54 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:12:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:18 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Successfully updated port: d85d1b22-c0c9-4405-a446-6c6480502b54 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:12:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Acquiring lock "refresh_cache-481cc682-2004-434d-b4eb-1688b0b07dd6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:12:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Acquired lock "refresh_cache-481cc682-2004-434d-b4eb-1688b0b07dd6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:12:18 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:12:18 user nova-compute[73917]: DEBUG nova.compute.manager [req-9c646f6a-1d63-43b5-93d5-26dca3883cdc req-148d2c68-142c-467d-a54f-cf13d9b31ce1 service nova] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Received event network-changed-d85d1b22-c0c9-4405-a446-6c6480502b54 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:12:18 user nova-compute[73917]: DEBUG nova.compute.manager [req-9c646f6a-1d63-43b5-93d5-26dca3883cdc req-148d2c68-142c-467d-a54f-cf13d9b31ce1 service nova] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Refreshing instance network info cache due to event network-changed-d85d1b22-c0c9-4405-a446-6c6480502b54. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:12:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9c646f6a-1d63-43b5-93d5-26dca3883cdc req-148d2c68-142c-467d-a54f-cf13d9b31ce1 service nova] Acquiring lock "refresh_cache-481cc682-2004-434d-b4eb-1688b0b07dd6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:12:18 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Updating instance_info_cache with network_info: [{"id": "d85d1b22-c0c9-4405-a446-6c6480502b54", "address": "fa:16:3e:4a:44:56", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85d1b22-c0", "ovs_interfaceid": "d85d1b22-c0c9-4405-a446-6c6480502b54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Releasing lock "refresh_cache-481cc682-2004-434d-b4eb-1688b0b07dd6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Instance network_info: |[{"id": "d85d1b22-c0c9-4405-a446-6c6480502b54", "address": "fa:16:3e:4a:44:56", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85d1b22-c0", "ovs_interfaceid": "d85d1b22-c0c9-4405-a446-6c6480502b54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9c646f6a-1d63-43b5-93d5-26dca3883cdc req-148d2c68-142c-467d-a54f-cf13d9b31ce1 service nova] Acquired lock "refresh_cache-481cc682-2004-434d-b4eb-1688b0b07dd6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.network.neutron [req-9c646f6a-1d63-43b5-93d5-26dca3883cdc req-148d2c68-142c-467d-a54f-cf13d9b31ce1 service nova] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Refreshing network info cache for port d85d1b22-c0c9-4405-a446-6c6480502b54 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Start _get_guest_xml network_info=[{"id": "d85d1b22-c0c9-4405-a446-6c6480502b54", "address": "fa:16:3e:4a:44:56", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85d1b22-c0", "ovs_interfaceid": "d85d1b22-c0c9-4405-a446-6c6480502b54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:12:19 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:12:19 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-5119324',display_name='tempest-ServersNegativeTestJSON-server-5119324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-5119324',id=17,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae04a1daa9c34775b7edfbce043b47c1',ramdisk_id='',reservation_id='r-4n6w0xta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-252207510',owner_user_name='tempest-ServersNegativeTestJSON-252207510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:12:16Z,user_data=None,user_id='811ce763d55a4aefb116079215d01fdb',uuid=481cc682-2004-434d-b4eb-1688b0b07dd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d85d1b22-c0c9-4405-a446-6c6480502b54", "address": "fa:16:3e:4a:44:56", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85d1b22-c0", "ovs_interfaceid": "d85d1b22-c0c9-4405-a446-6c6480502b54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Converting VIF {"id": "d85d1b22-c0c9-4405-a446-6c6480502b54", "address": "fa:16:3e:4a:44:56", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85d1b22-c0", "ovs_interfaceid": "d85d1b22-c0c9-4405-a446-6c6480502b54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:44:56,bridge_name='br-int',has_traffic_filtering=True,id=d85d1b22-c0c9-4405-a446-6c6480502b54,network=Network(06a65360-57e6-4419-8e18-8cfb937e1704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd85d1b22-c0') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lazy-loading 'pci_devices' on Instance uuid 481cc682-2004-434d-b4eb-1688b0b07dd6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:12:19 user nova-compute[73917]:   <uuid>481cc682-2004-434d-b4eb-1688b0b07dd6</uuid>
Aug 26 19:12:19 user nova-compute[73917]:   <name>instance-00000011</name>
Aug 26 19:12:19 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:12:19 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:12:19 user nova-compute[73917]:   <metadata>
Aug 26 19:12:19 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:12:19 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:12:19 user nova-compute[73917]:       <nova:name>tempest-ServersNegativeTestJSON-server-5119324</nova:name>
Aug 26 19:12:19 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:12:19</nova:creationTime>
Aug 26 19:12:19 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:12:19 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:12:19 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:12:19 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:12:19 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:12:19 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:12:19 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:12:19 user nova-compute[73917]:       <nova:owner>
Aug 26 19:12:19 user nova-compute[73917]:         <nova:user uuid="811ce763d55a4aefb116079215d01fdb">tempest-ServersNegativeTestJSON-252207510-project-member</nova:user>
Aug 26 19:12:19 user nova-compute[73917]:         <nova:project uuid="ae04a1daa9c34775b7edfbce043b47c1">tempest-ServersNegativeTestJSON-252207510</nova:project>
Aug 26 19:12:19 user nova-compute[73917]:       </nova:owner>
Aug 26 19:12:19 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:12:19 user nova-compute[73917]:       <nova:ports>
Aug 26 19:12:19 user nova-compute[73917]:         <nova:port uuid="d85d1b22-c0c9-4405-a446-6c6480502b54">
Aug 26 19:12:19 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 19:12:19 user nova-compute[73917]:         </nova:port>
Aug 26 19:12:19 user nova-compute[73917]:       </nova:ports>
Aug 26 19:12:19 user nova-compute[73917]:     </nova:instance>
Aug 26 19:12:19 user nova-compute[73917]:   </metadata>
Aug 26 19:12:19 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:12:19 user nova-compute[73917]:     <system>
Aug 26 19:12:19 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:12:19 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:12:19 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:12:19 user nova-compute[73917]:       <entry name="serial">481cc682-2004-434d-b4eb-1688b0b07dd6</entry>
Aug 26 19:12:19 user nova-compute[73917]:       <entry name="uuid">481cc682-2004-434d-b4eb-1688b0b07dd6</entry>
Aug 26 19:12:19 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:12:19 user nova-compute[73917]:     </system>
Aug 26 19:12:19 user nova-compute[73917]:   </sysinfo>
Aug 26 19:12:19 user nova-compute[73917]:   <os>
Aug 26 19:12:19 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:12:19 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:12:19 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:12:19 user nova-compute[73917]:   </os>
Aug 26 19:12:19 user nova-compute[73917]:   <features>
Aug 26 19:12:19 user nova-compute[73917]:     <acpi/>
Aug 26 19:12:19 user nova-compute[73917]:     <apic/>
Aug 26 19:12:19 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:12:19 user nova-compute[73917]:   </features>
Aug 26 19:12:19 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:12:19 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:12:19 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:12:19 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:12:19 user nova-compute[73917]:   </clock>
Aug 26 19:12:19 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:12:19 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:12:19 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:12:19 user nova-compute[73917]:   </cpu>
Aug 26 19:12:19 user nova-compute[73917]:   <devices>
Aug 26 19:12:19 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:12:19 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:12:19 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk"/>
Aug 26 19:12:19 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:12:19 user nova-compute[73917]:     </disk>
Aug 26 19:12:19 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:12:19 user nova-compute[73917]:       <mac address="fa:16:3e:4a:44:56"/>
Aug 26 19:12:19 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:12:19 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:12:19 user nova-compute[73917]:       <target dev="tapd85d1b22-c0"/>
Aug 26 19:12:19 user nova-compute[73917]:     </interface>
Aug 26 19:12:19 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:12:19 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/console.log" append="off"/>
Aug 26 19:12:19 user nova-compute[73917]:     </serial>
Aug 26 19:12:19 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:12:19 user nova-compute[73917]:     <video>
Aug 26 19:12:19 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:12:19 user nova-compute[73917]:     </video>
Aug 26 19:12:19 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:12:19 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:12:19 user nova-compute[73917]:     </rng>
Aug 26 19:12:19 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:12:19 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:12:19 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:12:19 user nova-compute[73917]:     </memballoon>
Aug 26 19:12:19 user nova-compute[73917]:   </devices>
Aug 26 19:12:19 user nova-compute[73917]: </domain>
Aug 26 19:12:19 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-5119324',display_name='tempest-ServersNegativeTestJSON-server-5119324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-5119324',id=17,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae04a1daa9c34775b7edfbce043b47c1',ramdisk_id='',reservation_id='r-4n6w0xta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-252207510',owner_user_name='tempest-ServersNegativeTestJSON-252207510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:12:16Z,user_data=None,user_id='811ce763d55a4aefb116079215d01fdb',uuid=481cc682-2004-434d-b4eb-1688b0b07dd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d85d1b22-c0c9-4405-a446-6c6480502b54", "address": "fa:16:3e:4a:44:56", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85d1b22-c0", "ovs_interfaceid": "d85d1b22-c0c9-4405-a446-6c6480502b54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Converting VIF {"id": "d85d1b22-c0c9-4405-a446-6c6480502b54", "address": "fa:16:3e:4a:44:56", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85d1b22-c0", "ovs_interfaceid": "d85d1b22-c0c9-4405-a446-6c6480502b54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:44:56,bridge_name='br-int',has_traffic_filtering=True,id=d85d1b22-c0c9-4405-a446-6c6480502b54,network=Network(06a65360-57e6-4419-8e18-8cfb937e1704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd85d1b22-c0') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG os_vif [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:44:56,bridge_name='br-int',has_traffic_filtering=True,id=d85d1b22-c0c9-4405-a446-6c6480502b54,network=Network(06a65360-57e6-4419-8e18-8cfb937e1704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd85d1b22-c0') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd85d1b22-c0, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd85d1b22-c0, col_values=(('external_ids', {'iface-id': 'd85d1b22-c0c9-4405-a446-6c6480502b54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:44:56', 'vm-uuid': '481cc682-2004-434d-b4eb-1688b0b07dd6'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:19 user nova-compute[73917]: INFO os_vif [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:44:56,bridge_name='br-int',has_traffic_filtering=True,id=d85d1b22-c0c9-4405-a446-6c6480502b54,network=Network(06a65360-57e6-4419-8e18-8cfb937e1704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd85d1b22-c0')
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:12:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] No VIF found with MAC fa:16:3e:4a:44:56, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:12:20 user nova-compute[73917]: DEBUG nova.network.neutron [req-9c646f6a-1d63-43b5-93d5-26dca3883cdc req-148d2c68-142c-467d-a54f-cf13d9b31ce1 service nova] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Updated VIF entry in instance network info cache for port d85d1b22-c0c9-4405-a446-6c6480502b54. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:12:20 user nova-compute[73917]: DEBUG nova.network.neutron [req-9c646f6a-1d63-43b5-93d5-26dca3883cdc req-148d2c68-142c-467d-a54f-cf13d9b31ce1 service nova] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Updating instance_info_cache with network_info: [{"id": "d85d1b22-c0c9-4405-a446-6c6480502b54", "address": "fa:16:3e:4a:44:56", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85d1b22-c0", "ovs_interfaceid": "d85d1b22-c0c9-4405-a446-6c6480502b54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:12:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9c646f6a-1d63-43b5-93d5-26dca3883cdc req-148d2c68-142c-467d-a54f-cf13d9b31ce1 service nova] Releasing lock "refresh_cache-481cc682-2004-434d-b4eb-1688b0b07dd6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:12:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:23 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077143.4537313, 481cc682-2004-434d-b4eb-1688b0b07dd6 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:12:23 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] VM Resumed (Lifecycle Event)
Aug 26 19:12:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:12:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:12:23 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Instance spawned successfully.
Aug 26 19:12:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:12:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:12:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "94f8d4e7-f310-45df-a0ae-82e608ac0119" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "94f8d4e7-f310-45df-a0ae-82e608ac0119" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:12:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:12:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:12:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:12:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:12:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:12:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:12:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:12:23 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:12:23 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077143.4583611, 481cc682-2004-434d-b4eb-1688b0b07dd6 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:12:23 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] VM Started (Lifecycle Event)
Aug 26 19:12:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:12:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:12:23 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:12:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:23 user nova-compute[73917]: INFO nova.compute.manager [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Took 8.02 seconds to spawn the instance on the hypervisor.
Aug 26 19:12:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:12:23 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:12:23 user nova-compute[73917]: INFO nova.compute.claims [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Claim successful on node user
Aug 26 19:12:23 user nova-compute[73917]: INFO nova.compute.manager [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Took 8.79 seconds to build instance.
Aug 26 19:12:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dab1624e-2f61-48f3-888e-f29221136d03 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "481cc682-2004-434d-b4eb-1688b0b07dd6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.914s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG nova.network.neutron [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:12:24 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:12:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG nova.policy [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e056c4ed5a18427a8fd1eaa6a3a795c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68229e3ed72a45fa8c2c9a33780479ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:12:24 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Creating image(s)
Aug 26 19:12:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "/opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "/opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "/opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.225s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.258s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk 1073741824" returned: 0 in 0.066s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.206s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:25 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:12:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:25 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Cannot resize image /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:12:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:12:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Ensure instance console log exists: /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:12:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:25 user nova-compute[73917]: DEBUG nova.network.neutron [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Successfully created port: ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:12:26 user nova-compute[73917]: DEBUG nova.network.neutron [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Successfully updated port: ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:12:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "refresh_cache-94f8d4e7-f310-45df-a0ae-82e608ac0119" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:12:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquired lock "refresh_cache-94f8d4e7-f310-45df-a0ae-82e608ac0119" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:12:26 user nova-compute[73917]: DEBUG nova.network.neutron [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:12:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-5af7db1b-7892-46f4-9fa9-2ea59d8d0a0e req-ccf1048c-da2e-47fd-b5e0-1544a8ab39f2 service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Received event network-changed-ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:12:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-5af7db1b-7892-46f4-9fa9-2ea59d8d0a0e req-ccf1048c-da2e-47fd-b5e0-1544a8ab39f2 service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Refreshing instance network info cache due to event network-changed-ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:12:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5af7db1b-7892-46f4-9fa9-2ea59d8d0a0e req-ccf1048c-da2e-47fd-b5e0-1544a8ab39f2 service nova] Acquiring lock "refresh_cache-94f8d4e7-f310-45df-a0ae-82e608ac0119" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:12:26 user nova-compute[73917]: DEBUG nova.network.neutron [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.network.neutron [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Updating instance_info_cache with network_info: [{"id": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "address": "fa:16:3e:45:49:40", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea31a0cf-61", "ovs_interfaceid": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Releasing lock "refresh_cache-94f8d4e7-f310-45df-a0ae-82e608ac0119" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Instance network_info: |[{"id": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "address": "fa:16:3e:45:49:40", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea31a0cf-61", "ovs_interfaceid": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5af7db1b-7892-46f4-9fa9-2ea59d8d0a0e req-ccf1048c-da2e-47fd-b5e0-1544a8ab39f2 service nova] Acquired lock "refresh_cache-94f8d4e7-f310-45df-a0ae-82e608ac0119" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.network.neutron [req-5af7db1b-7892-46f4-9fa9-2ea59d8d0a0e req-ccf1048c-da2e-47fd-b5e0-1544a8ab39f2 service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Refreshing network info cache for port ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Start _get_guest_xml network_info=[{"id": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "address": "fa:16:3e:45:49:40", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea31a0cf-61", "ovs_interfaceid": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:12:27 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:12:27 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-37194563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-37194563',id=18,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68229e3ed72a45fa8c2c9a33780479ce',ramdisk_id='',reservation_id='r-bpu4l55f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:12:24Z,user_data=None,user_id='e056c4ed5a18427a8fd1eaa6a3a795c0',uuid=94f8d4e7-f310-45df-a0ae-82e608ac0119,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "address": "fa:16:3e:45:49:40", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea31a0cf-61", "ovs_interfaceid": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converting VIF {"id": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "address": "fa:16:3e:45:49:40", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea31a0cf-61", "ovs_interfaceid": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:49:40,bridge_name='br-int',has_traffic_filtering=True,id=ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea31a0cf-61') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.objects.instance [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'pci_devices' on Instance uuid 94f8d4e7-f310-45df-a0ae-82e608ac0119 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:12:27 user nova-compute[73917]:   <uuid>94f8d4e7-f310-45df-a0ae-82e608ac0119</uuid>
Aug 26 19:12:27 user nova-compute[73917]:   <name>instance-00000012</name>
Aug 26 19:12:27 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:12:27 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:12:27 user nova-compute[73917]:   <metadata>
Aug 26 19:12:27 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:12:27 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:12:27 user nova-compute[73917]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-37194563</nova:name>
Aug 26 19:12:27 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:12:27</nova:creationTime>
Aug 26 19:12:27 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:12:27 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:12:27 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:12:27 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:12:27 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:12:27 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:12:27 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:12:27 user nova-compute[73917]:       <nova:owner>
Aug 26 19:12:27 user nova-compute[73917]:         <nova:user uuid="e056c4ed5a18427a8fd1eaa6a3a795c0">tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member</nova:user>
Aug 26 19:12:27 user nova-compute[73917]:         <nova:project uuid="68229e3ed72a45fa8c2c9a33780479ce">tempest-ServerBootFromVolumeStableRescueTest-1067875450</nova:project>
Aug 26 19:12:27 user nova-compute[73917]:       </nova:owner>
Aug 26 19:12:27 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:12:27 user nova-compute[73917]:       <nova:ports>
Aug 26 19:12:27 user nova-compute[73917]:         <nova:port uuid="ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9">
Aug 26 19:12:27 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 19:12:27 user nova-compute[73917]:         </nova:port>
Aug 26 19:12:27 user nova-compute[73917]:       </nova:ports>
Aug 26 19:12:27 user nova-compute[73917]:     </nova:instance>
Aug 26 19:12:27 user nova-compute[73917]:   </metadata>
Aug 26 19:12:27 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:12:27 user nova-compute[73917]:     <system>
Aug 26 19:12:27 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:12:27 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:12:27 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:12:27 user nova-compute[73917]:       <entry name="serial">94f8d4e7-f310-45df-a0ae-82e608ac0119</entry>
Aug 26 19:12:27 user nova-compute[73917]:       <entry name="uuid">94f8d4e7-f310-45df-a0ae-82e608ac0119</entry>
Aug 26 19:12:27 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:12:27 user nova-compute[73917]:     </system>
Aug 26 19:12:27 user nova-compute[73917]:   </sysinfo>
Aug 26 19:12:27 user nova-compute[73917]:   <os>
Aug 26 19:12:27 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:12:27 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:12:27 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:12:27 user nova-compute[73917]:   </os>
Aug 26 19:12:27 user nova-compute[73917]:   <features>
Aug 26 19:12:27 user nova-compute[73917]:     <acpi/>
Aug 26 19:12:27 user nova-compute[73917]:     <apic/>
Aug 26 19:12:27 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:12:27 user nova-compute[73917]:   </features>
Aug 26 19:12:27 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:12:27 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:12:27 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:12:27 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:12:27 user nova-compute[73917]:   </clock>
Aug 26 19:12:27 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:12:27 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:12:27 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:12:27 user nova-compute[73917]:   </cpu>
Aug 26 19:12:27 user nova-compute[73917]:   <devices>
Aug 26 19:12:27 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:12:27 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:12:27 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk"/>
Aug 26 19:12:27 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:12:27 user nova-compute[73917]:     </disk>
Aug 26 19:12:27 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:12:27 user nova-compute[73917]:       <mac address="fa:16:3e:45:49:40"/>
Aug 26 19:12:27 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:12:27 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:12:27 user nova-compute[73917]:       <target dev="tapea31a0cf-61"/>
Aug 26 19:12:27 user nova-compute[73917]:     </interface>
Aug 26 19:12:27 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:12:27 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/console.log" append="off"/>
Aug 26 19:12:27 user nova-compute[73917]:     </serial>
Aug 26 19:12:27 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:12:27 user nova-compute[73917]:     <video>
Aug 26 19:12:27 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:12:27 user nova-compute[73917]:     </video>
Aug 26 19:12:27 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:12:27 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:12:27 user nova-compute[73917]:     </rng>
Aug 26 19:12:27 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:12:27 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:12:27 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:12:27 user nova-compute[73917]:     </memballoon>
Aug 26 19:12:27 user nova-compute[73917]:   </devices>
Aug 26 19:12:27 user nova-compute[73917]: </domain>
Aug 26 19:12:27 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-37194563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-37194563',id=18,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68229e3ed72a45fa8c2c9a33780479ce',ramdisk_id='',reservation_id='r-bpu4l55f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:12:24Z,user_data=None,user_id='e056c4ed5a18427a8fd1eaa6a3a795c0',uuid=94f8d4e7-f310-45df-a0ae-82e608ac0119,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "address": "fa:16:3e:45:49:40", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea31a0cf-61", "ovs_interfaceid": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converting VIF {"id": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "address": "fa:16:3e:45:49:40", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea31a0cf-61", "ovs_interfaceid": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:49:40,bridge_name='br-int',has_traffic_filtering=True,id=ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea31a0cf-61') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG os_vif [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:49:40,bridge_name='br-int',has_traffic_filtering=True,id=ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea31a0cf-61') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea31a0cf-61, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapea31a0cf-61, col_values=(('external_ids', {'iface-id': 'ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:49:40', 'vm-uuid': '94f8d4e7-f310-45df-a0ae-82e608ac0119'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:27 user nova-compute[73917]: INFO os_vif [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:49:40,bridge_name='br-int',has_traffic_filtering=True,id=ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea31a0cf-61')
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] No VIF found with MAC fa:16:3e:45:49:40, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:12:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:28 user nova-compute[73917]: DEBUG nova.network.neutron [req-5af7db1b-7892-46f4-9fa9-2ea59d8d0a0e req-ccf1048c-da2e-47fd-b5e0-1544a8ab39f2 service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Updated VIF entry in instance network info cache for port ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:12:28 user nova-compute[73917]: DEBUG nova.network.neutron [req-5af7db1b-7892-46f4-9fa9-2ea59d8d0a0e req-ccf1048c-da2e-47fd-b5e0-1544a8ab39f2 service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Updating instance_info_cache with network_info: [{"id": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "address": "fa:16:3e:45:49:40", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea31a0cf-61", "ovs_interfaceid": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:12:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5af7db1b-7892-46f4-9fa9-2ea59d8d0a0e req-ccf1048c-da2e-47fd-b5e0-1544a8ab39f2 service nova] Releasing lock "refresh_cache-94f8d4e7-f310-45df-a0ae-82e608ac0119" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:12:28 user nova-compute[73917]: DEBUG nova.compute.manager [req-b2a3d42f-ce17-4a09-a076-82d7eb902844 req-ace0c5c7-7265-43a0-b9d0-2e842db062d7 service nova] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Received event network-vif-plugged-d85d1b22-c0c9-4405-a446-6c6480502b54 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:12:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b2a3d42f-ce17-4a09-a076-82d7eb902844 req-ace0c5c7-7265-43a0-b9d0-2e842db062d7 service nova] Acquiring lock "481cc682-2004-434d-b4eb-1688b0b07dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b2a3d42f-ce17-4a09-a076-82d7eb902844 req-ace0c5c7-7265-43a0-b9d0-2e842db062d7 service nova] Lock "481cc682-2004-434d-b4eb-1688b0b07dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b2a3d42f-ce17-4a09-a076-82d7eb902844 req-ace0c5c7-7265-43a0-b9d0-2e842db062d7 service nova] Lock "481cc682-2004-434d-b4eb-1688b0b07dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:28 user nova-compute[73917]: DEBUG nova.compute.manager [req-b2a3d42f-ce17-4a09-a076-82d7eb902844 req-ace0c5c7-7265-43a0-b9d0-2e842db062d7 service nova] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] No waiting events found dispatching network-vif-plugged-d85d1b22-c0c9-4405-a446-6c6480502b54 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:12:28 user nova-compute[73917]: WARNING nova.compute.manager [req-b2a3d42f-ce17-4a09-a076-82d7eb902844 req-ace0c5c7-7265-43a0-b9d0-2e842db062d7 service nova] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Received unexpected event network-vif-plugged-d85d1b22-c0c9-4405-a446-6c6480502b54 for instance with vm_state active and task_state None.
Aug 26 19:12:28 user nova-compute[73917]: DEBUG nova.compute.manager [req-b2a3d42f-ce17-4a09-a076-82d7eb902844 req-ace0c5c7-7265-43a0-b9d0-2e842db062d7 service nova] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Received event network-vif-plugged-d85d1b22-c0c9-4405-a446-6c6480502b54 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:12:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b2a3d42f-ce17-4a09-a076-82d7eb902844 req-ace0c5c7-7265-43a0-b9d0-2e842db062d7 service nova] Acquiring lock "481cc682-2004-434d-b4eb-1688b0b07dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b2a3d42f-ce17-4a09-a076-82d7eb902844 req-ace0c5c7-7265-43a0-b9d0-2e842db062d7 service nova] Lock "481cc682-2004-434d-b4eb-1688b0b07dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b2a3d42f-ce17-4a09-a076-82d7eb902844 req-ace0c5c7-7265-43a0-b9d0-2e842db062d7 service nova] Lock "481cc682-2004-434d-b4eb-1688b0b07dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:28 user nova-compute[73917]: DEBUG nova.compute.manager [req-b2a3d42f-ce17-4a09-a076-82d7eb902844 req-ace0c5c7-7265-43a0-b9d0-2e842db062d7 service nova] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] No waiting events found dispatching network-vif-plugged-d85d1b22-c0c9-4405-a446-6c6480502b54 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:12:28 user nova-compute[73917]: WARNING nova.compute.manager [req-b2a3d42f-ce17-4a09-a076-82d7eb902844 req-ace0c5c7-7265-43a0-b9d0-2e842db062d7 service nova] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Received unexpected event network-vif-plugged-d85d1b22-c0c9-4405-a446-6c6480502b54 for instance with vm_state active and task_state None.
Aug 26 19:12:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-2d4280c4-fdfa-405d-99d3-95856dcb0fd1 req-fb9e4e21-6bdb-4b55-96dc-6cfd25bdf421 service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Received event network-vif-plugged-ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:12:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2d4280c4-fdfa-405d-99d3-95856dcb0fd1 req-fb9e4e21-6bdb-4b55-96dc-6cfd25bdf421 service nova] Acquiring lock "94f8d4e7-f310-45df-a0ae-82e608ac0119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2d4280c4-fdfa-405d-99d3-95856dcb0fd1 req-fb9e4e21-6bdb-4b55-96dc-6cfd25bdf421 service nova] Lock "94f8d4e7-f310-45df-a0ae-82e608ac0119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2d4280c4-fdfa-405d-99d3-95856dcb0fd1 req-fb9e4e21-6bdb-4b55-96dc-6cfd25bdf421 service nova] Lock "94f8d4e7-f310-45df-a0ae-82e608ac0119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-2d4280c4-fdfa-405d-99d3-95856dcb0fd1 req-fb9e4e21-6bdb-4b55-96dc-6cfd25bdf421 service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] No waiting events found dispatching network-vif-plugged-ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:12:29 user nova-compute[73917]: WARNING nova.compute.manager [req-2d4280c4-fdfa-405d-99d3-95856dcb0fd1 req-fb9e4e21-6bdb-4b55-96dc-6cfd25bdf421 service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Received unexpected event network-vif-plugged-ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9 for instance with vm_state building and task_state spawning.
Aug 26 19:12:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:31 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077151.3450005, 94f8d4e7-f310-45df-a0ae-82e608ac0119 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:12:31 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] VM Resumed (Lifecycle Event)
Aug 26 19:12:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-6fb9511e-84b0-41a3-b616-c3f227e900eb req-03be50df-0196-4ac7-8c22-f576afabeafa service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Received event network-vif-plugged-ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:12:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6fb9511e-84b0-41a3-b616-c3f227e900eb req-03be50df-0196-4ac7-8c22-f576afabeafa service nova] Acquiring lock "94f8d4e7-f310-45df-a0ae-82e608ac0119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6fb9511e-84b0-41a3-b616-c3f227e900eb req-03be50df-0196-4ac7-8c22-f576afabeafa service nova] Lock "94f8d4e7-f310-45df-a0ae-82e608ac0119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6fb9511e-84b0-41a3-b616-c3f227e900eb req-03be50df-0196-4ac7-8c22-f576afabeafa service nova] Lock "94f8d4e7-f310-45df-a0ae-82e608ac0119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-6fb9511e-84b0-41a3-b616-c3f227e900eb req-03be50df-0196-4ac7-8c22-f576afabeafa service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] No waiting events found dispatching network-vif-plugged-ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:12:31 user nova-compute[73917]: WARNING nova.compute.manager [req-6fb9511e-84b0-41a3-b616-c3f227e900eb req-03be50df-0196-4ac7-8c22-f576afabeafa service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Received unexpected event network-vif-plugged-ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9 for instance with vm_state building and task_state spawning.
Aug 26 19:12:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:12:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:12:31 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Instance spawned successfully.
Aug 26 19:12:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:12:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:12:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:12:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:12:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:12:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:12:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:12:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:12:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:12:31 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:12:31 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077151.3503792, 94f8d4e7-f310-45df-a0ae-82e608ac0119 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:12:31 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] VM Started (Lifecycle Event)
Aug 26 19:12:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:12:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:12:31 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:12:31 user nova-compute[73917]: INFO nova.compute.manager [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Took 7.08 seconds to spawn the instance on the hypervisor.
Aug 26 19:12:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:12:31 user nova-compute[73917]: INFO nova.compute.manager [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Took 8.05 seconds to build instance.
Aug 26 19:12:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bf3bd77f-f627-4d17-a45a-d2016dec1d1f tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "94f8d4e7-f310-45df-a0ae-82e608ac0119" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.159s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-a13c5ac4-38bd-4661-b799-b294093ad805 req-c280f2eb-235c-4bf3-a4b9-31e2a5be260f service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Received event network-changed-895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:12:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-a13c5ac4-38bd-4661-b799-b294093ad805 req-c280f2eb-235c-4bf3-a4b9-31e2a5be260f service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Refreshing instance network info cache due to event network-changed-895c0971-95b8-490f-95b5-386c50ba29c8. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:12:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a13c5ac4-38bd-4661-b799-b294093ad805 req-c280f2eb-235c-4bf3-a4b9-31e2a5be260f service nova] Acquiring lock "refresh_cache-08ecabd0-f539-4068-9150-74e873809133" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:12:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a13c5ac4-38bd-4661-b799-b294093ad805 req-c280f2eb-235c-4bf3-a4b9-31e2a5be260f service nova] Acquired lock "refresh_cache-08ecabd0-f539-4068-9150-74e873809133" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:12:33 user nova-compute[73917]: DEBUG nova.network.neutron [req-a13c5ac4-38bd-4661-b799-b294093ad805 req-c280f2eb-235c-4bf3-a4b9-31e2a5be260f service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Refreshing network info cache for port 895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:12:33 user nova-compute[73917]: DEBUG nova.network.neutron [req-a13c5ac4-38bd-4661-b799-b294093ad805 req-c280f2eb-235c-4bf3-a4b9-31e2a5be260f service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Updated VIF entry in instance network info cache for port 895c0971-95b8-490f-95b5-386c50ba29c8. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:12:33 user nova-compute[73917]: DEBUG nova.network.neutron [req-a13c5ac4-38bd-4661-b799-b294093ad805 req-c280f2eb-235c-4bf3-a4b9-31e2a5be260f service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Updating instance_info_cache with network_info: [{"id": "895c0971-95b8-490f-95b5-386c50ba29c8", "address": "fa:16:3e:b0:8c:eb", "network": {"id": "ad75441f-c776-426b-8ada-8fc89037e592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-909384262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820b033209b644249a7b064b4ca6c23f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895c0971-95", "ovs_interfaceid": "895c0971-95b8-490f-95b5-386c50ba29c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:12:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a13c5ac4-38bd-4661-b799-b294093ad805 req-c280f2eb-235c-4bf3-a4b9-31e2a5be260f service nova] Releasing lock "refresh_cache-08ecabd0-f539-4068-9150-74e873809133" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:12:34 user nova-compute[73917]: INFO nova.compute.manager [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Rebuilding instance
Aug 26 19:12:34 user nova-compute[73917]: DEBUG nova.compute.manager [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-c851ee65-51b8-4571-9c8a-d98285b1b514 req-0b7e540a-f757-4d84-b7ab-0af5888f0674 service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Received event network-vif-unplugged-895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c851ee65-51b8-4571-9c8a-d98285b1b514 req-0b7e540a-f757-4d84-b7ab-0af5888f0674 service nova] Acquiring lock "08ecabd0-f539-4068-9150-74e873809133-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c851ee65-51b8-4571-9c8a-d98285b1b514 req-0b7e540a-f757-4d84-b7ab-0af5888f0674 service nova] Lock "08ecabd0-f539-4068-9150-74e873809133-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c851ee65-51b8-4571-9c8a-d98285b1b514 req-0b7e540a-f757-4d84-b7ab-0af5888f0674 service nova] Lock "08ecabd0-f539-4068-9150-74e873809133-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-c851ee65-51b8-4571-9c8a-d98285b1b514 req-0b7e540a-f757-4d84-b7ab-0af5888f0674 service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] No waiting events found dispatching network-vif-unplugged-895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:12:35 user nova-compute[73917]: WARNING nova.compute.manager [req-c851ee65-51b8-4571-9c8a-d98285b1b514 req-0b7e540a-f757-4d84-b7ab-0af5888f0674 service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Received unexpected event network-vif-unplugged-895c0971-95b8-490f-95b5-386c50ba29c8 for instance with vm_state active and task_state rebuilding.
Aug 26 19:12:35 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 08ecabd0-f539-4068-9150-74e873809133] Instance destroyed successfully.
Aug 26 19:12:35 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 08ecabd0-f539-4068-9150-74e873809133] Instance destroyed successfully.
Aug 26 19:12:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-372476347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-847741481',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILuuKhhd8SBkV1rvvqP3lRG/pwSBnr43r+z6CsGpn0WvVX9OQC0V+eSZCDA4YsPtHza5LR1n8VcvXIU4KZevCoPCULj3dhrVlzQmOhcxjRhz3Cu3v86zWvhmqTkFn+daA==',key_name='tempest-keypair-1708956738',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:11:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='820b033209b644249a7b064b4ca6c23f',ramdisk_id='',reservation_id='r-0arw7nc1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1172188124',owner_user_name='tempest-ServerActionsV293TestJSON-1172188124-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:12:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ddca966a7694d04b252599a47f4078e',uuid=08ecabd0-f539-4068-9150-74e873809133,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "895c0971-95b8-490f-95b5-386c50ba29c8", "address": "fa:16:3e:b0:8c:eb", "network": {"id": "ad75441f-c776-426b-8ada-8fc89037e592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-909384262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820b033209b644249a7b064b4ca6c23f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895c0971-95", "ovs_interfaceid": "895c0971-95b8-490f-95b5-386c50ba29c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Converting VIF {"id": "895c0971-95b8-490f-95b5-386c50ba29c8", "address": "fa:16:3e:b0:8c:eb", "network": {"id": "ad75441f-c776-426b-8ada-8fc89037e592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-909384262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820b033209b644249a7b064b4ca6c23f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895c0971-95", "ovs_interfaceid": "895c0971-95b8-490f-95b5-386c50ba29c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=895c0971-95b8-490f-95b5-386c50ba29c8,network=Network(ad75441f-c776-426b-8ada-8fc89037e592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895c0971-95') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG os_vif [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=895c0971-95b8-490f-95b5-386c50ba29c8,network=Network(ad75441f-c776-426b-8ada-8fc89037e592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895c0971-95') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap895c0971-95, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:35 user nova-compute[73917]: INFO os_vif [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=895c0971-95b8-490f-95b5-386c50ba29c8,network=Network(ad75441f-c776-426b-8ada-8fc89037e592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895c0971-95')
Aug 26 19:12:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGkZoHXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:12:35 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 19:12:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[084f9314-8274-470f-bedf-c128535844ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d876278-5bf3-403f-83fa-2a7781613a6f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:12:35 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:12:35 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:12:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:12:35 user nova-compute[73917]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:12:35 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:12:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b98361630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481'): ({'sdj'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Removing single pathed devices sdj {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d319824f-82d5-4092-b95f-088c8ba248b2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc87d19c-138e-4335-b0a7-32e1e1fc7278]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Flushing IO for device /dev/sdj {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5d05e7-24a5-44ae-9176-ce641ebb6988]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.056s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b732824-0274-4d90-9738-c4d1c639f773]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] SCSI volumes sdj have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23133373834306630', '/dev/disk/by-id/scsi-1SCST_BIOe90f97a6-137840f0a8525ccd', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e90f97a6') {{(pid=85467) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[299f311c-3dc7-421d-9d42-6c4799ee292f]: (4, None) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbcaeca-a12d-49c8-bbbd-99da0a8ac59b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfa2102-be9f-4ba3-9b52-2d52a08645c7]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481, portal: 172.16.0.220,3260]
Aug 26 19:12:36 user nova-compute[73917]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481, portal: 172.16.0.220,3260] successful.
Aug 26 19:12:36 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5a4662-ace0-45c5-8cb5-3d22d4a69c81]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] <== disconnect_volume: return (370ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:12:36 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Deleting instance files /opt/stack/data/nova/instances/08ecabd0-f539-4068-9150-74e873809133_del
Aug 26 19:12:36 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Deletion of /opt/stack/data/nova/instances/08ecabd0-f539-4068-9150-74e873809133_del complete
Aug 26 19:12:36 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 08ecabd0-f539-4068-9150-74e873809133 could not be found.
Aug 26 19:12:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGkZoHXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:12:36 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5fc70d-07b1-40d4-b6c0-916da0bf719b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a39f29-9959-40b4-b3dd-e703c2f0a426]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:12:36 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:12:36 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:12:36 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:12:36 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b786af9a0>, {}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Disconnecting from: [] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.064s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] <== disconnect_volume: return (65ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:12:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:12:37 user nova-compute[73917]: DEBUG nova.compute.manager [req-04cf87a4-c829-4bed-949b-e5be90be42be req-38d48111-d7b1-4854-8218-caca77cd0434 service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Received event network-vif-plugged-895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:12:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-04cf87a4-c829-4bed-949b-e5be90be42be req-38d48111-d7b1-4854-8218-caca77cd0434 service nova] Acquiring lock "08ecabd0-f539-4068-9150-74e873809133-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-04cf87a4-c829-4bed-949b-e5be90be42be req-38d48111-d7b1-4854-8218-caca77cd0434 service nova] Lock "08ecabd0-f539-4068-9150-74e873809133-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-04cf87a4-c829-4bed-949b-e5be90be42be req-38d48111-d7b1-4854-8218-caca77cd0434 service nova] Lock "08ecabd0-f539-4068-9150-74e873809133-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:37 user nova-compute[73917]: DEBUG nova.compute.manager [req-04cf87a4-c829-4bed-949b-e5be90be42be req-38d48111-d7b1-4854-8218-caca77cd0434 service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] No waiting events found dispatching network-vif-plugged-895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:12:37 user nova-compute[73917]: WARNING nova.compute.manager [req-04cf87a4-c829-4bed-949b-e5be90be42be req-38d48111-d7b1-4854-8218-caca77cd0434 service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Received unexpected event network-vif-plugged-895c0971-95b8-490f-95b5-386c50ba29c8 for instance with vm_state active and task_state rebuilding.
Aug 26 19:12:37 user nova-compute[73917]: DEBUG nova.compute.manager [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Preparing to wait for external event volume-reimaged-b057f77a-308f-4ef1-ac20-bd064c4ca481 {{(pid=73917) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 26 19:12:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Acquiring lock "08ecabd0-f539-4068-9150-74e873809133-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "08ecabd0-f539-4068-9150-74e873809133-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "08ecabd0-f539-4068-9150-74e873809133-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:43 user nova-compute[73917]: DEBUG nova.compute.manager [req-de34a37f-6613-4737-b789-526f0a190514 req-94405580-0384-4ca3-b72e-c214dc8b8319 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Received event network-changed-faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:12:43 user nova-compute[73917]: DEBUG nova.compute.manager [req-de34a37f-6613-4737-b789-526f0a190514 req-94405580-0384-4ca3-b72e-c214dc8b8319 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Refreshing instance network info cache due to event network-changed-faf9dd57-b9f3-4eec-af4d-b95205ffea78. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:12:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-de34a37f-6613-4737-b789-526f0a190514 req-94405580-0384-4ca3-b72e-c214dc8b8319 service nova] Acquiring lock "refresh_cache-c4218678-e287-4f07-8af1-59469bbcd6bd" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:12:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-de34a37f-6613-4737-b789-526f0a190514 req-94405580-0384-4ca3-b72e-c214dc8b8319 service nova] Acquired lock "refresh_cache-c4218678-e287-4f07-8af1-59469bbcd6bd" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:12:43 user nova-compute[73917]: DEBUG nova.network.neutron [req-de34a37f-6613-4737-b789-526f0a190514 req-94405580-0384-4ca3-b72e-c214dc8b8319 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Refreshing network info cache for port faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "c4218678-e287-4f07-8af1-59469bbcd6bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG nova.objects.instance [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lazy-loading 'flavor' on Instance uuid c4218678-e287-4f07-8af1-59469bbcd6bd {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "c4218678-e287-4f07-8af1-59469bbcd6bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:44 user nova-compute[73917]: INFO nova.compute.manager [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Attaching volume 0c50da8f-60da-4a1a-8ba9-b0202b97349a to /dev/vdb
Aug 26 19:12:44 user nova-compute[73917]: DEBUG os_brick.utils [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8e12a9-1b97-4089-be90-e4f44c3c73a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae5e2f1-5185-46a4-8c34-d4dee350c579]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c61aeac-b614-4893-b8e3-12150e62c1dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4c6edf-9783-4e40-b9f4-335501f792c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:12:44 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde7fdfa-c83f-4f13-87c8-3b036b9220a9]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG os_brick.utils [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Updating existing volume attachment record: 3f3a5590-8045-4929-b387-43d7be0e4fd9 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG nova.network.neutron [req-de34a37f-6613-4737-b789-526f0a190514 req-94405580-0384-4ca3-b72e-c214dc8b8319 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Updated VIF entry in instance network info cache for port faf9dd57-b9f3-4eec-af4d-b95205ffea78. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG nova.network.neutron [req-de34a37f-6613-4737-b789-526f0a190514 req-94405580-0384-4ca3-b72e-c214dc8b8319 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Updating instance_info_cache with network_info: [{"id": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "address": "fa:16:3e:ee:57:64", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf9dd57-b9", "ovs_interfaceid": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:12:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-de34a37f-6613-4737-b789-526f0a190514 req-94405580-0384-4ca3-b72e-c214dc8b8319 service nova] Releasing lock "refresh_cache-c4218678-e287-4f07-8af1-59469bbcd6bd" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:12:45 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:12:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 19:12:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] There are 0 instances to clean {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 19:12:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:50 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077155.8246858, 08ecabd0-f539-4068-9150-74e873809133 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:12:50 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 08ecabd0-f539-4068-9150-74e873809133] VM Stopped (Lifecycle Event)
Aug 26 19:12:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-75cbf8fc-fb73-4e90-bdba-2d87229ffad8 None None] [instance: 08ecabd0-f539-4068-9150-74e873809133] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:12:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:51 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:12:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:52 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:12:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:12:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:12:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:12:52 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:12:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:52 user nova-compute[73917]: INFO nova.compute.manager [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Terminating instance
Aug 26 19:12:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:12:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Updating instance_info_cache with network_info: [{"id": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "address": "fa:16:3e:c9:58:2d", "network": {"id": "4fb39591-1339-423b-a17d-cec979856e60", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09772507cd24e329e84aa3b9a3b9b7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245e99f5-fb", "ovs_interfaceid": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73917) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-de9b102f-f2c3-4fd5-ad1d-83a747539d7b req-b7ad1495-a85d-4bd7-b33a-6cc89ef0ec24 service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Received event network-vif-unplugged-70707344-848e-4e9b-baf4-6cfbb4737fb8 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-de9b102f-f2c3-4fd5-ad1d-83a747539d7b req-b7ad1495-a85d-4bd7-b33a-6cc89ef0ec24 service nova] Acquiring lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-de9b102f-f2c3-4fd5-ad1d-83a747539d7b req-b7ad1495-a85d-4bd7-b33a-6cc89ef0ec24 service nova] Lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-de9b102f-f2c3-4fd5-ad1d-83a747539d7b req-b7ad1495-a85d-4bd7-b33a-6cc89ef0ec24 service nova] Lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-de9b102f-f2c3-4fd5-ad1d-83a747539d7b req-b7ad1495-a85d-4bd7-b33a-6cc89ef0ec24 service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] No waiting events found dispatching network-vif-unplugged-70707344-848e-4e9b-baf4-6cfbb4737fb8 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-de9b102f-f2c3-4fd5-ad1d-83a747539d7b req-b7ad1495-a85d-4bd7-b33a-6cc89ef0ec24 service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Received event network-vif-unplugged-70707344-848e-4e9b-baf4-6cfbb4737fb8 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:12:53 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Instance destroyed successfully.
Aug 26 19:12:53 user nova-compute[73917]: DEBUG nova.objects.instance [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lazy-loading 'resources' on Instance uuid 5dd60c10-f99a-431d-a66f-936a7a7a1c55 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:06:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-168280068',display_name='tempest-AttachVolumeNegativeTest-server-168280068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-168280068',id=1,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLldEmRypfHCkMn/QByyzkXbQJjQQCN4Jn8O6nEo/hOA4e4QYD4ZW7YoCj6G7Pa00QzIruSmgojv4vz/cwFeUpf9waYiM5jIrjW8XKEMUvzzsMPEKyH8kJ9XzZDnGAZ5NA==',key_name='tempest-keypair-1977464775',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b291bbf9aedc4414a1ab402602849140',ramdisk_id='',reservation_id='r-bf4li2da',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2066333616',owner_user_name='tempest-AttachVolumeNegativeTest-2066333616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:07:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c64a5d226b8b4d60af840d49315bf60f',uuid=5dd60c10-f99a-431d-a66f-936a7a7a1c55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "address": "fa:16:3e:5a:c1:dd", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70707344-84", "ovs_interfaceid": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converting VIF {"id": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "address": "fa:16:3e:5a:c1:dd", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70707344-84", "ovs_interfaceid": "70707344-848e-4e9b-baf4-6cfbb4737fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:c1:dd,bridge_name='br-int',has_traffic_filtering=True,id=70707344-848e-4e9b-baf4-6cfbb4737fb8,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70707344-84') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG os_vif [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:c1:dd,bridge_name='br-int',has_traffic_filtering=True,id=70707344-848e-4e9b-baf4-6cfbb4737fb8,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70707344-84') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70707344-84, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:53 user nova-compute[73917]: INFO os_vif [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:c1:dd,bridge_name='br-int',has_traffic_filtering=True,id=70707344-848e-4e9b-baf4-6cfbb4737fb8,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70707344-84')
Aug 26 19:12:53 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Deleting instance files /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55_del
Aug 26 19:12:53 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Deletion of /opt/stack/data/nova/instances/5dd60c10-f99a-431d-a66f-936a7a7a1c55_del complete
Aug 26 19:12:53 user nova-compute[73917]: INFO nova.compute.manager [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 26 19:12:53 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:12:53 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:12:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:54 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:12:54 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:12:54 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:12:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:54 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:12:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:12:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:55 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:12:55 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Took 1.46 seconds to deallocate network for instance.
Aug 26 19:12:55 user nova-compute[73917]: DEBUG nova.compute.manager [req-11531f7e-2c4e-4779-9223-3d459f30f716 req-cae4927a-db26-48ee-8e3b-dc0a2e97dcc9 service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Received event network-vif-deleted-70707344-848e-4e9b-baf4-6cfbb4737fb8 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:12:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:12:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:55 user nova-compute[73917]: DEBUG nova.compute.manager [req-6d866cb9-89f5-485a-86c2-e70f6ca99c2e req-7a15b045-46f1-44d2-8165-4476a010c8a3 service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Received event network-vif-plugged-70707344-848e-4e9b-baf4-6cfbb4737fb8 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:12:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d866cb9-89f5-485a-86c2-e70f6ca99c2e req-7a15b045-46f1-44d2-8165-4476a010c8a3 service nova] Acquiring lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:12:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d866cb9-89f5-485a-86c2-e70f6ca99c2e req-7a15b045-46f1-44d2-8165-4476a010c8a3 service nova] Lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:12:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d866cb9-89f5-485a-86c2-e70f6ca99c2e req-7a15b045-46f1-44d2-8165-4476a010c8a3 service nova] Lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:55 user nova-compute[73917]: DEBUG nova.compute.manager [req-6d866cb9-89f5-485a-86c2-e70f6ca99c2e req-7a15b045-46f1-44d2-8165-4476a010c8a3 service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] No waiting events found dispatching network-vif-plugged-70707344-848e-4e9b-baf4-6cfbb4737fb8 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:12:55 user nova-compute[73917]: WARNING nova.compute.manager [req-6d866cb9-89f5-485a-86c2-e70f6ca99c2e req-7a15b045-46f1-44d2-8165-4476a010c8a3 service nova] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Received unexpected event network-vif-plugged-70707344-848e-4e9b-baf4-6cfbb4737fb8 for instance with vm_state deleted and task_state None.
Aug 26 19:12:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:56 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:12:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:56 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:12:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.811s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:56 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Deleted allocations for instance 5dd60c10-f99a-431d-a66f-936a7a7a1c55
Aug 26 19:12:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8e190626-dbe0-48dc-97eb-32e7cbd913f9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "5dd60c10-f99a-431d-a66f-936a7a7a1c55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.625s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:12:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeLCvVUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:12:58 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:12:58 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:12:58 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[595ce017-88c6-4519-82fb-cc9a26a0d356]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:12:58 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e9967f-7cbc-48fc-a3fa-803ff7d96d30]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a] added
Aug 26 19:12:58 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7125a60b-9367-463e-b12c-22befddd78c8]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[076fd1d5-e5f0-4b64-b091-44591eee3614]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HeLCvVUj {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HeLCvVUj" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3efa69b-ba70-4ec4-a295-9fe67ba44225]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HeLCvVUj'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ed564e-ea76-4629-b04d-8b20c13d6cae]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74b60aa-f802-4c49-ab2c-ef3e52039b9d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:12:58 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:12:58 user nova-compute[73917]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:12:58 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:12:58 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:12:58 user nova-compute[73917]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:12:58 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8290b7d-6b39-46ee-964c-acbfafba279a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a, portal: 172.16.0.220,3260]
Aug 26 19:12:58 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a, portal: 172.16.0.220,3260] successful.
Aug 26 19:12:58 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc76e98f-5ba1-487d-bcd8-8ce9f45e31f0]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dcc03f-5072-48b8-956c-3d57a49bbc51]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:12:58 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:12:58 user nova-compute[73917]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:12:58 user nova-compute[73917]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)
Aug 26 19:12:58 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:12:58 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:12:58 user nova-compute[73917]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:12:58 user nova-compute[73917]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)
Aug 26 19:12:58 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.034s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[988a895a-7ec8-4a8e-b38f-c6e282ef5468]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeLCvVUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:12:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:12:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:12:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.951s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] <== connect_volume: return (1955ms) {'type': 'block', 'scsi_wwn': '26661316666653631', 'path': '/dev/sdc'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661316666653631', 'path': '/dev/sdc'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:13:00 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:13:00 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=7285MB free_disk=25.4346923828125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.008s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.objects.instance [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lazy-loading 'flavor' on Instance uuid c4218678-e287-4f07-8af1-59469bbcd6bd {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:13:00 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:13:00 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:13:00 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:13:00 user nova-compute[73917]:   <serial>0c50da8f-60da-4a1a-8ba9-b0202b97349a</serial>
Aug 26 19:13:00 user nova-compute[73917]: </disk>
Aug 26 19:13:00 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance cc0ae046-2a39-4ab6-9327-2d9452c3035d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fd801f18-34b6-4682-8d43-edf82bd216c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fdfb377e-119e-41ce-b9e0-6e21053306cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 08ecabd0-f539-4068-9150-74e873809133 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c4218678-e287-4f07-8af1-59469bbcd6bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 481cc682-2004-434d-b4eb-1688b0b07dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 94f8d4e7-f310-45df-a0ae-82e608ac0119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing inventories for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating ProviderTree inventory for provider d90ad23a-e063-4f0d-8341-c34e0141d16a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating inventory in ProviderTree for provider d90ad23a-e063-4f0d-8341-c34e0141d16a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing aggregate associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, aggregates: None {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing trait associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:13:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] No VIF found with MAC fa:16:3e:ee:57:64, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG nova.compute.manager [req-42dd03ee-6641-446c-aa69-7ddd3151e8cb req-ceaf5591-335f-420e-8913-a5216ee22aac service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Received event volume-reimaged-b057f77a-308f-4ef1-ac20-bd064c4ca481 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-42dd03ee-6641-446c-aa69-7ddd3151e8cb req-ceaf5591-335f-420e-8913-a5216ee22aac service nova] Acquiring lock "08ecabd0-f539-4068-9150-74e873809133-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-42dd03ee-6641-446c-aa69-7ddd3151e8cb req-ceaf5591-335f-420e-8913-a5216ee22aac service nova] Lock "08ecabd0-f539-4068-9150-74e873809133-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-42dd03ee-6641-446c-aa69-7ddd3151e8cb req-ceaf5591-335f-420e-8913-a5216ee22aac service nova] Lock "08ecabd0-f539-4068-9150-74e873809133-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG nova.compute.manager [req-42dd03ee-6641-446c-aa69-7ddd3151e8cb req-ceaf5591-335f-420e-8913-a5216ee22aac service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Processing event volume-reimaged-b057f77a-308f-4ef1-ac20-bd064c4ca481 {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Instance event wait completed in 23 seconds for volume-reimaged {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:13:01 user nova-compute[73917]: INFO nova.virt.block_device [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Booting with volume b057f77a-308f-4ef1-ac20-bd064c4ca481 at /dev/vda
Aug 26 19:13:01 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7fbab965-1369-4a6e-b59b-b0627d68a167 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.754s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.221s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG os_brick.utils [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4304f378-b089-479b-a768-c3e2fb5939bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff6cd1a-2742-4717-8953-57cd4dd1ecb8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79c2871-ddaa-42c9-b3b9-d94091b97e50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb164aff-31a5-4904-9dc7-f49dbd1d8caf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:13:01 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:13:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b72e4b-a95f-47cb-9298-ac57826cbe6f]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG os_brick.utils [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Updating existing volume attachment record: 862fe955-c710-4d32-a489-87ae2391a1fb {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:13:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:02 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:13:02 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:13:02 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:13:02 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:13:02 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:13:02 user nova-compute[73917]: INFO nova.compute.manager [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Rebuilding instance
Aug 26 19:13:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:03 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:03 user nova-compute[73917]: DEBUG nova.compute.manager [req-09a1799d-4520-49f6-affe-ef3b34958019 req-c1ce8362-ac26-4057-b12d-621bd9639a40 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Received event network-vif-unplugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-09a1799d-4520-49f6-affe-ef3b34958019 req-c1ce8362-ac26-4057-b12d-621bd9639a40 service nova] Acquiring lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-09a1799d-4520-49f6-affe-ef3b34958019 req-c1ce8362-ac26-4057-b12d-621bd9639a40 service nova] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-09a1799d-4520-49f6-affe-ef3b34958019 req-c1ce8362-ac26-4057-b12d-621bd9639a40 service nova] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:03 user nova-compute[73917]: DEBUG nova.compute.manager [req-09a1799d-4520-49f6-affe-ef3b34958019 req-c1ce8362-ac26-4057-b12d-621bd9639a40 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] No waiting events found dispatching network-vif-unplugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:03 user nova-compute[73917]: WARNING nova.compute.manager [req-09a1799d-4520-49f6-affe-ef3b34958019 req-c1ce8362-ac26-4057-b12d-621bd9639a40 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Received unexpected event network-vif-unplugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 for instance with vm_state active and task_state rebuilding.
Aug 26 19:13:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:04 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Instance destroyed successfully.
Aug 26 19:13:04 user nova-compute[73917]: INFO nova.compute.manager [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Detaching volume 0c50da8f-60da-4a1a-8ba9-b0202b97349a
Aug 26 19:13:04 user nova-compute[73917]: INFO nova.virt.block_device [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Attempting to driver detach volume 0c50da8f-60da-4a1a-8ba9-b0202b97349a from mountpoint /dev/vdb
Aug 26 19:13:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Attempting to detach device vdb from instance c4218678-e287-4f07-8af1-59469bbcd6bd from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:13:04 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:13:04 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:13:04 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:13:04 user nova-compute[73917]:   <serial>0c50da8f-60da-4a1a-8ba9-b0202b97349a</serial>
Aug 26 19:13:04 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:13:04 user nova-compute[73917]: </disk>
Aug 26 19:13:04 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:13:04 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Successfully detached device vdb from instance c4218678-e287-4f07-8af1-59469bbcd6bd from the persistent domain config.
Aug 26 19:13:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeLCvVUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:13:04 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 19:13:04 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[db37ad69-606d-4ebb-82ab-2eaac0aab168]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f1444d-1b07-49e1-81c1-2904da91cfd8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:13:04 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:13:04 user nova-compute[73917]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)
Aug 26 19:13:04 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:13:04 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:13:04 user nova-compute[73917]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)
Aug 26 19:13:04 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b9841ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a'): ({'sdc'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Removing single pathed devices sdc {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a1daa3-3bac-40f1-aca1-cf77cde9db7d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fd8b8a-ae40-47c6-8a0b-db326b4c0ec7]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Flushing IO for device /dev/sdc {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb6fe18-18c9-44e4-8a1d-50bc8be8d288]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2761951f-e1f8-49f8-a4cb-c6f837a7af0a]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdf2597-4a5e-4605-932c-c0bbaa66a738]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24b06b2-2b74-4149-b5bf-6d52eefdf91c]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a, portal: 172.16.0.220,3260]
Aug 26 19:13:04 user nova-compute[73917]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a, portal: 172.16.0.220,3260] successful.
Aug 26 19:13:04 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:05 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e115d8-dec5-4b17-83fe-6b56691b9234]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.424s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:13:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] <== disconnect_volume: return (427ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:13:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:13:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:05 user nova-compute[73917]: INFO nova.compute.manager [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Detaching volume 90b84430-2ecf-40e8-96de-912b95b5bf86
Aug 26 19:13:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-ffa51e9b-dbc7-49b0-8344-1f7d3ecf0ae2 req-7958eb54-0b14-45a7-ada6-e4e476b1d31d service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Received event network-vif-plugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ffa51e9b-dbc7-49b0-8344-1f7d3ecf0ae2 req-7958eb54-0b14-45a7-ada6-e4e476b1d31d service nova] Acquiring lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ffa51e9b-dbc7-49b0-8344-1f7d3ecf0ae2 req-7958eb54-0b14-45a7-ada6-e4e476b1d31d service nova] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ffa51e9b-dbc7-49b0-8344-1f7d3ecf0ae2 req-7958eb54-0b14-45a7-ada6-e4e476b1d31d service nova] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-ffa51e9b-dbc7-49b0-8344-1f7d3ecf0ae2 req-7958eb54-0b14-45a7-ada6-e4e476b1d31d service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] No waiting events found dispatching network-vif-plugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:05 user nova-compute[73917]: WARNING nova.compute.manager [req-ffa51e9b-dbc7-49b0-8344-1f7d3ecf0ae2 req-7958eb54-0b14-45a7-ada6-e4e476b1d31d service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Received unexpected event network-vif-plugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 for instance with vm_state active and task_state rebuilding.
Aug 26 19:13:05 user nova-compute[73917]: INFO nova.virt.block_device [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Attempting to driver detach volume 90b84430-2ecf-40e8-96de-912b95b5bf86 from mountpoint /dev/vdb
Aug 26 19:13:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Attempting to detach device vdb from instance fdfb377e-119e-41ce-b9e0-6e21053306cc from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:13:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:13:05 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:13:05 user nova-compute[73917]:   <source dev="/dev/sde"/>
Aug 26 19:13:05 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:13:05 user nova-compute[73917]:   <serial>90b84430-2ecf-40e8-96de-912b95b5bf86</serial>
Aug 26 19:13:05 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 19:13:05 user nova-compute[73917]: </disk>
Aug 26 19:13:05 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:13:05 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Successfully detached device vdb from instance fdfb377e-119e-41ce-b9e0-6e21053306cc from the persistent domain config.
Aug 26 19:13:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fdfb377e-119e-41ce-b9e0-6e21053306cc from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:13:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:13:05 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:13:05 user nova-compute[73917]:   <source dev="/dev/sde"/>
Aug 26 19:13:05 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:13:05 user nova-compute[73917]:   <serial>90b84430-2ecf-40e8-96de-912b95b5bf86</serial>
Aug 26 19:13:05 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 19:13:05 user nova-compute[73917]: </disk>
Aug 26 19:13:05 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:06 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Instance destroyed successfully.
Aug 26 19:13:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-843239325',display_name='tempest-ServerActionsTestOtherA-server-628875920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-843239325',id=16,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOklNSOL9r1q/zNv/+3lsUzJeS13Yy6booypQqav1LdRa4o4bUXxStD8Zbc/LQrFJOxHm0LxGHgW2WZ+4aH+DXEkJob/ZjlhQDrC3ATS52MugxelqEnl2LwwmyLXCgc3bw==',key_name='tempest-keypair-258176439',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:10:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2e09fe7b38e4bb991bfaaf5b4ad357a',ramdisk_id='',reservation_id='r-cn28ztmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2069094918',owner_user_name='tempest-ServerActionsTestOtherA-2069094918-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:13:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd1b7d3fe22c4b239cf03235866e17d4',uuid=c4218678-e287-4f07-8af1-59469bbcd6bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "address": "fa:16:3e:ee:57:64", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf9dd57-b9", "ovs_interfaceid": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converting VIF {"id": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "address": "fa:16:3e:ee:57:64", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf9dd57-b9", "ovs_interfaceid": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:57:64,bridge_name='br-int',has_traffic_filtering=True,id=faf9dd57-b9f3-4eec-af4d-b95205ffea78,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf9dd57-b9') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_vif [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:57:64,bridge_name='br-int',has_traffic_filtering=True,id=faf9dd57-b9f3-4eec-af4d-b95205ffea78,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf9dd57-b9') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfaf9dd57-b9, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:13:06 user nova-compute[73917]: INFO os_vif [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:57:64,bridge_name='br-int',has_traffic_filtering=True,id=faf9dd57-b9f3-4eec-af4d-b95205ffea78,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf9dd57-b9')
Aug 26 19:13:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeLCvVUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:13:06 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fe9930-d128-4549-b8e6-f0cf7f5cf34c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f88101-eabc-4125-9c86-eaaa57236f1f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:13:06 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:13:06 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:13:06 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:13:06 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b984185e0>, {}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Disconnecting from: [] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.054s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] <== disconnect_volume: return (55ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:13:06 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Deleting instance files /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd_del
Aug 26 19:13:06 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Deletion of /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd_del complete
Aug 26 19:13:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693077186.4857333, fdfb377e-119e-41ce-b9e0-6e21053306cc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:13:06 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Successfully detached device vdb from instance fdfb377e-119e-41ce-b9e0-6e21053306cc from the live domain config.
Aug 26 19:13:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hXixcyfT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:13:06 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ec91b3-474d-44e8-86c6-cd03131240fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c53ae1-1749-4fb4-aebc-4819115bd698]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:13:06 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:13:06 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:13:06 user nova-compute[73917]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 (non-flash)
Aug 26 19:13:06 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b98363370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86'): ({'sde'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Removing single pathed devices sde {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[686a2482-c600-4b1e-8d13-6ebd66d30ae5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.030s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc900d48-258e-4c0c-9bdb-2bf76076ab7b]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Flushing IO for device /dev/sde {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a24e3ff-867e-439f-b698-2f75afb94375]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:13:06 user nova-compute[73917]: INFO nova.virt.block_device [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Booting with volume 0c50da8f-60da-4a1a-8ba9-b0202b97349a at /dev/vdb
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[41946bca-f640-45c8-b631-da92fcbcc038]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] SCSI volumes sde have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0954ded7-18a0-4d6f-9172-fae046dac346]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.utils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[135a3bc1-4cf6-48f3-af8c-3add52796baa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac34804-16ae-4147-b6a5-3164490c0172]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac704bc-16c4-4bad-a100-5d9859e72742]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86, portal: 172.16.0.220,3260]
Aug 26 19:13:06 user nova-compute[73917]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86, portal: 172.16.0.220,3260] successful.
Aug 26 19:13:06 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfc58d8-645d-4db5-ba8a-36f1c3dd8f1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d45ca32-28b1-412a-9f2a-9c081cc9721f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b84430-2ecf-40e8-96de-912b95b5bf86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71e5e99-9f8d-489b-8eb5-e9750b46c3dd]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] <== disconnect_volume: return (433ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:13:06 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:13:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15786fc-a0bd-41ef-8550-590033160e4f]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG os_brick.utils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:13:06 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Updating existing volume attachment record: ca72464f-b44f-4a1f-8c20-393c78b3c061 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:13:07 user nova-compute[73917]: INFO nova.compute.manager [None req-51e447f8-1ca8-4954-b633-e718ca823701 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Unrescuing
Aug 26 19:13:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-51e447f8-1ca8-4954-b633-e718ca823701 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:13:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-51e447f8-1ca8-4954-b633-e718ca823701 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquired lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:13:07 user nova-compute[73917]: DEBUG nova.network.neutron [None req-51e447f8-1ca8-4954-b633-e718ca823701 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:13:07 user nova-compute[73917]: DEBUG nova.objects.instance [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'flavor' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-941b2e6c-cfb9-42e3-896a-a14b00f80140 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.318s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ba702b6-76a2-4d60-9f85-6987fd0b98eb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ba702b6-76a2-4d60-9f85-6987fd0b98eb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG nova.compute.manager [None req-6ba702b6-76a2-4d60-9f85-6987fd0b98eb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG nova.compute.manager [None req-6ba702b6-76a2-4d60-9f85-6987fd0b98eb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73917) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG nova.objects.instance [None req-6ba702b6-76a2-4d60-9f85-6987fd0b98eb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'flavor' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG nova.network.neutron [None req-51e447f8-1ca8-4954-b633-e718ca823701 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Updating instance_info_cache with network_info: [{"id": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "address": "fa:16:3e:c9:58:2d", "network": {"id": "4fb39591-1339-423b-a17d-cec979856e60", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09772507cd24e329e84aa3b9a3b9b7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245e99f5-fb", "ovs_interfaceid": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-51e447f8-1ca8-4954-b633-e718ca823701 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Releasing lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG nova.objects.instance [None req-51e447f8-1ca8-4954-b633-e718ca823701 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lazy-loading 'flavor' on Instance uuid 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077173.8162122, 5dd60c10-f99a-431d-a66f-936a7a7a1c55 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:13:08 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] VM Stopped (Lifecycle Event)
Aug 26 19:13:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG nova.compute.manager [None req-e9ac4f2d-edad-4861-bf91-d2f15d5cd942 None None] [instance: 5dd60c10-f99a-431d-a66f-936a7a7a1c55] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG nova.compute.manager [req-ced5fd8f-b1fa-4358-849e-7f2fcbb3ca4b req-a85d25c2-1bf3-4c25-a757-29307c87b4bc service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received event network-vif-unplugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ced5fd8f-b1fa-4358-849e-7f2fcbb3ca4b req-a85d25c2-1bf3-4c25-a757-29307c87b4bc service nova] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ced5fd8f-b1fa-4358-849e-7f2fcbb3ca4b req-a85d25c2-1bf3-4c25-a757-29307c87b4bc service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ced5fd8f-b1fa-4358-849e-7f2fcbb3ca4b req-a85d25c2-1bf3-4c25-a757-29307c87b4bc service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:08 user nova-compute[73917]: DEBUG nova.compute.manager [req-ced5fd8f-b1fa-4358-849e-7f2fcbb3ca4b req-a85d25c2-1bf3-4c25-a757-29307c87b4bc service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] No waiting events found dispatching network-vif-unplugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:08 user nova-compute[73917]: WARNING nova.compute.manager [req-ced5fd8f-b1fa-4358-849e-7f2fcbb3ca4b req-a85d25c2-1bf3-4c25-a757-29307c87b4bc service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received unexpected event network-vif-unplugged-37aa792a-c367-4dfd-b814-cb9c32ef373c for instance with vm_state active and task_state powering-off.
Aug 26 19:13:09 user nova-compute[73917]: DEBUG nova.compute.manager [req-d8905cd9-e55a-4d70-9ac8-21bfb48c190c req-3cc14226-7a77-422b-b384-1eb6ee9021db service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-vif-unplugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d8905cd9-e55a-4d70-9ac8-21bfb48c190c req-3cc14226-7a77-422b-b384-1eb6ee9021db service nova] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d8905cd9-e55a-4d70-9ac8-21bfb48c190c req-3cc14226-7a77-422b-b384-1eb6ee9021db service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d8905cd9-e55a-4d70-9ac8-21bfb48c190c req-3cc14226-7a77-422b-b384-1eb6ee9021db service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:09 user nova-compute[73917]: DEBUG nova.compute.manager [req-d8905cd9-e55a-4d70-9ac8-21bfb48c190c req-3cc14226-7a77-422b-b384-1eb6ee9021db service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] No waiting events found dispatching network-vif-unplugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:09 user nova-compute[73917]: WARNING nova.compute.manager [req-d8905cd9-e55a-4d70-9ac8-21bfb48c190c req-3cc14226-7a77-422b-b384-1eb6ee9021db service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received unexpected event network-vif-unplugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:13:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:09 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Instance destroyed successfully.
Aug 26 19:13:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-6ba702b6-76a2-4d60-9f85-6987fd0b98eb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:09 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Instance destroyed successfully.
Aug 26 19:13:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ba702b6-76a2-4d60-9f85-6987fd0b98eb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.506s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-dd0220b5-eb5b-4749-bba1-dd68d1a7c81a req-365f91df-0bb2-4ecf-a4d0-6848d6fe709a service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-dd0220b5-eb5b-4749-bba1-dd68d1a7c81a req-365f91df-0bb2-4ecf-a4d0-6848d6fe709a service nova] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-dd0220b5-eb5b-4749-bba1-dd68d1a7c81a req-365f91df-0bb2-4ecf-a4d0-6848d6fe709a service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-dd0220b5-eb5b-4749-bba1-dd68d1a7c81a req-365f91df-0bb2-4ecf-a4d0-6848d6fe709a service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-dd0220b5-eb5b-4749-bba1-dd68d1a7c81a req-365f91df-0bb2-4ecf-a4d0-6848d6fe709a service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] No waiting events found dispatching network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:11 user nova-compute[73917]: WARNING nova.compute.manager [req-dd0220b5-eb5b-4749-bba1-dd68d1a7c81a req-365f91df-0bb2-4ecf-a4d0-6848d6fe709a service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received unexpected event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:13:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-dd0220b5-eb5b-4749-bba1-dd68d1a7c81a req-365f91df-0bb2-4ecf-a4d0-6848d6fe709a service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-dd0220b5-eb5b-4749-bba1-dd68d1a7c81a req-365f91df-0bb2-4ecf-a4d0-6848d6fe709a service nova] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-dd0220b5-eb5b-4749-bba1-dd68d1a7c81a req-365f91df-0bb2-4ecf-a4d0-6848d6fe709a service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-dd0220b5-eb5b-4749-bba1-dd68d1a7c81a req-365f91df-0bb2-4ecf-a4d0-6848d6fe709a service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-dd0220b5-eb5b-4749-bba1-dd68d1a7c81a req-365f91df-0bb2-4ecf-a4d0-6848d6fe709a service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] No waiting events found dispatching network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:11 user nova-compute[73917]: WARNING nova.compute.manager [req-dd0220b5-eb5b-4749-bba1-dd68d1a7c81a req-365f91df-0bb2-4ecf-a4d0-6848d6fe709a service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received unexpected event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:13:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] No waiting events found dispatching network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:11 user nova-compute[73917]: WARNING nova.compute.manager [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received unexpected event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c for instance with vm_state stopped and task_state None.
Aug 26 19:13:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-changed-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Refreshing instance network info cache due to event network-changed-245e99f5-fb5c-4442-b5f7-c2b05207f2fc. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] Acquiring lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] Acquired lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG nova.network.neutron [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Refreshing network info cache for port 245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG nova.compute.manager [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:13:12 user nova-compute[73917]: INFO nova.compute.claims [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Claim successful on node user
Aug 26 19:13:12 user nova-compute[73917]: DEBUG nova.network.neutron [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Updated VIF entry in instance network info cache for port 245e99f5-fb5c-4442-b5f7-c2b05207f2fc. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG nova.network.neutron [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Updating instance_info_cache with network_info: [{"id": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "address": "fa:16:3e:c9:58:2d", "network": {"id": "4fb39591-1339-423b-a17d-cec979856e60", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09772507cd24e329e84aa3b9a3b9b7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245e99f5-fb", "ovs_interfaceid": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] Releasing lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG nova.compute.manager [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-changed-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG nova.compute.manager [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Refreshing instance network info cache due to event network-changed-245e99f5-fb5c-4442-b5f7-c2b05207f2fc. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] Acquiring lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] Acquired lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG nova.network.neutron [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Refreshing network info cache for port 245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.762s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:12 user nova-compute[73917]: DEBUG nova.compute.manager [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.network.neutron [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:13:13 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:13:13 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Creating image(s)
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "/opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "/opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "/opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.policy [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ff1648bb2044c0e9fd90ece565c4e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d3d1cb213442cc9a672abe4a5c2b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] No waiting events found dispatching network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:13 user nova-compute[73917]: WARNING nova.compute.manager [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received unexpected event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-vif-unplugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] No waiting events found dispatching network-vif-unplugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:13 user nova-compute[73917]: WARNING nova.compute.manager [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received unexpected event network-vif-unplugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] No waiting events found dispatching network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:13 user nova-compute[73917]: WARNING nova.compute.manager [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received unexpected event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] No waiting events found dispatching network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:13 user nova-compute[73917]: WARNING nova.compute.manager [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received unexpected event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] No waiting events found dispatching network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:13 user nova-compute[73917]: WARNING nova.compute.manager [req-3a1cbe05-bb0d-4dbe-bc5e-a9c3857b30c2 req-58504d61-c2a1-4198-b59d-d91fea2b9092 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received unexpected event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.network.neutron [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Updated VIF entry in instance network info cache for port 245e99f5-fb5c-4442-b5f7-c2b05207f2fc. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.network.neutron [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Updating instance_info_cache with network_info: [{"id": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "address": "fa:16:3e:c9:58:2d", "network": {"id": "4fb39591-1339-423b-a17d-cec979856e60", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09772507cd24e329e84aa3b9a3b9b7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245e99f5-fb", "ovs_interfaceid": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3dc2305a-bf32-4f20-a2e5-f3a5160f6d91 req-54c9e236-5c6e-4fd9-acac-940488dc4331 service nova] Releasing lock "refresh_cache-9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.233s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.233s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk 1073741824" returned: 0 in 0.054s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-51e447f8-1ca8-4954-b633-e718ca823701 tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Removed pending event for 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 due to event {{(pid=73917) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077193.9354906, 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:13:13 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] VM Resumed (Lifecycle Event)
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:13:14 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 19:13:14 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077193.93573, 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:13:14 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] VM Started (Lifecycle Event)
Aug 26 19:13:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.176s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:14 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:13:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:13:14 user nova-compute[73917]: DEBUG nova.network.neutron [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Successfully created port: c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:13:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:14 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Cannot resize image /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:13:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:13:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Ensure instance console log exists: /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:13:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:15 user nova-compute[73917]: DEBUG nova.network.neutron [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Successfully updated port: c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:13:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:13:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquired lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:13:15 user nova-compute[73917]: DEBUG nova.network.neutron [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:13:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-36eff20b-6a97-44a3-8724-a5211017d2ba req-e6716db0-2916-4edc-b21f-00806cadaf27 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received event network-changed-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-36eff20b-6a97-44a3-8724-a5211017d2ba req-e6716db0-2916-4edc-b21f-00806cadaf27 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Refreshing instance network info cache due to event network-changed-c63a3326-bd42-40f4-8559-b7f08e5f9a98. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:13:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-36eff20b-6a97-44a3-8724-a5211017d2ba req-e6716db0-2916-4edc-b21f-00806cadaf27 service nova] Acquiring lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:13:15 user nova-compute[73917]: DEBUG nova.network.neutron [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:13:16 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Creating image(s)
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Did not create local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Ensure instance console log exists: /opt/stack/data/nova/instances/08ecabd0-f539-4068-9150-74e873809133/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Start _get_guest_xml network_info=[{"id": "895c0971-95b8-490f-95b5-386c50ba29c8", "address": "fa:16:3e:b0:8c:eb", "network": {"id": "ad75441f-c776-426b-8ada-8fc89037e592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-909384262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820b033209b644249a7b064b4ca6c23f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895c0971-95", "ovs_interfaceid": "895c0971-95b8-490f-95b5-386c50ba29c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGkZoHXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '08ecabd0-f539-4068-9150-74e873809133', 'attached_at': '', 'detached_at': '', 'volume_id': 'b057f77a-308f-4ef1-ac20-bd064c4ca481', 'serial': 'b057f77a-308f-4ef1-ac20-bd064c4ca481'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '862fe955-c710-4d32-a489-87ae2391a1fb', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:16 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 19:13:16 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.objects.instance [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lazy-loading 'vcpu_model' on Instance uuid 08ecabd0-f539-4068-9150-74e873809133 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGkZoHXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:13:16 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:13:16 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:13:16 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.network.neutron [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Updating instance_info_cache with network_info: [{"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Releasing lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Instance network_info: |[{"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-36eff20b-6a97-44a3-8724-a5211017d2ba req-e6716db0-2916-4edc-b21f-00806cadaf27 service nova] Acquired lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.network.neutron [req-36eff20b-6a97-44a3-8724-a5211017d2ba req-e6716db0-2916-4edc-b21f-00806cadaf27 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Refreshing network info cache for port c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Start _get_guest_xml network_info=[{"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6912a3c-5047-4daa-8a00-201aceb2cc31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:13:16 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:13:16 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:13:16 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[57622af3-1b3a-403d-8442-9e5070c34d17]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481] added
Aug 26 19:13:16 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1165082774',display_name='tempest-ServerActionsTestOtherB-server-1165082774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1165082774',id=19,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf6A+tLmlhXN1ex/7jOISEFChezRDQZ5m7P/4PRHH+2Viff3bm+/OVarrZ0hky07ll3BRX4g048OhpV/rgYZ4nSom5KVv2Uu0RHTe6WT8eoSMJzatFMKJ/1TpRz/DQQnw==',key_name='tempest-keypair-2090853106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36d3d1cb213442cc9a672abe4a5c2b61',ramdisk_id='',reservation_id='r-0fa34jg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-824485866',owner_user_name='tempest-ServerActionsTestOtherB-824485866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:13:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff1648bb2044c0e9fd90ece565c4e8e',uuid=dca28d65-37d0-4b60-b8aa-dcca61b6a187,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Converting VIF {"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.objects.instance [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lazy-loading 'pci_devices' on Instance uuid dca28d65-37d0-4b60-b8aa-dcca61b6a187 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7866d897-ee6b-4793-b0cf-ffe8b8607d7c]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:13:16 user nova-compute[73917]:   <uuid>dca28d65-37d0-4b60-b8aa-dcca61b6a187</uuid>
Aug 26 19:13:16 user nova-compute[73917]:   <name>instance-00000013</name>
Aug 26 19:13:16 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:13:16 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:13:16 user nova-compute[73917]:   <metadata>
Aug 26 19:13:16 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:13:16 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:13:16 user nova-compute[73917]:       <nova:name>tempest-ServerActionsTestOtherB-server-1165082774</nova:name>
Aug 26 19:13:16 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:13:16</nova:creationTime>
Aug 26 19:13:16 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:13:16 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:13:16 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:13:16 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:13:16 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:13:16 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:13:16 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:13:16 user nova-compute[73917]:       <nova:owner>
Aug 26 19:13:16 user nova-compute[73917]:         <nova:user uuid="0ff1648bb2044c0e9fd90ece565c4e8e">tempest-ServerActionsTestOtherB-824485866-project-member</nova:user>
Aug 26 19:13:16 user nova-compute[73917]:         <nova:project uuid="36d3d1cb213442cc9a672abe4a5c2b61">tempest-ServerActionsTestOtherB-824485866</nova:project>
Aug 26 19:13:16 user nova-compute[73917]:       </nova:owner>
Aug 26 19:13:16 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:13:16 user nova-compute[73917]:       <nova:ports>
Aug 26 19:13:16 user nova-compute[73917]:         <nova:port uuid="c63a3326-bd42-40f4-8559-b7f08e5f9a98">
Aug 26 19:13:16 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 19:13:16 user nova-compute[73917]:         </nova:port>
Aug 26 19:13:16 user nova-compute[73917]:       </nova:ports>
Aug 26 19:13:16 user nova-compute[73917]:     </nova:instance>
Aug 26 19:13:16 user nova-compute[73917]:   </metadata>
Aug 26 19:13:16 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:13:16 user nova-compute[73917]:     <system>
Aug 26 19:13:16 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:13:16 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:13:16 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:13:16 user nova-compute[73917]:       <entry name="serial">dca28d65-37d0-4b60-b8aa-dcca61b6a187</entry>
Aug 26 19:13:16 user nova-compute[73917]:       <entry name="uuid">dca28d65-37d0-4b60-b8aa-dcca61b6a187</entry>
Aug 26 19:13:16 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:13:16 user nova-compute[73917]:     </system>
Aug 26 19:13:16 user nova-compute[73917]:   </sysinfo>
Aug 26 19:13:16 user nova-compute[73917]:   <os>
Aug 26 19:13:16 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:13:16 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:13:16 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:13:16 user nova-compute[73917]:   </os>
Aug 26 19:13:16 user nova-compute[73917]:   <features>
Aug 26 19:13:16 user nova-compute[73917]:     <acpi/>
Aug 26 19:13:16 user nova-compute[73917]:     <apic/>
Aug 26 19:13:16 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:13:16 user nova-compute[73917]:   </features>
Aug 26 19:13:16 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:13:16 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:13:16 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:13:16 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:13:16 user nova-compute[73917]:   </clock>
Aug 26 19:13:16 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:13:16 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:13:16 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:13:16 user nova-compute[73917]:   </cpu>
Aug 26 19:13:16 user nova-compute[73917]:   <devices>
Aug 26 19:13:16 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:13:16 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:13:16 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk"/>
Aug 26 19:13:16 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:13:16 user nova-compute[73917]:     </disk>
Aug 26 19:13:16 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:13:16 user nova-compute[73917]:       <mac address="fa:16:3e:14:4e:59"/>
Aug 26 19:13:16 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:13:16 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:13:16 user nova-compute[73917]:       <target dev="tapc63a3326-bd"/>
Aug 26 19:13:16 user nova-compute[73917]:     </interface>
Aug 26 19:13:16 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:13:16 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/console.log" append="off"/>
Aug 26 19:13:16 user nova-compute[73917]:     </serial>
Aug 26 19:13:16 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:13:16 user nova-compute[73917]:     <video>
Aug 26 19:13:16 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:13:16 user nova-compute[73917]:     </video>
Aug 26 19:13:16 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:13:16 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:13:16 user nova-compute[73917]:     </rng>
Aug 26 19:13:16 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:13:16 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:13:16 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:13:16 user nova-compute[73917]:     </memballoon>
Aug 26 19:13:16 user nova-compute[73917]:   </devices>
Aug 26 19:13:16 user nova-compute[73917]: </domain>
Aug 26 19:13:16 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1165082774',display_name='tempest-ServerActionsTestOtherB-server-1165082774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1165082774',id=19,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf6A+tLmlhXN1ex/7jOISEFChezRDQZ5m7P/4PRHH+2Viff3bm+/OVarrZ0hky07ll3BRX4g048OhpV/rgYZ4nSom5KVv2Uu0RHTe6WT8eoSMJzatFMKJ/1TpRz/DQQnw==',key_name='tempest-keypair-2090853106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36d3d1cb213442cc9a672abe4a5c2b61',ramdisk_id='',reservation_id='r-0fa34jg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-824485866',owner_user_name='tempest-ServerActionsTestOtherB-824485866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:13:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff1648bb2044c0e9fd90ece565c4e8e',uuid=dca28d65-37d0-4b60-b8aa-dcca61b6a187,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Converting VIF {"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_vif [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc63a3326-bd, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc63a3326-bd, col_values=(('external_ids', {'iface-id': 'c63a3326-bd42-40f4-8559-b7f08e5f9a98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:4e:59', 'vm-uuid': 'dca28d65-37d0-4b60-b8aa-dcca61b6a187'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ce223d-f792-44ce-b3a2-003a78f92b84]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sGkZoHXP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:16 user nova-compute[73917]: INFO os_vif [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd')
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sGkZoHXP" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a3ea2a-4dfd-4638-9fbb-e650b263c958]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sGkZoHXP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:13:16 user nova-compute[73917]: INFO nova.compute.claims [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Claim successful on node user
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[58450c3f-0ec6-4b54-a569-9d5eb1d5e3a6]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] No VIF found with MAC fa:16:3e:14:4e:59, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d4e83f-612b-4543-bc6a-5e64bec52a39]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:13:16 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:13:16 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ec88f0-bb26-48d1-a6a1-3d9fb48a4169]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481, portal: 172.16.0.220,3260]
Aug 26 19:13:16 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481, portal: 172.16.0.220,3260] successful.
Aug 26 19:13:16 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c1dba3-0d8c-4948-b49a-150cb1a00521]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c8cd3e-9979-4790-aa73-a2c7f1260424]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:13:16 user nova-compute[73917]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:13:16 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:13:16 user nova-compute[73917]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:13:16 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.444s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[750d6af5-ccbb-400f-a9d0-7bb86b00ac14]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:13:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGkZoHXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG nova.network.neutron [req-36eff20b-6a97-44a3-8724-a5211017d2ba req-e6716db0-2916-4edc-b21f-00806cadaf27 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Updated VIF entry in instance network info cache for port c63a3326-bd42-40f4-8559-b7f08e5f9a98. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG nova.network.neutron [req-36eff20b-6a97-44a3-8724-a5211017d2ba req-e6716db0-2916-4edc-b21f-00806cadaf27 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Updating instance_info_cache with network_info: [{"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-36eff20b-6a97-44a3-8724-a5211017d2ba req-e6716db0-2916-4edc-b21f-00806cadaf27 service nova] Releasing lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.726s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG nova.compute.manager [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG nova.compute.manager [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG nova.network.neutron [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:13:17 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:13:17 user nova-compute[73917]: DEBUG nova.compute.manager [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG nova.policy [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4db077369ef04a9eb5c0654b96550468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f7803cd6f44ed19fe59bd7286b6498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG nova.compute.manager [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:13:17 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Creating image(s)
Aug 26 19:13:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "/opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "/opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.260s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.508s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] <== connect_volume: return (1512ms) {'type': 'block', 'scsi_wwn': '23133373834306630', 'path': '/dev/sdb'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:13:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133373834306630', 'path': '/dev/sdb'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T19:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-372476347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-847741481',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILuuKhhd8SBkV1rvvqP3lRG/pwSBnr43r+z6CsGpn0WvVX9OQC0V+eSZCDA4YsPtHza5LR1n8VcvXIU4KZevCoPCULj3dhrVlzQmOhcxjRhz3Cu3v86zWvhmqTkFn+daA==',key_name='tempest-keypair-1708956738',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:11:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='820b033209b644249a7b064b4ca6c23f',ramdisk_id='',reservation_id='r-0arw7nc1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1172188124',owner_user_name='tempest-ServerActionsV293TestJSON-1172188124-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:13:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ddca966a7694d04b252599a47f4078e',uuid=08ecabd0-f539-4068-9150-74e873809133,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "895c0971-95b8-490f-95b5-386c50ba29c8", "address": "fa:16:3e:b0:8c:eb", "network": {"id": "ad75441f-c776-426b-8ada-8fc89037e592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-909384262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820b033209b644249a7b064b4ca6c23f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895c0971-95", "ovs_interfaceid": "895c0971-95b8-490f-95b5-386c50ba29c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Converting VIF {"id": "895c0971-95b8-490f-95b5-386c50ba29c8", "address": "fa:16:3e:b0:8c:eb", "network": {"id": "ad75441f-c776-426b-8ada-8fc89037e592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-909384262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820b033209b644249a7b064b4ca6c23f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895c0971-95", "ovs_interfaceid": "895c0971-95b8-490f-95b5-386c50ba29c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=895c0971-95b8-490f-95b5-386c50ba29c8,network=Network(ad75441f-c776-426b-8ada-8fc89037e592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895c0971-95') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:13:18 user nova-compute[73917]:   <uuid>08ecabd0-f539-4068-9150-74e873809133</uuid>
Aug 26 19:13:18 user nova-compute[73917]:   <name>instance-0000000f</name>
Aug 26 19:13:18 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:13:18 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:13:18 user nova-compute[73917]:   <metadata>
Aug 26 19:13:18 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:13:18 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:13:18 user nova-compute[73917]:       <nova:name>tempest-ServerActionsV293TestJSON-server-372476347</nova:name>
Aug 26 19:13:18 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:13:16</nova:creationTime>
Aug 26 19:13:18 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:13:18 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:13:18 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:13:18 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:13:18 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:13:18 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:13:18 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:13:18 user nova-compute[73917]:       <nova:owner>
Aug 26 19:13:18 user nova-compute[73917]:         <nova:user uuid="4ddca966a7694d04b252599a47f4078e">tempest-ServerActionsV293TestJSON-1172188124-project-member</nova:user>
Aug 26 19:13:18 user nova-compute[73917]:         <nova:project uuid="820b033209b644249a7b064b4ca6c23f">tempest-ServerActionsV293TestJSON-1172188124</nova:project>
Aug 26 19:13:18 user nova-compute[73917]:       </nova:owner>
Aug 26 19:13:18 user nova-compute[73917]:       <nova:ports>
Aug 26 19:13:18 user nova-compute[73917]:         <nova:port uuid="895c0971-95b8-490f-95b5-386c50ba29c8">
Aug 26 19:13:18 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 19:13:18 user nova-compute[73917]:         </nova:port>
Aug 26 19:13:18 user nova-compute[73917]:       </nova:ports>
Aug 26 19:13:18 user nova-compute[73917]:     </nova:instance>
Aug 26 19:13:18 user nova-compute[73917]:   </metadata>
Aug 26 19:13:18 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:13:18 user nova-compute[73917]:     <system>
Aug 26 19:13:18 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:13:18 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:13:18 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:13:18 user nova-compute[73917]:       <entry name="serial">08ecabd0-f539-4068-9150-74e873809133</entry>
Aug 26 19:13:18 user nova-compute[73917]:       <entry name="uuid">08ecabd0-f539-4068-9150-74e873809133</entry>
Aug 26 19:13:18 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:13:18 user nova-compute[73917]:     </system>
Aug 26 19:13:18 user nova-compute[73917]:   </sysinfo>
Aug 26 19:13:18 user nova-compute[73917]:   <os>
Aug 26 19:13:18 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:13:18 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:13:18 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:13:18 user nova-compute[73917]:   </os>
Aug 26 19:13:18 user nova-compute[73917]:   <features>
Aug 26 19:13:18 user nova-compute[73917]:     <acpi/>
Aug 26 19:13:18 user nova-compute[73917]:     <apic/>
Aug 26 19:13:18 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:13:18 user nova-compute[73917]:   </features>
Aug 26 19:13:18 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:13:18 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:13:18 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:13:18 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:13:18 user nova-compute[73917]:   </clock>
Aug 26 19:13:18 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:13:18 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:13:18 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:13:18 user nova-compute[73917]:   </cpu>
Aug 26 19:13:18 user nova-compute[73917]:   <devices>
Aug 26 19:13:18 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:13:18 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:13:18 user nova-compute[73917]:       <source dev="/dev/sdb"/>
Aug 26 19:13:18 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:13:18 user nova-compute[73917]:       <serial>b057f77a-308f-4ef1-ac20-bd064c4ca481</serial>
Aug 26 19:13:18 user nova-compute[73917]:     </disk>
Aug 26 19:13:18 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:13:18 user nova-compute[73917]:       <mac address="fa:16:3e:b0:8c:eb"/>
Aug 26 19:13:18 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:13:18 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:13:18 user nova-compute[73917]:       <target dev="tap895c0971-95"/>
Aug 26 19:13:18 user nova-compute[73917]:     </interface>
Aug 26 19:13:18 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:13:18 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/08ecabd0-f539-4068-9150-74e873809133/console.log" append="off"/>
Aug 26 19:13:18 user nova-compute[73917]:     </serial>
Aug 26 19:13:18 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:13:18 user nova-compute[73917]:     <video>
Aug 26 19:13:18 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:13:18 user nova-compute[73917]:     </video>
Aug 26 19:13:18 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:13:18 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:13:18 user nova-compute[73917]:     </rng>
Aug 26 19:13:18 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:13:18 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:13:18 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:13:18 user nova-compute[73917]:     </memballoon>
Aug 26 19:13:18 user nova-compute[73917]:   </devices>
Aug 26 19:13:18 user nova-compute[73917]: </domain>
Aug 26 19:13:18 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T19:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-372476347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-847741481',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILuuKhhd8SBkV1rvvqP3lRG/pwSBnr43r+z6CsGpn0WvVX9OQC0V+eSZCDA4YsPtHza5LR1n8VcvXIU4KZevCoPCULj3dhrVlzQmOhcxjRhz3Cu3v86zWvhmqTkFn+daA==',key_name='tempest-keypair-1708956738',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:11:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='820b033209b644249a7b064b4ca6c23f',ramdisk_id='',reservation_id='r-0arw7nc1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1172188124',owner_user_name='tempest-ServerActionsV293TestJSON-1172188124-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:13:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ddca966a7694d04b252599a47f4078e',uuid=08ecabd0-f539-4068-9150-74e873809133,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "895c0971-95b8-490f-95b5-386c50ba29c8", "address": "fa:16:3e:b0:8c:eb", "network": {"id": "ad75441f-c776-426b-8ada-8fc89037e592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-909384262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820b033209b644249a7b064b4ca6c23f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895c0971-95", "ovs_interfaceid": "895c0971-95b8-490f-95b5-386c50ba29c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Converting VIF {"id": "895c0971-95b8-490f-95b5-386c50ba29c8", "address": "fa:16:3e:b0:8c:eb", "network": {"id": "ad75441f-c776-426b-8ada-8fc89037e592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-909384262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820b033209b644249a7b064b4ca6c23f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895c0971-95", "ovs_interfaceid": "895c0971-95b8-490f-95b5-386c50ba29c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=895c0971-95b8-490f-95b5-386c50ba29c8,network=Network(ad75441f-c776-426b-8ada-8fc89037e592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895c0971-95') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG os_vif [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=895c0971-95b8-490f-95b5-386c50ba29c8,network=Network(ad75441f-c776-426b-8ada-8fc89037e592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895c0971-95') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap895c0971-95, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap895c0971-95, col_values=(('external_ids', {'iface-id': '895c0971-95b8-490f-95b5-386c50ba29c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:8c:eb', 'vm-uuid': '08ecabd0-f539-4068-9150-74e873809133'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:18 user nova-compute[73917]: INFO os_vif [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=895c0971-95b8-490f-95b5-386c50ba29c8,network=Network(ad75441f-c776-426b-8ada-8fc89037e592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895c0971-95')
Aug 26 19:13:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.228s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk 1073741824" returned: 0 in 0.056s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] No VIF found with MAC fa:16:3e:b0:8c:eb, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.247s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG nova.network.neutron [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Successfully created port: a3c97057-1f39-49d8-9f1b-d0f2deea9357 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Cannot resize image /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Ensure instance console log exists: /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG nova.compute.manager [req-05fb35cb-69b6-486f-8c6d-5f58e6b6029e req-89bd82f4-f262-4530-a740-ea7f95ac091d service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received event network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-05fb35cb-69b6-486f-8c6d-5f58e6b6029e req-89bd82f4-f262-4530-a740-ea7f95ac091d service nova] Acquiring lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-05fb35cb-69b6-486f-8c6d-5f58e6b6029e req-89bd82f4-f262-4530-a740-ea7f95ac091d service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-05fb35cb-69b6-486f-8c6d-5f58e6b6029e req-89bd82f4-f262-4530-a740-ea7f95ac091d service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:18 user nova-compute[73917]: DEBUG nova.compute.manager [req-05fb35cb-69b6-486f-8c6d-5f58e6b6029e req-89bd82f4-f262-4530-a740-ea7f95ac091d service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] No waiting events found dispatching network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:18 user nova-compute[73917]: WARNING nova.compute.manager [req-05fb35cb-69b6-486f-8c6d-5f58e6b6029e req-89bd82f4-f262-4530-a740-ea7f95ac091d service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received unexpected event network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 for instance with vm_state building and task_state spawning.
Aug 26 19:13:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:19 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077184.1080437, c4218678-e287-4f07-8af1-59469bbcd6bd => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:13:19 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] VM Stopped (Lifecycle Event)
Aug 26 19:13:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-add47d75-ceb8-4ba2-b079-a8956c5128e3 None None] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:19 user nova-compute[73917]: DEBUG nova.network.neutron [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Successfully updated port: a3c97057-1f39-49d8-9f1b-d0f2deea9357 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:13:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "refresh_cache-f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:13:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquired lock "refresh_cache-f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:13:19 user nova-compute[73917]: DEBUG nova.network.neutron [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:13:19 user nova-compute[73917]: DEBUG nova.network.neutron [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.network.neutron [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Updating instance_info_cache with network_info: [{"id": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "address": "fa:16:3e:dd:b4:69", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c97057-1f", "ovs_interfaceid": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Releasing lock "refresh_cache-f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.compute.manager [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Instance network_info: |[{"id": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "address": "fa:16:3e:dd:b4:69", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c97057-1f", "ovs_interfaceid": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Start _get_guest_xml network_info=[{"id": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "address": "fa:16:3e:dd:b4:69", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c97057-1f", "ovs_interfaceid": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:20 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:13:20 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1875469590',display_name='tempest-VolumesAdminNegativeTest-server-1875469590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1875469590',id=20,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbjm7JS4q/8toEgXFvtecKsTaTn6+0tO+zq53jbF0asEVsqn8iNixnaqsykdR3I/9JMwF8lXGApzEWMk97vzNvwu0lksZWsZBCC5GLvrZ0yPI8mvhBOD/F9QHvU2MLJCw==',key_name='tempest-keypair-741700897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5f7803cd6f44ed19fe59bd7286b6498',ramdisk_id='',reservation_id='r-unwj6nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-13801866',owner_user_name='tempest-VolumesAdminNegativeTest-13801866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:13:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4db077369ef04a9eb5c0654b96550468',uuid=f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "address": "fa:16:3e:dd:b4:69", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c97057-1f", "ovs_interfaceid": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Converting VIF {"id": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "address": "fa:16:3e:dd:b4:69", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c97057-1f", "ovs_interfaceid": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b4:69,bridge_name='br-int',has_traffic_filtering=True,id=a3c97057-1f39-49d8-9f1b-d0f2deea9357,network=Network(7da3a70d-3593-4f44-8572-3ae03e3cf9c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c97057-1f') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.objects.instance [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lazy-loading 'pci_devices' on Instance uuid f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:13:20 user nova-compute[73917]:   <uuid>f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10</uuid>
Aug 26 19:13:20 user nova-compute[73917]:   <name>instance-00000014</name>
Aug 26 19:13:20 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:13:20 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:13:20 user nova-compute[73917]:   <metadata>
Aug 26 19:13:20 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:13:20 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:13:20 user nova-compute[73917]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1875469590</nova:name>
Aug 26 19:13:20 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:13:20</nova:creationTime>
Aug 26 19:13:20 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:13:20 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:13:20 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:13:20 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:13:20 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:13:20 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:13:20 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:13:20 user nova-compute[73917]:       <nova:owner>
Aug 26 19:13:20 user nova-compute[73917]:         <nova:user uuid="4db077369ef04a9eb5c0654b96550468">tempest-VolumesAdminNegativeTest-13801866-project-member</nova:user>
Aug 26 19:13:20 user nova-compute[73917]:         <nova:project uuid="f5f7803cd6f44ed19fe59bd7286b6498">tempest-VolumesAdminNegativeTest-13801866</nova:project>
Aug 26 19:13:20 user nova-compute[73917]:       </nova:owner>
Aug 26 19:13:20 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:13:20 user nova-compute[73917]:       <nova:ports>
Aug 26 19:13:20 user nova-compute[73917]:         <nova:port uuid="a3c97057-1f39-49d8-9f1b-d0f2deea9357">
Aug 26 19:13:20 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 19:13:20 user nova-compute[73917]:         </nova:port>
Aug 26 19:13:20 user nova-compute[73917]:       </nova:ports>
Aug 26 19:13:20 user nova-compute[73917]:     </nova:instance>
Aug 26 19:13:20 user nova-compute[73917]:   </metadata>
Aug 26 19:13:20 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:13:20 user nova-compute[73917]:     <system>
Aug 26 19:13:20 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:13:20 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:13:20 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:13:20 user nova-compute[73917]:       <entry name="serial">f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10</entry>
Aug 26 19:13:20 user nova-compute[73917]:       <entry name="uuid">f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10</entry>
Aug 26 19:13:20 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:13:20 user nova-compute[73917]:     </system>
Aug 26 19:13:20 user nova-compute[73917]:   </sysinfo>
Aug 26 19:13:20 user nova-compute[73917]:   <os>
Aug 26 19:13:20 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:13:20 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:13:20 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:13:20 user nova-compute[73917]:   </os>
Aug 26 19:13:20 user nova-compute[73917]:   <features>
Aug 26 19:13:20 user nova-compute[73917]:     <acpi/>
Aug 26 19:13:20 user nova-compute[73917]:     <apic/>
Aug 26 19:13:20 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:13:20 user nova-compute[73917]:   </features>
Aug 26 19:13:20 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:13:20 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:13:20 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:13:20 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:13:20 user nova-compute[73917]:   </clock>
Aug 26 19:13:20 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:13:20 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:13:20 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:13:20 user nova-compute[73917]:   </cpu>
Aug 26 19:13:20 user nova-compute[73917]:   <devices>
Aug 26 19:13:20 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:13:20 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:13:20 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk"/>
Aug 26 19:13:20 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:13:20 user nova-compute[73917]:     </disk>
Aug 26 19:13:20 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:13:20 user nova-compute[73917]:       <mac address="fa:16:3e:dd:b4:69"/>
Aug 26 19:13:20 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:13:20 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:13:20 user nova-compute[73917]:       <target dev="tapa3c97057-1f"/>
Aug 26 19:13:20 user nova-compute[73917]:     </interface>
Aug 26 19:13:20 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:13:20 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/console.log" append="off"/>
Aug 26 19:13:20 user nova-compute[73917]:     </serial>
Aug 26 19:13:20 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:13:20 user nova-compute[73917]:     <video>
Aug 26 19:13:20 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:13:20 user nova-compute[73917]:     </video>
Aug 26 19:13:20 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:13:20 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:13:20 user nova-compute[73917]:     </rng>
Aug 26 19:13:20 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:13:20 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:13:20 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:13:20 user nova-compute[73917]:     </memballoon>
Aug 26 19:13:20 user nova-compute[73917]:   </devices>
Aug 26 19:13:20 user nova-compute[73917]: </domain>
Aug 26 19:13:20 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1875469590',display_name='tempest-VolumesAdminNegativeTest-server-1875469590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1875469590',id=20,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbjm7JS4q/8toEgXFvtecKsTaTn6+0tO+zq53jbF0asEVsqn8iNixnaqsykdR3I/9JMwF8lXGApzEWMk97vzNvwu0lksZWsZBCC5GLvrZ0yPI8mvhBOD/F9QHvU2MLJCw==',key_name='tempest-keypair-741700897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5f7803cd6f44ed19fe59bd7286b6498',ramdisk_id='',reservation_id='r-unwj6nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-13801866',owner_user_name='tempest-VolumesAdminNegativeTest-13801866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:13:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4db077369ef04a9eb5c0654b96550468',uuid=f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "address": "fa:16:3e:dd:b4:69", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c97057-1f", "ovs_interfaceid": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Converting VIF {"id": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "address": "fa:16:3e:dd:b4:69", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c97057-1f", "ovs_interfaceid": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b4:69,bridge_name='br-int',has_traffic_filtering=True,id=a3c97057-1f39-49d8-9f1b-d0f2deea9357,network=Network(7da3a70d-3593-4f44-8572-3ae03e3cf9c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c97057-1f') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG os_vif [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b4:69,bridge_name='br-int',has_traffic_filtering=True,id=a3c97057-1f39-49d8-9f1b-d0f2deea9357,network=Network(7da3a70d-3593-4f44-8572-3ae03e3cf9c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c97057-1f') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3c97057-1f, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa3c97057-1f, col_values=(('external_ids', {'iface-id': 'a3c97057-1f39-49d8-9f1b-d0f2deea9357', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:b4:69', 'vm-uuid': 'f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:20 user nova-compute[73917]: INFO os_vif [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b4:69,bridge_name='br-int',has_traffic_filtering=True,id=a3c97057-1f39-49d8-9f1b-d0f2deea9357,network=Network(7da3a70d-3593-4f44-8572-3ae03e3cf9c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c97057-1f')
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] No VIF found with MAC fa:16:3e:dd:b4:69, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:13:20 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Creating image(s)
Aug 26 19:13:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "/opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "/opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.compute.manager [req-81feb5a4-c76d-4374-98a6-1d4afa4ac4c1 req-96278f3f-08f7-4840-8e0f-5febf6734bf2 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received event network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-81feb5a4-c76d-4374-98a6-1d4afa4ac4c1 req-96278f3f-08f7-4840-8e0f-5febf6734bf2 service nova] Acquiring lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-81feb5a4-c76d-4374-98a6-1d4afa4ac4c1 req-96278f3f-08f7-4840-8e0f-5febf6734bf2 service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-81feb5a4-c76d-4374-98a6-1d4afa4ac4c1 req-96278f3f-08f7-4840-8e0f-5febf6734bf2 service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.compute.manager [req-81feb5a4-c76d-4374-98a6-1d4afa4ac4c1 req-96278f3f-08f7-4840-8e0f-5febf6734bf2 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] No waiting events found dispatching network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:20 user nova-compute[73917]: WARNING nova.compute.manager [req-81feb5a4-c76d-4374-98a6-1d4afa4ac4c1 req-96278f3f-08f7-4840-8e0f-5febf6734bf2 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received unexpected event network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 for instance with vm_state building and task_state spawning.
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.compute.manager [req-81feb5a4-c76d-4374-98a6-1d4afa4ac4c1 req-96278f3f-08f7-4840-8e0f-5febf6734bf2 service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Received event network-changed-a3c97057-1f39-49d8-9f1b-d0f2deea9357 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.compute.manager [req-81feb5a4-c76d-4374-98a6-1d4afa4ac4c1 req-96278f3f-08f7-4840-8e0f-5febf6734bf2 service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Refreshing instance network info cache due to event network-changed-a3c97057-1f39-49d8-9f1b-d0f2deea9357. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-81feb5a4-c76d-4374-98a6-1d4afa4ac4c1 req-96278f3f-08f7-4840-8e0f-5febf6734bf2 service nova] Acquiring lock "refresh_cache-f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-81feb5a4-c76d-4374-98a6-1d4afa4ac4c1 req-96278f3f-08f7-4840-8e0f-5febf6734bf2 service nova] Acquired lock "refresh_cache-f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:13:20 user nova-compute[73917]: DEBUG nova.network.neutron [req-81feb5a4-c76d-4374-98a6-1d4afa4ac4c1 req-96278f3f-08f7-4840-8e0f-5febf6734bf2 service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Refreshing network info cache for port a3c97057-1f39-49d8-9f1b-d0f2deea9357 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.225s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.221s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk 1073741824" returned: 0 in 0.063s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.168s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.network.neutron [req-81feb5a4-c76d-4374-98a6-1d4afa4ac4c1 req-96278f3f-08f7-4840-8e0f-5febf6734bf2 service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Updated VIF entry in instance network info cache for port a3c97057-1f39-49d8-9f1b-d0f2deea9357. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.network.neutron [req-81feb5a4-c76d-4374-98a6-1d4afa4ac4c1 req-96278f3f-08f7-4840-8e0f-5febf6734bf2 service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Updating instance_info_cache with network_info: [{"id": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "address": "fa:16:3e:dd:b4:69", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c97057-1f", "ovs_interfaceid": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-81feb5a4-c76d-4374-98a6-1d4afa4ac4c1 req-96278f3f-08f7-4840-8e0f-5febf6734bf2 service nova] Releasing lock "refresh_cache-f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-81feb5a4-c76d-4374-98a6-1d4afa4ac4c1 req-96278f3f-08f7-4840-8e0f-5febf6734bf2 service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Received event network-vif-plugged-895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-81feb5a4-c76d-4374-98a6-1d4afa4ac4c1 req-96278f3f-08f7-4840-8e0f-5febf6734bf2 service nova] Acquiring lock "08ecabd0-f539-4068-9150-74e873809133-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-81feb5a4-c76d-4374-98a6-1d4afa4ac4c1 req-96278f3f-08f7-4840-8e0f-5febf6734bf2 service nova] Lock "08ecabd0-f539-4068-9150-74e873809133-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-81feb5a4-c76d-4374-98a6-1d4afa4ac4c1 req-96278f3f-08f7-4840-8e0f-5febf6734bf2 service nova] Lock "08ecabd0-f539-4068-9150-74e873809133-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-81feb5a4-c76d-4374-98a6-1d4afa4ac4c1 req-96278f3f-08f7-4840-8e0f-5febf6734bf2 service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] No waiting events found dispatching network-vif-plugged-895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:21 user nova-compute[73917]: WARNING nova.compute.manager [req-81feb5a4-c76d-4374-98a6-1d4afa4ac4c1 req-96278f3f-08f7-4840-8e0f-5febf6734bf2 service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Received unexpected event network-vif-plugged-895c0971-95b8-490f-95b5-386c50ba29c8 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Cannot resize image /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Ensure instance console log exists: /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Start _get_guest_xml network_info=[{"id": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "address": "fa:16:3e:ee:57:64", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf9dd57-b9", "ovs_interfaceid": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeLCvVUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c4218678-e287-4f07-8af1-59469bbcd6bd', 'attached_at': '', 'detached_at': '', 'volume_id': '0c50da8f-60da-4a1a-8ba9-b0202b97349a', 'serial': '0c50da8f-60da-4a1a-8ba9-b0202b97349a'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': 'ca72464f-b44f-4a1f-8c20-393c78b3c061', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:13:21 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 19:13:21 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.objects.instance [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lazy-loading 'vcpu_model' on Instance uuid c4218678-e287-4f07-8af1-59469bbcd6bd {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeLCvVUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:13:21 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 19:13:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:13:21 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 19:13:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:13:21 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e348ba-78cb-4006-8f61-45943f441624]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:13:21 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81fc9dd-fd98-4c46-a911-4dd1d07e7971]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a] added
Aug 26 19:13:21 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f68660f-630f-4a0e-8d75-6248e7075bad]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ece4cc3-b6be-4da9-8540-61ccc9eaedec]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HeLCvVUj {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HeLCvVUj" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[da16e359-570c-4036-9012-c8ee1fee7d61]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HeLCvVUj'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab21f803-817f-4d5c-bfbc-8f3c3d472da0]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd93d9e-5356-4ca3-a753-9fd5d584d551]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:13:21 user nova-compute[73917]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:13:21 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:13:21 user nova-compute[73917]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:13:21 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:13:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f35863-53c5-4418-ade5-2ebfc486b653]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a, portal: 172.16.0.220,3260]
Aug 26 19:13:22 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a, portal: 172.16.0.220,3260] successful.
Aug 26 19:13:22 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.050s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb893a9-faf1-4e73-8143-ddb25aa2fe70]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.055s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6663dcf-414e-4bd2-87a0-4f3b2299ed3e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:13:22 user nova-compute[73917]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:13:22 user nova-compute[73917]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)
Aug 26 19:13:22 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:13:22 user nova-compute[73917]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:13:22 user nova-compute[73917]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)
Aug 26 19:13:22 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9721b0bb-515e-431f-abea-3a36da28cfbd]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeLCvVUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077202.4111836, dca28d65-37d0-4b60-b8aa-dcca61b6a187 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:13:22 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] VM Resumed (Lifecycle Event)
Aug 26 19:13:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:13:22 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Instance spawned successfully.
Aug 26 19:13:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:13:22 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:13:22 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077202.4237702, dca28d65-37d0-4b60-b8aa-dcca61b6a187 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:13:22 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] VM Started (Lifecycle Event)
Aug 26 19:13:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:13:22 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:13:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-af99e45c-0d22-4a75-ad5f-fca60c9f827e req-cd7868d3-a735-404d-adca-f271b0e690a0 service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Received event network-vif-plugged-a3c97057-1f39-49d8-9f1b-d0f2deea9357 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-af99e45c-0d22-4a75-ad5f-fca60c9f827e req-cd7868d3-a735-404d-adca-f271b0e690a0 service nova] Acquiring lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-af99e45c-0d22-4a75-ad5f-fca60c9f827e req-cd7868d3-a735-404d-adca-f271b0e690a0 service nova] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-af99e45c-0d22-4a75-ad5f-fca60c9f827e req-cd7868d3-a735-404d-adca-f271b0e690a0 service nova] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-af99e45c-0d22-4a75-ad5f-fca60c9f827e req-cd7868d3-a735-404d-adca-f271b0e690a0 service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] No waiting events found dispatching network-vif-plugged-a3c97057-1f39-49d8-9f1b-d0f2deea9357 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:22 user nova-compute[73917]: WARNING nova.compute.manager [req-af99e45c-0d22-4a75-ad5f-fca60c9f827e req-cd7868d3-a735-404d-adca-f271b0e690a0 service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Received unexpected event network-vif-plugged-a3c97057-1f39-49d8-9f1b-d0f2deea9357 for instance with vm_state building and task_state spawning.
Aug 26 19:13:22 user nova-compute[73917]: INFO nova.compute.manager [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Took 9.36 seconds to spawn the instance on the hypervisor.
Aug 26 19:13:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:22 user nova-compute[73917]: INFO nova.compute.manager [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Took 10.57 seconds to build instance.
Aug 26 19:13:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f9999e-3a6d-4562-bf84-3899f95bc9b7 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.713s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-327d5606-3f77-409e-ba4f-d521f4b8a955 req-389aa06e-84e5-4f4c-bc62-98570ec36040 service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Received event network-vif-plugged-895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-327d5606-3f77-409e-ba4f-d521f4b8a955 req-389aa06e-84e5-4f4c-bc62-98570ec36040 service nova] Acquiring lock "08ecabd0-f539-4068-9150-74e873809133-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-327d5606-3f77-409e-ba4f-d521f4b8a955 req-389aa06e-84e5-4f4c-bc62-98570ec36040 service nova] Lock "08ecabd0-f539-4068-9150-74e873809133-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-327d5606-3f77-409e-ba4f-d521f4b8a955 req-389aa06e-84e5-4f4c-bc62-98570ec36040 service nova] Lock "08ecabd0-f539-4068-9150-74e873809133-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-327d5606-3f77-409e-ba4f-d521f4b8a955 req-389aa06e-84e5-4f4c-bc62-98570ec36040 service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] No waiting events found dispatching network-vif-plugged-895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:23 user nova-compute[73917]: WARNING nova.compute.manager [req-327d5606-3f77-409e-ba4f-d521f4b8a955 req-389aa06e-84e5-4f4c-bc62-98570ec36040 service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Received unexpected event network-vif-plugged-895c0971-95b8-490f-95b5-386c50ba29c8 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 19:13:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '26661316666653631', 'path': '/dev/sdc'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661316666653631', 'path': '/dev/sdc'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T19:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-843239325',display_name='tempest-ServerActionsTestOtherA-server-628875920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-843239325',id=16,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOklNSOL9r1q/zNv/+3lsUzJeS13Yy6booypQqav1LdRa4o4bUXxStD8Zbc/LQrFJOxHm0LxGHgW2WZ+4aH+DXEkJob/ZjlhQDrC3ATS52MugxelqEnl2LwwmyLXCgc3bw==',key_name='tempest-keypair-258176439',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:10:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2e09fe7b38e4bb991bfaaf5b4ad357a',ramdisk_id='',reservation_id='r-cn28ztmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2069094918',owner_user_name='tempest-ServerActionsTestOtherA-2069094918-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:13:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd1b7d3fe22c4b239cf03235866e17d4',uuid=c4218678-e287-4f07-8af1-59469bbcd6bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "address": "fa:16:3e:ee:57:64", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf9dd57-b9", "ovs_interfaceid": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converting VIF {"id": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "address": "fa:16:3e:ee:57:64", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf9dd57-b9", "ovs_interfaceid": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:57:64,bridge_name='br-int',has_traffic_filtering=True,id=faf9dd57-b9f3-4eec-af4d-b95205ffea78,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf9dd57-b9') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:13:23 user nova-compute[73917]:   <uuid>c4218678-e287-4f07-8af1-59469bbcd6bd</uuid>
Aug 26 19:13:23 user nova-compute[73917]:   <name>instance-00000010</name>
Aug 26 19:13:23 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:13:23 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:13:23 user nova-compute[73917]:   <metadata>
Aug 26 19:13:23 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:13:23 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:13:23 user nova-compute[73917]:       <nova:name>tempest-ServerActionsTestOtherA-server-628875920</nova:name>
Aug 26 19:13:23 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:13:21</nova:creationTime>
Aug 26 19:13:23 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:13:23 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:13:23 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:13:23 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:13:23 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:13:23 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:13:23 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:13:23 user nova-compute[73917]:       <nova:owner>
Aug 26 19:13:23 user nova-compute[73917]:         <nova:user uuid="cd1b7d3fe22c4b239cf03235866e17d4">tempest-ServerActionsTestOtherA-2069094918-project-member</nova:user>
Aug 26 19:13:23 user nova-compute[73917]:         <nova:project uuid="c2e09fe7b38e4bb991bfaaf5b4ad357a">tempest-ServerActionsTestOtherA-2069094918</nova:project>
Aug 26 19:13:23 user nova-compute[73917]:       </nova:owner>
Aug 26 19:13:23 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:13:23 user nova-compute[73917]:       <nova:ports>
Aug 26 19:13:23 user nova-compute[73917]:         <nova:port uuid="faf9dd57-b9f3-4eec-af4d-b95205ffea78">
Aug 26 19:13:23 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 19:13:23 user nova-compute[73917]:         </nova:port>
Aug 26 19:13:23 user nova-compute[73917]:       </nova:ports>
Aug 26 19:13:23 user nova-compute[73917]:     </nova:instance>
Aug 26 19:13:23 user nova-compute[73917]:   </metadata>
Aug 26 19:13:23 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:13:23 user nova-compute[73917]:     <system>
Aug 26 19:13:23 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:13:23 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:13:23 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:13:23 user nova-compute[73917]:       <entry name="serial">c4218678-e287-4f07-8af1-59469bbcd6bd</entry>
Aug 26 19:13:23 user nova-compute[73917]:       <entry name="uuid">c4218678-e287-4f07-8af1-59469bbcd6bd</entry>
Aug 26 19:13:23 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:13:23 user nova-compute[73917]:     </system>
Aug 26 19:13:23 user nova-compute[73917]:   </sysinfo>
Aug 26 19:13:23 user nova-compute[73917]:   <os>
Aug 26 19:13:23 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:13:23 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:13:23 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:13:23 user nova-compute[73917]:   </os>
Aug 26 19:13:23 user nova-compute[73917]:   <features>
Aug 26 19:13:23 user nova-compute[73917]:     <acpi/>
Aug 26 19:13:23 user nova-compute[73917]:     <apic/>
Aug 26 19:13:23 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:13:23 user nova-compute[73917]:   </features>
Aug 26 19:13:23 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:13:23 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:13:23 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:13:23 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:13:23 user nova-compute[73917]:   </clock>
Aug 26 19:13:23 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:13:23 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:13:23 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:13:23 user nova-compute[73917]:   </cpu>
Aug 26 19:13:23 user nova-compute[73917]:   <devices>
Aug 26 19:13:23 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:13:23 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:13:23 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk"/>
Aug 26 19:13:23 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:13:23 user nova-compute[73917]:     </disk>
Aug 26 19:13:23 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:13:23 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:13:23 user nova-compute[73917]:       <source dev="/dev/sdc"/>
Aug 26 19:13:23 user nova-compute[73917]:       <target dev="vdb" bus="virtio"/>
Aug 26 19:13:23 user nova-compute[73917]:       <serial>0c50da8f-60da-4a1a-8ba9-b0202b97349a</serial>
Aug 26 19:13:23 user nova-compute[73917]:     </disk>
Aug 26 19:13:23 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:13:23 user nova-compute[73917]:       <mac address="fa:16:3e:ee:57:64"/>
Aug 26 19:13:23 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:13:23 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:13:23 user nova-compute[73917]:       <target dev="tapfaf9dd57-b9"/>
Aug 26 19:13:23 user nova-compute[73917]:     </interface>
Aug 26 19:13:23 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:13:23 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/console.log" append="off"/>
Aug 26 19:13:23 user nova-compute[73917]:     </serial>
Aug 26 19:13:23 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:13:23 user nova-compute[73917]:     <video>
Aug 26 19:13:23 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:13:23 user nova-compute[73917]:     </video>
Aug 26 19:13:23 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:13:23 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:13:23 user nova-compute[73917]:     </rng>
Aug 26 19:13:23 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:13:23 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:13:23 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:13:23 user nova-compute[73917]:     </memballoon>
Aug 26 19:13:23 user nova-compute[73917]:   </devices>
Aug 26 19:13:23 user nova-compute[73917]: </domain>
Aug 26 19:13:23 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T19:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-843239325',display_name='tempest-ServerActionsTestOtherA-server-628875920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-843239325',id=16,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOklNSOL9r1q/zNv/+3lsUzJeS13Yy6booypQqav1LdRa4o4bUXxStD8Zbc/LQrFJOxHm0LxGHgW2WZ+4aH+DXEkJob/ZjlhQDrC3ATS52MugxelqEnl2LwwmyLXCgc3bw==',key_name='tempest-keypair-258176439',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:10:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2e09fe7b38e4bb991bfaaf5b4ad357a',ramdisk_id='',reservation_id='r-cn28ztmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2069094918',owner_user_name='tempest-ServerActionsTestOtherA-2069094918-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:13:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd1b7d3fe22c4b239cf03235866e17d4',uuid=c4218678-e287-4f07-8af1-59469bbcd6bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "address": "fa:16:3e:ee:57:64", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf9dd57-b9", "ovs_interfaceid": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converting VIF {"id": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "address": "fa:16:3e:ee:57:64", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf9dd57-b9", "ovs_interfaceid": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:57:64,bridge_name='br-int',has_traffic_filtering=True,id=faf9dd57-b9f3-4eec-af4d-b95205ffea78,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf9dd57-b9') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG os_vif [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:57:64,bridge_name='br-int',has_traffic_filtering=True,id=faf9dd57-b9f3-4eec-af4d-b95205ffea78,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf9dd57-b9') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfaf9dd57-b9, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfaf9dd57-b9, col_values=(('external_ids', {'iface-id': 'faf9dd57-b9f3-4eec-af4d-b95205ffea78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:57:64', 'vm-uuid': 'c4218678-e287-4f07-8af1-59469bbcd6bd'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:23 user nova-compute[73917]: INFO os_vif [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:57:64,bridge_name='br-int',has_traffic_filtering=True,id=faf9dd57-b9f3-4eec-af4d-b95205ffea78,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf9dd57-b9')
Aug 26 19:13:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:13:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] No VIF found with MAC fa:16:3e:ee:57:64, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077204.178438, 08ecabd0-f539-4068-9150-74e873809133 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:13:24 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 08ecabd0-f539-4068-9150-74e873809133] VM Resumed (Lifecycle Event)
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:13:24 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 08ecabd0-f539-4068-9150-74e873809133] Instance spawned successfully.
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 08ecabd0-f539-4068-9150-74e873809133] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 08ecabd0-f539-4068-9150-74e873809133] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:24 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 08ecabd0-f539-4068-9150-74e873809133] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077204.184601, 08ecabd0-f539-4068-9150-74e873809133 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:13:24 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 08ecabd0-f539-4068-9150-74e873809133] VM Started (Lifecycle Event)
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 08ecabd0-f539-4068-9150-74e873809133] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 08ecabd0-f539-4068-9150-74e873809133] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:13:24 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 08ecabd0-f539-4068-9150-74e873809133] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.objects.instance [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73917) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077189.673061, fdfb377e-119e-41ce-b9e0-6e21053306cc => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:13:24 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] VM Stopped (Lifecycle Event)
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-24413aed-b716-4f36-a216-2d7f437b3add req-be70fb55-586d-41eb-b792-7eaff884f386 service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Received event network-vif-plugged-a3c97057-1f39-49d8-9f1b-d0f2deea9357 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-24413aed-b716-4f36-a216-2d7f437b3add req-be70fb55-586d-41eb-b792-7eaff884f386 service nova] Acquiring lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-24413aed-b716-4f36-a216-2d7f437b3add req-be70fb55-586d-41eb-b792-7eaff884f386 service nova] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-24413aed-b716-4f36-a216-2d7f437b3add req-be70fb55-586d-41eb-b792-7eaff884f386 service nova] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-24413aed-b716-4f36-a216-2d7f437b3add req-be70fb55-586d-41eb-b792-7eaff884f386 service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] No waiting events found dispatching network-vif-plugged-a3c97057-1f39-49d8-9f1b-d0f2deea9357 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:24 user nova-compute[73917]: WARNING nova.compute.manager [req-24413aed-b716-4f36-a216-2d7f437b3add req-be70fb55-586d-41eb-b792-7eaff884f386 service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Received unexpected event network-vif-plugged-a3c97057-1f39-49d8-9f1b-d0f2deea9357 for instance with vm_state building and task_state spawning.
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1fc9ce0b-c7f2-4e38-9a5a-3b0262cc2083 None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-42dd03ee-6641-446c-aa69-7ddd3151e8cb tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.266s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1fc9ce0b-c7f2-4e38-9a5a-3b0262cc2083 None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:13:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:13:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:13:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:25 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077205.084843, f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:13:25 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] VM Resumed (Lifecycle Event)
Aug 26 19:13:25 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Instance spawned successfully.
Aug 26 19:13:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:13:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:13:25 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:13:25 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077205.0850174, f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:13:25 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] VM Started (Lifecycle Event)
Aug 26 19:13:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:13:25 user nova-compute[73917]: INFO nova.compute.manager [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Took 7.65 seconds to spawn the instance on the hypervisor.
Aug 26 19:13:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:25 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:13:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:25 user nova-compute[73917]: INFO nova.compute.manager [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Took 8.85 seconds to build instance.
Aug 26 19:13:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a097bd58-cd60-4f38-a5c7-20d311ccd390 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.980s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-c1744b30-f78e-418f-a8f9-3ca9b7c66b77 req-f5bf5dea-8f7c-4f4d-b3ae-96a5d7f95899 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Received event network-vif-plugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c1744b30-f78e-418f-a8f9-3ca9b7c66b77 req-f5bf5dea-8f7c-4f4d-b3ae-96a5d7f95899 service nova] Acquiring lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c1744b30-f78e-418f-a8f9-3ca9b7c66b77 req-f5bf5dea-8f7c-4f4d-b3ae-96a5d7f95899 service nova] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c1744b30-f78e-418f-a8f9-3ca9b7c66b77 req-f5bf5dea-8f7c-4f4d-b3ae-96a5d7f95899 service nova] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-c1744b30-f78e-418f-a8f9-3ca9b7c66b77 req-f5bf5dea-8f7c-4f4d-b3ae-96a5d7f95899 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] No waiting events found dispatching network-vif-plugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:26 user nova-compute[73917]: WARNING nova.compute.manager [req-c1744b30-f78e-418f-a8f9-3ca9b7c66b77 req-f5bf5dea-8f7c-4f4d-b3ae-96a5d7f95899 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Received unexpected event network-vif-plugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 19:13:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-c1744b30-f78e-418f-a8f9-3ca9b7c66b77 req-f5bf5dea-8f7c-4f4d-b3ae-96a5d7f95899 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Received event network-vif-plugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c1744b30-f78e-418f-a8f9-3ca9b7c66b77 req-f5bf5dea-8f7c-4f4d-b3ae-96a5d7f95899 service nova] Acquiring lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c1744b30-f78e-418f-a8f9-3ca9b7c66b77 req-f5bf5dea-8f7c-4f4d-b3ae-96a5d7f95899 service nova] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c1744b30-f78e-418f-a8f9-3ca9b7c66b77 req-f5bf5dea-8f7c-4f4d-b3ae-96a5d7f95899 service nova] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-c1744b30-f78e-418f-a8f9-3ca9b7c66b77 req-f5bf5dea-8f7c-4f4d-b3ae-96a5d7f95899 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] No waiting events found dispatching network-vif-plugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:26 user nova-compute[73917]: WARNING nova.compute.manager [req-c1744b30-f78e-418f-a8f9-3ca9b7c66b77 req-f5bf5dea-8f7c-4f4d-b3ae-96a5d7f95899 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Received unexpected event network-vif-plugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 19:13:27 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077207.7601016, c4218678-e287-4f07-8af1-59469bbcd6bd => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:13:27 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] VM Resumed (Lifecycle Event)
Aug 26 19:13:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:13:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:13:27 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Instance spawned successfully.
Aug 26 19:13:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:13:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:13:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:27 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 19:13:27 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077207.7604282, c4218678-e287-4f07-8af1-59469bbcd6bd => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:13:27 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] VM Started (Lifecycle Event)
Aug 26 19:13:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:13:27 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 19:13:28 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:28 user nova-compute[73917]: DEBUG nova.objects.instance [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73917) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 19:13:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d80efb3c-2990-4517-be48-d78771e0a654 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.092s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:35 user nova-compute[73917]: INFO nova.compute.manager [None req-a5236f02-4843-4902-acb9-58e328dc81e6 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Unrescuing
Aug 26 19:13:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a5236f02-4843-4902-acb9-58e328dc81e6 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:13:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a5236f02-4843-4902-acb9-58e328dc81e6 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquired lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:13:35 user nova-compute[73917]: DEBUG nova.network.neutron [None req-a5236f02-4843-4902-acb9-58e328dc81e6 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:13:36 user nova-compute[73917]: DEBUG nova.network.neutron [None req-a5236f02-4843-4902-acb9-58e328dc81e6 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Updating instance_info_cache with network_info: [{"id": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "address": "fa:16:3e:89:79:8b", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8ac63b-61", "ovs_interfaceid": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:13:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a5236f02-4843-4902-acb9-58e328dc81e6 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Releasing lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:13:36 user nova-compute[73917]: DEBUG nova.objects.instance [None req-a5236f02-4843-4902-acb9-58e328dc81e6 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'flavor' on Instance uuid cc0ae046-2a39-4ab6-9327-2d9452c3035d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:13:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-1c29fbe7-bcc8-42e7-889b-2f4f3f4a2e9b req-d2347020-b181-419b-8f15-327832f2f264 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received event network-vif-unplugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1c29fbe7-bcc8-42e7-889b-2f4f3f4a2e9b req-d2347020-b181-419b-8f15-327832f2f264 service nova] Acquiring lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1c29fbe7-bcc8-42e7-889b-2f4f3f4a2e9b req-d2347020-b181-419b-8f15-327832f2f264 service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1c29fbe7-bcc8-42e7-889b-2f4f3f4a2e9b req-d2347020-b181-419b-8f15-327832f2f264 service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-1c29fbe7-bcc8-42e7-889b-2f4f3f4a2e9b req-d2347020-b181-419b-8f15-327832f2f264 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] No waiting events found dispatching network-vif-unplugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:36 user nova-compute[73917]: WARNING nova.compute.manager [req-1c29fbe7-bcc8-42e7-889b-2f4f3f4a2e9b req-d2347020-b181-419b-8f15-327832f2f264 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received unexpected event network-vif-unplugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:13:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:36 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Instance destroyed successfully.
Aug 26 19:13:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:38 user nova-compute[73917]: DEBUG nova.compute.manager [req-3c902dc1-70dc-4784-b726-d7f3de38ad85 req-240562a7-11c8-48fa-ae42-7958163b55f8 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received event network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3c902dc1-70dc-4784-b726-d7f3de38ad85 req-240562a7-11c8-48fa-ae42-7958163b55f8 service nova] Acquiring lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3c902dc1-70dc-4784-b726-d7f3de38ad85 req-240562a7-11c8-48fa-ae42-7958163b55f8 service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3c902dc1-70dc-4784-b726-d7f3de38ad85 req-240562a7-11c8-48fa-ae42-7958163b55f8 service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:38 user nova-compute[73917]: DEBUG nova.compute.manager [req-3c902dc1-70dc-4784-b726-d7f3de38ad85 req-240562a7-11c8-48fa-ae42-7958163b55f8 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] No waiting events found dispatching network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:38 user nova-compute[73917]: WARNING nova.compute.manager [req-3c902dc1-70dc-4784-b726-d7f3de38ad85 req-240562a7-11c8-48fa-ae42-7958163b55f8 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received unexpected event network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:13:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:40 user nova-compute[73917]: DEBUG nova.compute.manager [req-f8cf03cd-6aed-46d0-b735-c1db86d2158a req-82e67f9a-cf53-40f8-9ea6-291e76a752b6 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received event network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f8cf03cd-6aed-46d0-b735-c1db86d2158a req-82e67f9a-cf53-40f8-9ea6-291e76a752b6 service nova] Acquiring lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f8cf03cd-6aed-46d0-b735-c1db86d2158a req-82e67f9a-cf53-40f8-9ea6-291e76a752b6 service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f8cf03cd-6aed-46d0-b735-c1db86d2158a req-82e67f9a-cf53-40f8-9ea6-291e76a752b6 service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:40 user nova-compute[73917]: DEBUG nova.compute.manager [req-f8cf03cd-6aed-46d0-b735-c1db86d2158a req-82e67f9a-cf53-40f8-9ea6-291e76a752b6 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] No waiting events found dispatching network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:40 user nova-compute[73917]: WARNING nova.compute.manager [req-f8cf03cd-6aed-46d0-b735-c1db86d2158a req-82e67f9a-cf53-40f8-9ea6-291e76a752b6 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received unexpected event network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:13:40 user nova-compute[73917]: DEBUG nova.compute.manager [req-f8cf03cd-6aed-46d0-b735-c1db86d2158a req-82e67f9a-cf53-40f8-9ea6-291e76a752b6 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received event network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f8cf03cd-6aed-46d0-b735-c1db86d2158a req-82e67f9a-cf53-40f8-9ea6-291e76a752b6 service nova] Acquiring lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f8cf03cd-6aed-46d0-b735-c1db86d2158a req-82e67f9a-cf53-40f8-9ea6-291e76a752b6 service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f8cf03cd-6aed-46d0-b735-c1db86d2158a req-82e67f9a-cf53-40f8-9ea6-291e76a752b6 service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:40 user nova-compute[73917]: DEBUG nova.compute.manager [req-f8cf03cd-6aed-46d0-b735-c1db86d2158a req-82e67f9a-cf53-40f8-9ea6-291e76a752b6 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] No waiting events found dispatching network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:40 user nova-compute[73917]: WARNING nova.compute.manager [req-f8cf03cd-6aed-46d0-b735-c1db86d2158a req-82e67f9a-cf53-40f8-9ea6-291e76a752b6 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received unexpected event network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:13:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Removed pending event for cc0ae046-2a39-4ab6-9327-2d9452c3035d due to event {{(pid=73917) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 19:13:41 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077221.3752813, cc0ae046-2a39-4ab6-9327-2d9452c3035d => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:13:41 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] VM Resumed (Lifecycle Event)
Aug 26 19:13:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-a5236f02-4843-4902-acb9-58e328dc81e6 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:13:41 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 19:13:41 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077221.3795266, cc0ae046-2a39-4ab6-9327-2d9452c3035d => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:13:41 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] VM Started (Lifecycle Event)
Aug 26 19:13:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:42 user nova-compute[73917]: INFO nova.compute.manager [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Detaching volume 1db76c5d-a93f-421a-a23d-797da93b388d
Aug 26 19:13:42 user nova-compute[73917]: INFO nova.virt.block_device [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Attempting to driver detach volume 1db76c5d-a93f-421a-a23d-797da93b388d from mountpoint /dev/vdb
Aug 26 19:13:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Attempting to detach device vdb from instance 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:13:42 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:13:42 user nova-compute[73917]:   <source dev="/dev/sdk"/>
Aug 26 19:13:42 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:13:42 user nova-compute[73917]:   <serial>1db76c5d-a93f-421a-a23d-797da93b388d</serial>
Aug 26 19:13:42 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:13:42 user nova-compute[73917]: </disk>
Aug 26 19:13:42 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:13:42 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Successfully detached device vdb from instance 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 from the persistent domain config.
Aug 26 19:13:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:13:42 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:13:42 user nova-compute[73917]:   <source dev="/dev/sdk"/>
Aug 26 19:13:42 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:13:42 user nova-compute[73917]:   <serial>1db76c5d-a93f-421a-a23d-797da93b388d</serial>
Aug 26 19:13:42 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:13:42 user nova-compute[73917]: </disk>
Aug 26 19:13:42 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693077222.6693377, 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:13:42 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Successfully detached device vdb from instance 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 from the live domain config.
Aug 26 19:13:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHCnuxqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:13:42 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:13:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd669f3f-11c1-495f-b234-5ff73e98a272]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b687cea-8a48-4915-a2be-3a19bee94d2c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:13:42 user nova-compute[73917]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:13:42 user nova-compute[73917]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)
Aug 26 19:13:42 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d (non-flash)
Aug 26 19:13:42 user nova-compute[73917]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:13:42 user nova-compute[73917]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)
Aug 26 19:13:42 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b7847beb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d'): ({'sdk'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Removing single pathed devices sdk {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b307f7-1d70-4051-99b0-0f3e5b0e7e7a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1741e0cc-cb88-4b3a-8c91-dcfd7ac4f5ce]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Flushing IO for device /dev/sdk {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4239d8d5-af00-4323-aa37-7a35e23f869d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.042s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b153c7f-e4d8-4b96-9aeb-cc2c84e3da2a]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] SCSI volumes sdk have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a244a7-e054-4c8b-ae36-e8f42ada8064]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09487ef-58df-40e7-b3cf-58220666d527]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d, portal: 172.16.0.220,3260]
Aug 26 19:13:42 user nova-compute[73917]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d, portal: 172.16.0.220,3260] successful.
Aug 26 19:13:42 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db76c5d-a93f-421a-a23d-797da93b388d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb64f2d-0c82-4fb4-8516-22684c96ad2e]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] <== disconnect_volume: return (299ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:13:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:13:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:43 user nova-compute[73917]: DEBUG nova.objects.instance [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lazy-loading 'flavor' on Instance uuid 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:13:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-65b333b2-9d1e-43aa-8a25-4800643f2e1b tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.892s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "9628e76c-a137-4499-96d7-5f6a30eb6dad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:48 user nova-compute[73917]: DEBUG nova.compute.manager [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:13:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:13:48 user nova-compute[73917]: INFO nova.compute.claims [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Claim successful on node user
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:13:49 user nova-compute[73917]: WARNING nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid cc0ae046-2a39-4ab6-9327-2d9452c3035d {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid fd801f18-34b6-4682-8d43-edf82bd216c2 {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid 1c12fdf0-17e7-438b-aa6c-729dd67676aa {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid 481cc682-2004-434d-b4eb-1688b0b07dd6 {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid 94f8d4e7-f310-45df-a0ae-82e608ac0119 {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid dca28d65-37d0-4b60-b8aa-dcca61b6a187 {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid 9628e76c-a137-4499-96d7-5f6a30eb6dad {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid 08ecabd0-f539-4068-9150-74e873809133 {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid c4218678-e287-4f07-8af1-59469bbcd6bd {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "fd801f18-34b6-4682-8d43-edf82bd216c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "481cc682-2004-434d-b4eb-1688b0b07dd6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "481cc682-2004-434d-b4eb-1688b0b07dd6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "94f8d4e7-f310-45df-a0ae-82e608ac0119" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "94f8d4e7-f310-45df-a0ae-82e608ac0119" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "9628e76c-a137-4499-96d7-5f6a30eb6dad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "08ecabd0-f539-4068-9150-74e873809133" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "08ecabd0-f539-4068-9150-74e873809133" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "c4218678-e287-4f07-8af1-59469bbcd6bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "94f8d4e7-f310-45df-a0ae-82e608ac0119" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "481cc682-2004-434d-b4eb-1688b0b07dd6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.146s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.156s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.157s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "08ecabd0-f539-4068-9150-74e873809133" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.173s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.664s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.network.neutron [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:13:49 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.policy [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c64a5d226b8b4d60af840d49315bf60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b291bbf9aedc4414a1ab402602849140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:13:49 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Creating image(s)
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "/opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "/opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "/opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.182s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.222s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk 1073741824" returned: 0 in 0.057s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:50 user nova-compute[73917]: DEBUG nova.network.neutron [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Successfully created port: 4c360957-8f3b-4887-8efb-74e42c75d777 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:13:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.198s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:50 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:13:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:50 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Cannot resize image /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:13:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:13:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Ensure instance console log exists: /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:13:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:51 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:13:51 user nova-compute[73917]: DEBUG nova.network.neutron [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Successfully updated port: 4c360957-8f3b-4887-8efb-74e42c75d777 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:13:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "refresh_cache-9628e76c-a137-4499-96d7-5f6a30eb6dad" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:13:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquired lock "refresh_cache-9628e76c-a137-4499-96d7-5f6a30eb6dad" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:13:51 user nova-compute[73917]: DEBUG nova.network.neutron [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:13:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-6e697d30-1f80-4f47-a82a-844e2d8bf008 req-b7e6bc25-0e4e-4eec-b9a1-6ac9ce87a838 service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Received event network-changed-4c360957-8f3b-4887-8efb-74e42c75d777 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-6e697d30-1f80-4f47-a82a-844e2d8bf008 req-b7e6bc25-0e4e-4eec-b9a1-6ac9ce87a838 service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Refreshing instance network info cache due to event network-changed-4c360957-8f3b-4887-8efb-74e42c75d777. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:13:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6e697d30-1f80-4f47-a82a-844e2d8bf008 req-b7e6bc25-0e4e-4eec-b9a1-6ac9ce87a838 service nova] Acquiring lock "refresh_cache-9628e76c-a137-4499-96d7-5f6a30eb6dad" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:13:51 user nova-compute[73917]: DEBUG nova.network.neutron [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.network.neutron [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Updating instance_info_cache with network_info: [{"id": "4c360957-8f3b-4887-8efb-74e42c75d777", "address": "fa:16:3e:ac:6b:52", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c360957-8f", "ovs_interfaceid": "4c360957-8f3b-4887-8efb-74e42c75d777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Releasing lock "refresh_cache-9628e76c-a137-4499-96d7-5f6a30eb6dad" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Instance network_info: |[{"id": "4c360957-8f3b-4887-8efb-74e42c75d777", "address": "fa:16:3e:ac:6b:52", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c360957-8f", "ovs_interfaceid": "4c360957-8f3b-4887-8efb-74e42c75d777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6e697d30-1f80-4f47-a82a-844e2d8bf008 req-b7e6bc25-0e4e-4eec-b9a1-6ac9ce87a838 service nova] Acquired lock "refresh_cache-9628e76c-a137-4499-96d7-5f6a30eb6dad" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.network.neutron [req-6e697d30-1f80-4f47-a82a-844e2d8bf008 req-b7e6bc25-0e4e-4eec-b9a1-6ac9ce87a838 service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Refreshing network info cache for port 4c360957-8f3b-4887-8efb-74e42c75d777 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Start _get_guest_xml network_info=[{"id": "4c360957-8f3b-4887-8efb-74e42c75d777", "address": "fa:16:3e:ac:6b:52", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c360957-8f", "ovs_interfaceid": "4c360957-8f3b-4887-8efb-74e42c75d777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:13:52 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:13:52 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:13:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1420235405',display_name='tempest-AttachVolumeNegativeTest-server-1420235405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1420235405',id=21,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1YpS+TXJKk4Vg5AorFwW+tnQUyrnWcOEEM698/15bFv55YCaGSj+tzNnthXg21SQiRfWjQ5YsX0zkYX+n9hocscdH0H67zFqD1X0Dfn3i99IIwk24tqVHGrS2Mzjw/RA==',key_name='tempest-keypair-501160362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b291bbf9aedc4414a1ab402602849140',ramdisk_id='',reservation_id='r-kid0ja94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2066333616',owner_user_name='tempest-AttachVolumeNegativeTest-2066333616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:13:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c64a5d226b8b4d60af840d49315bf60f',uuid=9628e76c-a137-4499-96d7-5f6a30eb6dad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c360957-8f3b-4887-8efb-74e42c75d777", "address": "fa:16:3e:ac:6b:52", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c360957-8f", "ovs_interfaceid": "4c360957-8f3b-4887-8efb-74e42c75d777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converting VIF {"id": "4c360957-8f3b-4887-8efb-74e42c75d777", "address": "fa:16:3e:ac:6b:52", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c360957-8f", "ovs_interfaceid": "4c360957-8f3b-4887-8efb-74e42c75d777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6b:52,bridge_name='br-int',has_traffic_filtering=True,id=4c360957-8f3b-4887-8efb-74e42c75d777,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c360957-8f') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.objects.instance [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lazy-loading 'pci_devices' on Instance uuid 9628e76c-a137-4499-96d7-5f6a30eb6dad {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:13:52 user nova-compute[73917]:   <uuid>9628e76c-a137-4499-96d7-5f6a30eb6dad</uuid>
Aug 26 19:13:52 user nova-compute[73917]:   <name>instance-00000015</name>
Aug 26 19:13:52 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:13:52 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:13:52 user nova-compute[73917]:   <metadata>
Aug 26 19:13:52 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:13:52 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:13:52 user nova-compute[73917]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1420235405</nova:name>
Aug 26 19:13:52 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:13:52</nova:creationTime>
Aug 26 19:13:52 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:13:52 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:13:52 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:13:52 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:13:52 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:13:52 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:13:52 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:13:52 user nova-compute[73917]:       <nova:owner>
Aug 26 19:13:52 user nova-compute[73917]:         <nova:user uuid="c64a5d226b8b4d60af840d49315bf60f">tempest-AttachVolumeNegativeTest-2066333616-project-member</nova:user>
Aug 26 19:13:52 user nova-compute[73917]:         <nova:project uuid="b291bbf9aedc4414a1ab402602849140">tempest-AttachVolumeNegativeTest-2066333616</nova:project>
Aug 26 19:13:52 user nova-compute[73917]:       </nova:owner>
Aug 26 19:13:52 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:13:52 user nova-compute[73917]:       <nova:ports>
Aug 26 19:13:52 user nova-compute[73917]:         <nova:port uuid="4c360957-8f3b-4887-8efb-74e42c75d777">
Aug 26 19:13:52 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 19:13:52 user nova-compute[73917]:         </nova:port>
Aug 26 19:13:52 user nova-compute[73917]:       </nova:ports>
Aug 26 19:13:52 user nova-compute[73917]:     </nova:instance>
Aug 26 19:13:52 user nova-compute[73917]:   </metadata>
Aug 26 19:13:52 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:13:52 user nova-compute[73917]:     <system>
Aug 26 19:13:52 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:13:52 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:13:52 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:13:52 user nova-compute[73917]:       <entry name="serial">9628e76c-a137-4499-96d7-5f6a30eb6dad</entry>
Aug 26 19:13:52 user nova-compute[73917]:       <entry name="uuid">9628e76c-a137-4499-96d7-5f6a30eb6dad</entry>
Aug 26 19:13:52 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:13:52 user nova-compute[73917]:     </system>
Aug 26 19:13:52 user nova-compute[73917]:   </sysinfo>
Aug 26 19:13:52 user nova-compute[73917]:   <os>
Aug 26 19:13:52 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:13:52 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:13:52 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:13:52 user nova-compute[73917]:   </os>
Aug 26 19:13:52 user nova-compute[73917]:   <features>
Aug 26 19:13:52 user nova-compute[73917]:     <acpi/>
Aug 26 19:13:52 user nova-compute[73917]:     <apic/>
Aug 26 19:13:52 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:13:52 user nova-compute[73917]:   </features>
Aug 26 19:13:52 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:13:52 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:13:52 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:13:52 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:13:52 user nova-compute[73917]:   </clock>
Aug 26 19:13:52 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:13:52 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:13:52 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:13:52 user nova-compute[73917]:   </cpu>
Aug 26 19:13:52 user nova-compute[73917]:   <devices>
Aug 26 19:13:52 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:13:52 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:13:52 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk"/>
Aug 26 19:13:52 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:13:52 user nova-compute[73917]:     </disk>
Aug 26 19:13:52 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:13:52 user nova-compute[73917]:       <mac address="fa:16:3e:ac:6b:52"/>
Aug 26 19:13:52 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:13:52 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:13:52 user nova-compute[73917]:       <target dev="tap4c360957-8f"/>
Aug 26 19:13:52 user nova-compute[73917]:     </interface>
Aug 26 19:13:52 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:13:52 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/console.log" append="off"/>
Aug 26 19:13:52 user nova-compute[73917]:     </serial>
Aug 26 19:13:52 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:13:52 user nova-compute[73917]:     <video>
Aug 26 19:13:52 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:13:52 user nova-compute[73917]:     </video>
Aug 26 19:13:52 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:13:52 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:13:52 user nova-compute[73917]:     </rng>
Aug 26 19:13:52 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:13:52 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:13:52 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:13:52 user nova-compute[73917]:     </memballoon>
Aug 26 19:13:52 user nova-compute[73917]:   </devices>
Aug 26 19:13:52 user nova-compute[73917]: </domain>
Aug 26 19:13:52 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:13:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1420235405',display_name='tempest-AttachVolumeNegativeTest-server-1420235405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1420235405',id=21,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1YpS+TXJKk4Vg5AorFwW+tnQUyrnWcOEEM698/15bFv55YCaGSj+tzNnthXg21SQiRfWjQ5YsX0zkYX+n9hocscdH0H67zFqD1X0Dfn3i99IIwk24tqVHGrS2Mzjw/RA==',key_name='tempest-keypair-501160362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b291bbf9aedc4414a1ab402602849140',ramdisk_id='',reservation_id='r-kid0ja94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2066333616',owner_user_name='tempest-AttachVolumeNegativeTest-2066333616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:13:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c64a5d226b8b4d60af840d49315bf60f',uuid=9628e76c-a137-4499-96d7-5f6a30eb6dad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c360957-8f3b-4887-8efb-74e42c75d777", "address": "fa:16:3e:ac:6b:52", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c360957-8f", "ovs_interfaceid": "4c360957-8f3b-4887-8efb-74e42c75d777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converting VIF {"id": "4c360957-8f3b-4887-8efb-74e42c75d777", "address": "fa:16:3e:ac:6b:52", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c360957-8f", "ovs_interfaceid": "4c360957-8f3b-4887-8efb-74e42c75d777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6b:52,bridge_name='br-int',has_traffic_filtering=True,id=4c360957-8f3b-4887-8efb-74e42c75d777,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c360957-8f') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG os_vif [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6b:52,bridge_name='br-int',has_traffic_filtering=True,id=4c360957-8f3b-4887-8efb-74e42c75d777,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c360957-8f') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c360957-8f, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c360957-8f, col_values=(('external_ids', {'iface-id': '4c360957-8f3b-4887-8efb-74e42c75d777', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:6b:52', 'vm-uuid': '9628e76c-a137-4499-96d7-5f6a30eb6dad'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:52 user nova-compute[73917]: INFO os_vif [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6b:52,bridge_name='br-int',has_traffic_filtering=True,id=4c360957-8f3b-4887-8efb-74e42c75d777,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c360957-8f')
Aug 26 19:13:52 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] No VIF found with MAC fa:16:3e:ac:6b:52, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Didn't find any instances for network info cache update. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.network.neutron [req-6e697d30-1f80-4f47-a82a-844e2d8bf008 req-b7e6bc25-0e4e-4eec-b9a1-6ac9ce87a838 service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Updated VIF entry in instance network info cache for port 4c360957-8f3b-4887-8efb-74e42c75d777. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG nova.network.neutron [req-6e697d30-1f80-4f47-a82a-844e2d8bf008 req-b7e6bc25-0e4e-4eec-b9a1-6ac9ce87a838 service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Updating instance_info_cache with network_info: [{"id": "4c360957-8f3b-4887-8efb-74e42c75d777", "address": "fa:16:3e:ac:6b:52", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c360957-8f", "ovs_interfaceid": "4c360957-8f3b-4887-8efb-74e42c75d777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:13:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6e697d30-1f80-4f47-a82a-844e2d8bf008 req-b7e6bc25-0e4e-4eec-b9a1-6ac9ce87a838 service nova] Releasing lock "refresh_cache-9628e76c-a137-4499-96d7-5f6a30eb6dad" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:13:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:54 user nova-compute[73917]: DEBUG nova.compute.manager [req-12566930-dbad-4226-a578-5b9580ba8131 req-18b2400c-4c83-45d8-9383-b7615976c7b1 service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Received event network-vif-plugged-4c360957-8f3b-4887-8efb-74e42c75d777 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-12566930-dbad-4226-a578-5b9580ba8131 req-18b2400c-4c83-45d8-9383-b7615976c7b1 service nova] Acquiring lock "9628e76c-a137-4499-96d7-5f6a30eb6dad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-12566930-dbad-4226-a578-5b9580ba8131 req-18b2400c-4c83-45d8-9383-b7615976c7b1 service nova] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-12566930-dbad-4226-a578-5b9580ba8131 req-18b2400c-4c83-45d8-9383-b7615976c7b1 service nova] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:54 user nova-compute[73917]: DEBUG nova.compute.manager [req-12566930-dbad-4226-a578-5b9580ba8131 req-18b2400c-4c83-45d8-9383-b7615976c7b1 service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] No waiting events found dispatching network-vif-plugged-4c360957-8f3b-4887-8efb-74e42c75d777 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:54 user nova-compute[73917]: WARNING nova.compute.manager [req-12566930-dbad-4226-a578-5b9580ba8131 req-18b2400c-4c83-45d8-9383-b7615976c7b1 service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Received unexpected event network-vif-plugged-4c360957-8f3b-4887-8efb-74e42c75d777 for instance with vm_state building and task_state spawning.
Aug 26 19:13:54 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:13:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:55 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:13:55 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:13:55 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:13:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:13:55 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:13:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:55 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:13:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG nova.compute.manager [req-b027c268-f2ff-45d3-99ad-a405c1f86f63 req-3e6b05e0-e0df-464c-9b3c-0802b0c1b06b service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Received event network-vif-plugged-4c360957-8f3b-4887-8efb-74e42c75d777 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b027c268-f2ff-45d3-99ad-a405c1f86f63 req-3e6b05e0-e0df-464c-9b3c-0802b0c1b06b service nova] Acquiring lock "9628e76c-a137-4499-96d7-5f6a30eb6dad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b027c268-f2ff-45d3-99ad-a405c1f86f63 req-3e6b05e0-e0df-464c-9b3c-0802b0c1b06b service nova] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b027c268-f2ff-45d3-99ad-a405c1f86f63 req-3e6b05e0-e0df-464c-9b3c-0802b0c1b06b service nova] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG nova.compute.manager [req-b027c268-f2ff-45d3-99ad-a405c1f86f63 req-3e6b05e0-e0df-464c-9b3c-0802b0c1b06b service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] No waiting events found dispatching network-vif-plugged-4c360957-8f3b-4887-8efb-74e42c75d777 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:13:56 user nova-compute[73917]: WARNING nova.compute.manager [req-b027c268-f2ff-45d3-99ad-a405c1f86f63 req-3e6b05e0-e0df-464c-9b3c-0802b0c1b06b service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Received unexpected event network-vif-plugged-4c360957-8f3b-4887-8efb-74e42c75d777 for instance with vm_state building and task_state spawning.
Aug 26 19:13:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077236.2557755, 9628e76c-a137-4499-96d7-5f6a30eb6dad => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:13:56 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] VM Resumed (Lifecycle Event)
Aug 26 19:13:56 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Instance spawned successfully.
Aug 26 19:13:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:56 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:13:56 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077236.2562099, 9628e76c-a137-4499-96d7-5f6a30eb6dad => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:13:56 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] VM Started (Lifecycle Event)
Aug 26 19:13:56 user nova-compute[73917]: INFO nova.compute.manager [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Took 6.44 seconds to spawn the instance on the hypervisor.
Aug 26 19:13:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:13:56 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:13:56 user nova-compute[73917]: INFO nova.compute.manager [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Took 7.55 seconds to build instance.
Aug 26 19:13:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6ee194cd-379e-46f3-ba62-a99b9c03ac25 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.684s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.109s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:13:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:13:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.254s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:13:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:13:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:13:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:01 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:14:01 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:14:01 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=6826MB free_disk=25.371612548828125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:14:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:14:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:14:01 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance cc0ae046-2a39-4ab6-9327-2d9452c3035d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:14:01 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fd801f18-34b6-4682-8d43-edf82bd216c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:14:01 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fdfb377e-119e-41ce-b9e0-6e21053306cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:14:01 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:14:01 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:14:01 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 08ecabd0-f539-4068-9150-74e873809133 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:14:01 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c4218678-e287-4f07-8af1-59469bbcd6bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:14:01 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 481cc682-2004-434d-b4eb-1688b0b07dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:14:01 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 94f8d4e7-f310-45df-a0ae-82e608ac0119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:14:01 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance dca28d65-37d0-4b60-b8aa-dcca61b6a187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:14:01 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:14:01 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 9628e76c-a137-4499-96d7-5f6a30eb6dad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:14:01 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:14:01 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:14:01 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:14:01 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:14:01 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:14:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:14:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:02 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:14:02 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:14:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Acquiring lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:14:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:14:06 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:14:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:14:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:14:06 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:14:06 user nova-compute[73917]: INFO nova.compute.claims [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Claim successful on node user
Aug 26 19:14:07 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG nova.network.neutron [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:14:07 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:14:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG nova.policy [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '811ce763d55a4aefb116079215d01fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae04a1daa9c34775b7edfbce043b47c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:14:07 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Creating image(s)
Aug 26 19:14:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f2eed3f-0aac-4fbb-a958-ee8934c0e41a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "/opt/stack/data/nova/instances/8f2eed3f-0aac-4fbb-a958-ee8934c0e41a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "/opt/stack/data/nova/instances/8f2eed3f-0aac-4fbb-a958-ee8934c0e41a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.191s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.179s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/8f2eed3f-0aac-4fbb-a958-ee8934c0e41a/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/8f2eed3f-0aac-4fbb-a958-ee8934c0e41a/disk 1073741824" returned: 0 in 0.054s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:07 user nova-compute[73917]: DEBUG nova.network.neutron [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Successfully created port: 0c46d6d6-91e9-496f-9288-5f70608cf324 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:14:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.186s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:08 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f2eed3f-0aac-4fbb-a958-ee8934c0e41a/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:14:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f2eed3f-0aac-4fbb-a958-ee8934c0e41a/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f2eed3f-0aac-4fbb-a958-ee8934c0e41a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:08 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Cannot resize image /opt/stack/data/nova/instances/8f2eed3f-0aac-4fbb-a958-ee8934c0e41a/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:14:08 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:14:08 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Ensure instance console log exists: /opt/stack/data/nova/instances/8f2eed3f-0aac-4fbb-a958-ee8934c0e41a/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:14:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:14:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:14:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:14:08 user nova-compute[73917]: DEBUG nova.network.neutron [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Successfully updated port: 0c46d6d6-91e9-496f-9288-5f70608cf324 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:14:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Acquiring lock "refresh_cache-8f2eed3f-0aac-4fbb-a958-ee8934c0e41a" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:14:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Acquired lock "refresh_cache-8f2eed3f-0aac-4fbb-a958-ee8934c0e41a" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:14:08 user nova-compute[73917]: DEBUG nova.network.neutron [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:14:08 user nova-compute[73917]: DEBUG nova.compute.manager [req-41c467e9-e0df-42c9-af7e-38a55ffb9156 req-42447aec-68f2-445e-abc9-5dd7c21d8f7c service nova] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Received event network-changed-0c46d6d6-91e9-496f-9288-5f70608cf324 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:14:08 user nova-compute[73917]: DEBUG nova.compute.manager [req-41c467e9-e0df-42c9-af7e-38a55ffb9156 req-42447aec-68f2-445e-abc9-5dd7c21d8f7c service nova] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Refreshing instance network info cache due to event network-changed-0c46d6d6-91e9-496f-9288-5f70608cf324. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:14:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-41c467e9-e0df-42c9-af7e-38a55ffb9156 req-42447aec-68f2-445e-abc9-5dd7c21d8f7c service nova] Acquiring lock "refresh_cache-8f2eed3f-0aac-4fbb-a958-ee8934c0e41a" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:14:08 user nova-compute[73917]: DEBUG nova.network.neutron [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.network.neutron [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Updating instance_info_cache with network_info: [{"id": "0c46d6d6-91e9-496f-9288-5f70608cf324", "address": "fa:16:3e:2b:eb:d6", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c46d6d6-91", "ovs_interfaceid": "0c46d6d6-91e9-496f-9288-5f70608cf324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Releasing lock "refresh_cache-8f2eed3f-0aac-4fbb-a958-ee8934c0e41a" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Instance network_info: |[{"id": "0c46d6d6-91e9-496f-9288-5f70608cf324", "address": "fa:16:3e:2b:eb:d6", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c46d6d6-91", "ovs_interfaceid": "0c46d6d6-91e9-496f-9288-5f70608cf324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-41c467e9-e0df-42c9-af7e-38a55ffb9156 req-42447aec-68f2-445e-abc9-5dd7c21d8f7c service nova] Acquired lock "refresh_cache-8f2eed3f-0aac-4fbb-a958-ee8934c0e41a" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.network.neutron [req-41c467e9-e0df-42c9-af7e-38a55ffb9156 req-42447aec-68f2-445e-abc9-5dd7c21d8f7c service nova] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Refreshing network info cache for port 0c46d6d6-91e9-496f-9288-5f70608cf324 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Start _get_guest_xml network_info=[{"id": "0c46d6d6-91e9-496f-9288-5f70608cf324", "address": "fa:16:3e:2b:eb:d6", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c46d6d6-91", "ovs_interfaceid": "0c46d6d6-91e9-496f-9288-5f70608cf324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:14:09 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:14:09 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-135361502',display_name='tempest-ServersNegativeTestJSON-server-135361502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-135361502',id=22,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae04a1daa9c34775b7edfbce043b47c1',ramdisk_id='',reservation_id='r-mpxmqf0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-252207510',owner_user_name='tempest-ServersNegativeTestJSON-252207510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:14:07Z,user_data=None,user_id='811ce763d55a4aefb116079215d01fdb',uuid=8f2eed3f-0aac-4fbb-a958-ee8934c0e41a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c46d6d6-91e9-496f-9288-5f70608cf324", "address": "fa:16:3e:2b:eb:d6", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c46d6d6-91", "ovs_interfaceid": "0c46d6d6-91e9-496f-9288-5f70608cf324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Converting VIF {"id": "0c46d6d6-91e9-496f-9288-5f70608cf324", "address": "fa:16:3e:2b:eb:d6", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c46d6d6-91", "ovs_interfaceid": "0c46d6d6-91e9-496f-9288-5f70608cf324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:eb:d6,bridge_name='br-int',has_traffic_filtering=True,id=0c46d6d6-91e9-496f-9288-5f70608cf324,network=Network(06a65360-57e6-4419-8e18-8cfb937e1704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c46d6d6-91') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.objects.instance [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:14:09 user nova-compute[73917]:   <uuid>8f2eed3f-0aac-4fbb-a958-ee8934c0e41a</uuid>
Aug 26 19:14:09 user nova-compute[73917]:   <name>instance-00000016</name>
Aug 26 19:14:09 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:14:09 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:14:09 user nova-compute[73917]:   <metadata>
Aug 26 19:14:09 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:14:09 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:14:09 user nova-compute[73917]:       <nova:name>tempest-ServersNegativeTestJSON-server-135361502</nova:name>
Aug 26 19:14:09 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:14:09</nova:creationTime>
Aug 26 19:14:09 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:14:09 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:14:09 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:14:09 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:14:09 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:14:09 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:14:09 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:14:09 user nova-compute[73917]:       <nova:owner>
Aug 26 19:14:09 user nova-compute[73917]:         <nova:user uuid="811ce763d55a4aefb116079215d01fdb">tempest-ServersNegativeTestJSON-252207510-project-member</nova:user>
Aug 26 19:14:09 user nova-compute[73917]:         <nova:project uuid="ae04a1daa9c34775b7edfbce043b47c1">tempest-ServersNegativeTestJSON-252207510</nova:project>
Aug 26 19:14:09 user nova-compute[73917]:       </nova:owner>
Aug 26 19:14:09 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:14:09 user nova-compute[73917]:       <nova:ports>
Aug 26 19:14:09 user nova-compute[73917]:         <nova:port uuid="0c46d6d6-91e9-496f-9288-5f70608cf324">
Aug 26 19:14:09 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 19:14:09 user nova-compute[73917]:         </nova:port>
Aug 26 19:14:09 user nova-compute[73917]:       </nova:ports>
Aug 26 19:14:09 user nova-compute[73917]:     </nova:instance>
Aug 26 19:14:09 user nova-compute[73917]:   </metadata>
Aug 26 19:14:09 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:14:09 user nova-compute[73917]:     <system>
Aug 26 19:14:09 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:14:09 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:14:09 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:14:09 user nova-compute[73917]:       <entry name="serial">8f2eed3f-0aac-4fbb-a958-ee8934c0e41a</entry>
Aug 26 19:14:09 user nova-compute[73917]:       <entry name="uuid">8f2eed3f-0aac-4fbb-a958-ee8934c0e41a</entry>
Aug 26 19:14:09 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:14:09 user nova-compute[73917]:     </system>
Aug 26 19:14:09 user nova-compute[73917]:   </sysinfo>
Aug 26 19:14:09 user nova-compute[73917]:   <os>
Aug 26 19:14:09 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:14:09 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:14:09 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:14:09 user nova-compute[73917]:   </os>
Aug 26 19:14:09 user nova-compute[73917]:   <features>
Aug 26 19:14:09 user nova-compute[73917]:     <acpi/>
Aug 26 19:14:09 user nova-compute[73917]:     <apic/>
Aug 26 19:14:09 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:14:09 user nova-compute[73917]:   </features>
Aug 26 19:14:09 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:14:09 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:14:09 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:14:09 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:14:09 user nova-compute[73917]:   </clock>
Aug 26 19:14:09 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:14:09 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:14:09 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:14:09 user nova-compute[73917]:   </cpu>
Aug 26 19:14:09 user nova-compute[73917]:   <devices>
Aug 26 19:14:09 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:14:09 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:14:09 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/8f2eed3f-0aac-4fbb-a958-ee8934c0e41a/disk"/>
Aug 26 19:14:09 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:14:09 user nova-compute[73917]:     </disk>
Aug 26 19:14:09 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:14:09 user nova-compute[73917]:       <mac address="fa:16:3e:2b:eb:d6"/>
Aug 26 19:14:09 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:14:09 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:14:09 user nova-compute[73917]:       <target dev="tap0c46d6d6-91"/>
Aug 26 19:14:09 user nova-compute[73917]:     </interface>
Aug 26 19:14:09 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:14:09 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/8f2eed3f-0aac-4fbb-a958-ee8934c0e41a/console.log" append="off"/>
Aug 26 19:14:09 user nova-compute[73917]:     </serial>
Aug 26 19:14:09 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:14:09 user nova-compute[73917]:     <video>
Aug 26 19:14:09 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:14:09 user nova-compute[73917]:     </video>
Aug 26 19:14:09 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:14:09 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:14:09 user nova-compute[73917]:     </rng>
Aug 26 19:14:09 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:14:09 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:14:09 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:14:09 user nova-compute[73917]:     </memballoon>
Aug 26 19:14:09 user nova-compute[73917]:   </devices>
Aug 26 19:14:09 user nova-compute[73917]: </domain>
Aug 26 19:14:09 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-135361502',display_name='tempest-ServersNegativeTestJSON-server-135361502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-135361502',id=22,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae04a1daa9c34775b7edfbce043b47c1',ramdisk_id='',reservation_id='r-mpxmqf0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-252207510',owner_user_name='tempest-ServersNegativeTestJSON-252207510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:14:07Z,user_data=None,user_id='811ce763d55a4aefb116079215d01fdb',uuid=8f2eed3f-0aac-4fbb-a958-ee8934c0e41a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c46d6d6-91e9-496f-9288-5f70608cf324", "address": "fa:16:3e:2b:eb:d6", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c46d6d6-91", "ovs_interfaceid": "0c46d6d6-91e9-496f-9288-5f70608cf324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Converting VIF {"id": "0c46d6d6-91e9-496f-9288-5f70608cf324", "address": "fa:16:3e:2b:eb:d6", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c46d6d6-91", "ovs_interfaceid": "0c46d6d6-91e9-496f-9288-5f70608cf324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:eb:d6,bridge_name='br-int',has_traffic_filtering=True,id=0c46d6d6-91e9-496f-9288-5f70608cf324,network=Network(06a65360-57e6-4419-8e18-8cfb937e1704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c46d6d6-91') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG os_vif [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:eb:d6,bridge_name='br-int',has_traffic_filtering=True,id=0c46d6d6-91e9-496f-9288-5f70608cf324,network=Network(06a65360-57e6-4419-8e18-8cfb937e1704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c46d6d6-91') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c46d6d6-91, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0c46d6d6-91, col_values=(('external_ids', {'iface-id': '0c46d6d6-91e9-496f-9288-5f70608cf324', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:eb:d6', 'vm-uuid': '8f2eed3f-0aac-4fbb-a958-ee8934c0e41a'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:09 user nova-compute[73917]: INFO os_vif [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:eb:d6,bridge_name='br-int',has_traffic_filtering=True,id=0c46d6d6-91e9-496f-9288-5f70608cf324,network=Network(06a65360-57e6-4419-8e18-8cfb937e1704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c46d6d6-91')
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] No VIF found with MAC fa:16:3e:2b:eb:d6, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.network.neutron [req-41c467e9-e0df-42c9-af7e-38a55ffb9156 req-42447aec-68f2-445e-abc9-5dd7c21d8f7c service nova] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Updated VIF entry in instance network info cache for port 0c46d6d6-91e9-496f-9288-5f70608cf324. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG nova.network.neutron [req-41c467e9-e0df-42c9-af7e-38a55ffb9156 req-42447aec-68f2-445e-abc9-5dd7c21d8f7c service nova] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Updating instance_info_cache with network_info: [{"id": "0c46d6d6-91e9-496f-9288-5f70608cf324", "address": "fa:16:3e:2b:eb:d6", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c46d6d6-91", "ovs_interfaceid": "0c46d6d6-91e9-496f-9288-5f70608cf324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-41c467e9-e0df-42c9-af7e-38a55ffb9156 req-42447aec-68f2-445e-abc9-5dd7c21d8f7c service nova] Releasing lock "refresh_cache-8f2eed3f-0aac-4fbb-a958-ee8934c0e41a" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:14:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-ff39c5f5-0ff8-4988-8518-101662972f7a req-2bbc6647-02fd-4033-b2b8-4ac1563c6a35 service nova] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Received event network-vif-plugged-0c46d6d6-91e9-496f-9288-5f70608cf324 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:14:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ff39c5f5-0ff8-4988-8518-101662972f7a req-2bbc6647-02fd-4033-b2b8-4ac1563c6a35 service nova] Acquiring lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:14:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ff39c5f5-0ff8-4988-8518-101662972f7a req-2bbc6647-02fd-4033-b2b8-4ac1563c6a35 service nova] Lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:14:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ff39c5f5-0ff8-4988-8518-101662972f7a req-2bbc6647-02fd-4033-b2b8-4ac1563c6a35 service nova] Lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:14:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-ff39c5f5-0ff8-4988-8518-101662972f7a req-2bbc6647-02fd-4033-b2b8-4ac1563c6a35 service nova] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] No waiting events found dispatching network-vif-plugged-0c46d6d6-91e9-496f-9288-5f70608cf324 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:14:11 user nova-compute[73917]: WARNING nova.compute.manager [req-ff39c5f5-0ff8-4988-8518-101662972f7a req-2bbc6647-02fd-4033-b2b8-4ac1563c6a35 service nova] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Received unexpected event network-vif-plugged-0c46d6d6-91e9-496f-9288-5f70608cf324 for instance with vm_state building and task_state spawning.
Aug 26 19:14:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:13 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077253.0204449, 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:14:13 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] VM Resumed (Lifecycle Event)
Aug 26 19:14:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:14:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:14:13 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Instance spawned successfully.
Aug 26 19:14:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:14:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:14:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:14:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:14:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:14:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:14:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:14:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:14:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:14:13 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:14:13 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077253.02198, 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:14:13 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] VM Started (Lifecycle Event)
Aug 26 19:14:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:14:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:14:13 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:14:13 user nova-compute[73917]: INFO nova.compute.manager [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Took 5.63 seconds to spawn the instance on the hypervisor.
Aug 26 19:14:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:14:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-132b104d-1434-44d4-ad5b-f842b6609ae3 req-54332c37-d29b-43e8-a068-bedcbacb25e0 service nova] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Received event network-vif-plugged-0c46d6d6-91e9-496f-9288-5f70608cf324 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:14:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-132b104d-1434-44d4-ad5b-f842b6609ae3 req-54332c37-d29b-43e8-a068-bedcbacb25e0 service nova] Acquiring lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:14:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-132b104d-1434-44d4-ad5b-f842b6609ae3 req-54332c37-d29b-43e8-a068-bedcbacb25e0 service nova] Lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:14:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-132b104d-1434-44d4-ad5b-f842b6609ae3 req-54332c37-d29b-43e8-a068-bedcbacb25e0 service nova] Lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:14:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-132b104d-1434-44d4-ad5b-f842b6609ae3 req-54332c37-d29b-43e8-a068-bedcbacb25e0 service nova] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] No waiting events found dispatching network-vif-plugged-0c46d6d6-91e9-496f-9288-5f70608cf324 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:14:13 user nova-compute[73917]: WARNING nova.compute.manager [req-132b104d-1434-44d4-ad5b-f842b6609ae3 req-54332c37-d29b-43e8-a068-bedcbacb25e0 service nova] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Received unexpected event network-vif-plugged-0c46d6d6-91e9-496f-9288-5f70608cf324 for instance with vm_state building and task_state spawning.
Aug 26 19:14:13 user nova-compute[73917]: INFO nova.compute.manager [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Took 6.51 seconds to build instance.
Aug 26 19:14:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b058a1f-ebef-4e9f-8a30-e233568ed7b8 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.607s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:14:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:14:14 user nova-compute[73917]: INFO nova.compute.manager [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] instance snapshotting
Aug 26 19:14:14 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Beginning live snapshot process
Aug 26 19:14:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json -f qcow2 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json -f qcow2 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.193s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgushu3uq/5a1153b7ecc64728afa6f52967b52866.delta 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgushu3uq/5a1153b7ecc64728afa6f52967b52866.delta 1073741824" returned: 0 in 0.045s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:15 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 19:14:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:14:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] COPY block job progress, current cursor: 24444928 final cursor: 75497472 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:14:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:14:17 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 19:14:17 user nova-compute[73917]: DEBUG nova.privsep.utils [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73917) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 19:14:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgushu3uq/5a1153b7ecc64728afa6f52967b52866.delta /opt/stack/data/nova/instances/snapshots/tmpgushu3uq/5a1153b7ecc64728afa6f52967b52866 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgushu3uq/5a1153b7ecc64728afa6f52967b52866.delta /opt/stack/data/nova/instances/snapshots/tmpgushu3uq/5a1153b7ecc64728afa6f52967b52866" returned: 0 in 0.700s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:18 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Snapshot extracted, beginning image upload
Aug 26 19:14:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:21 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Snapshot image upload complete
Aug 26 19:14:21 user nova-compute[73917]: INFO nova.compute.manager [None req-cc707844-b869-46c5-a757-ac9f904ab1b6 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Took 6.59 seconds to snapshot the instance on the hypervisor.
Aug 26 19:14:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Acquiring lock "08ecabd0-f539-4068-9150-74e873809133" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "08ecabd0-f539-4068-9150-74e873809133" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Acquiring lock "08ecabd0-f539-4068-9150-74e873809133-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "08ecabd0-f539-4068-9150-74e873809133-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "08ecabd0-f539-4068-9150-74e873809133-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:14:27 user nova-compute[73917]: INFO nova.compute.manager [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Terminating instance
Aug 26 19:14:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-bcea379c-8352-4f43-8f03-c47141179d76 req-2979e09c-7068-4d7a-8bc7-8d1125748fbb service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Received event network-vif-unplugged-895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-bcea379c-8352-4f43-8f03-c47141179d76 req-2979e09c-7068-4d7a-8bc7-8d1125748fbb service nova] Acquiring lock "08ecabd0-f539-4068-9150-74e873809133-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-bcea379c-8352-4f43-8f03-c47141179d76 req-2979e09c-7068-4d7a-8bc7-8d1125748fbb service nova] Lock "08ecabd0-f539-4068-9150-74e873809133-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-bcea379c-8352-4f43-8f03-c47141179d76 req-2979e09c-7068-4d7a-8bc7-8d1125748fbb service nova] Lock "08ecabd0-f539-4068-9150-74e873809133-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-bcea379c-8352-4f43-8f03-c47141179d76 req-2979e09c-7068-4d7a-8bc7-8d1125748fbb service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] No waiting events found dispatching network-vif-unplugged-895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-bcea379c-8352-4f43-8f03-c47141179d76 req-2979e09c-7068-4d7a-8bc7-8d1125748fbb service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Received event network-vif-unplugged-895c0971-95b8-490f-95b5-386c50ba29c8 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:14:27 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 08ecabd0-f539-4068-9150-74e873809133] Instance destroyed successfully.
Aug 26 19:14:27 user nova-compute[73917]: DEBUG nova.objects.instance [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lazy-loading 'resources' on Instance uuid 08ecabd0-f539-4068-9150-74e873809133 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T19:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-372476347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-847741481',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILuuKhhd8SBkV1rvvqP3lRG/pwSBnr43r+z6CsGpn0WvVX9OQC0V+eSZCDA4YsPtHza5LR1n8VcvXIU4KZevCoPCULj3dhrVlzQmOhcxjRhz3Cu3v86zWvhmqTkFn+daA==',key_name='tempest-keypair-1708956738',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:13:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='820b033209b644249a7b064b4ca6c23f',ramdisk_id='',reservation_id='r-0arw7nc1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1172188124',owner_user_name='tempest-ServerActionsV293TestJSON-1172188124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:13:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ddca966a7694d04b252599a47f4078e',uuid=08ecabd0-f539-4068-9150-74e873809133,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "895c0971-95b8-490f-95b5-386c50ba29c8", "address": "fa:16:3e:b0:8c:eb", "network": {"id": "ad75441f-c776-426b-8ada-8fc89037e592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-909384262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820b033209b644249a7b064b4ca6c23f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895c0971-95", "ovs_interfaceid": "895c0971-95b8-490f-95b5-386c50ba29c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Converting VIF {"id": "895c0971-95b8-490f-95b5-386c50ba29c8", "address": "fa:16:3e:b0:8c:eb", "network": {"id": "ad75441f-c776-426b-8ada-8fc89037e592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-909384262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820b033209b644249a7b064b4ca6c23f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895c0971-95", "ovs_interfaceid": "895c0971-95b8-490f-95b5-386c50ba29c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=895c0971-95b8-490f-95b5-386c50ba29c8,network=Network(ad75441f-c776-426b-8ada-8fc89037e592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895c0971-95') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG os_vif [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=895c0971-95b8-490f-95b5-386c50ba29c8,network=Network(ad75441f-c776-426b-8ada-8fc89037e592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895c0971-95') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap895c0971-95, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:27 user nova-compute[73917]: INFO os_vif [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=895c0971-95b8-490f-95b5-386c50ba29c8,network=Network(ad75441f-c776-426b-8ada-8fc89037e592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895c0971-95')
Aug 26 19:14:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGkZoHXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:14:27 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:14:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7ed720-6b51-46ba-9b1e-f2bd7519351b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a006da07-98df-4767-b475-f64ae4d67765]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:14:27 user nova-compute[73917]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)
Aug 26 19:14:27 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:14:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 (non-flash)
Aug 26 19:14:27 user nova-compute[73917]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)
Aug 26 19:14:27 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6bb51ed5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481'): ({'sdb'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Removing single pathed devices sdb {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a901e2e1-9b90-4544-b493-54ec8dd9688c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9406f0-b8dd-4bae-8599-d733f67b8f71]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Flushing IO for device /dev/sdb {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaf31ec-bd70-4d5e-bd8a-39ea863e9fbb]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc08ab71-9258-46e5-a1df-f72f89901fa7]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.068s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1471b3a-d1df-4fab-b247-a363bcf0d436]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f94db0-291d-4acf-8bf2-b488806aee46]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481, portal: 172.16.0.220,3260]
Aug 26 19:14:28 user nova-compute[73917]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481, portal: 172.16.0.220,3260] successful.
Aug 26 19:14:28 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b057f77a-308f-4ef1-ac20-bd064c4ca481 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cd0077-f53a-4a49-8aa8-ac45a52545d0]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] <== disconnect_volume: return (360ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:14:28 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Deleting instance files /opt/stack/data/nova/instances/08ecabd0-f539-4068-9150-74e873809133_del
Aug 26 19:14:28 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Deletion of /opt/stack/data/nova/instances/08ecabd0-f539-4068-9150-74e873809133_del complete
Aug 26 19:14:28 user nova-compute[73917]: INFO nova.compute.manager [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 26 19:14:28 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 08ecabd0-f539-4068-9150-74e873809133] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:14:28 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 08ecabd0-f539-4068-9150-74e873809133] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:14:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-a27bd23b-bccb-48ff-bebe-27d2b762f5c5 req-f7bc37b2-d223-44d7-a22f-1933a888f64f service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Received event network-vif-plugged-895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:14:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a27bd23b-bccb-48ff-bebe-27d2b762f5c5 req-f7bc37b2-d223-44d7-a22f-1933a888f64f service nova] Acquiring lock "08ecabd0-f539-4068-9150-74e873809133-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:14:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a27bd23b-bccb-48ff-bebe-27d2b762f5c5 req-f7bc37b2-d223-44d7-a22f-1933a888f64f service nova] Lock "08ecabd0-f539-4068-9150-74e873809133-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:14:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a27bd23b-bccb-48ff-bebe-27d2b762f5c5 req-f7bc37b2-d223-44d7-a22f-1933a888f64f service nova] Lock "08ecabd0-f539-4068-9150-74e873809133-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:14:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-a27bd23b-bccb-48ff-bebe-27d2b762f5c5 req-f7bc37b2-d223-44d7-a22f-1933a888f64f service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] No waiting events found dispatching network-vif-plugged-895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:14:29 user nova-compute[73917]: WARNING nova.compute.manager [req-a27bd23b-bccb-48ff-bebe-27d2b762f5c5 req-f7bc37b2-d223-44d7-a22f-1933a888f64f service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Received unexpected event network-vif-plugged-895c0971-95b8-490f-95b5-386c50ba29c8 for instance with vm_state active and task_state deleting.
Aug 26 19:14:29 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 08ecabd0-f539-4068-9150-74e873809133] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:14:29 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 08ecabd0-f539-4068-9150-74e873809133] Took 1.57 seconds to deallocate network for instance.
Aug 26 19:14:30 user nova-compute[73917]: INFO nova.compute.manager [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Took 0.85 seconds to detach 1 volumes for instance.
Aug 26 19:14:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] [instance: 08ecabd0-f539-4068-9150-74e873809133] Deleting volume: b057f77a-308f-4ef1-ac20-bd064c4ca481 {{(pid=73917) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 19:14:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:14:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:14:31 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:14:31 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:14:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:14:31 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Deleted allocations for instance 08ecabd0-f539-4068-9150-74e873809133
Aug 26 19:14:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fa17fa94-d4a2-47b5-a4d2-5ae07d64024f tempest-ServerActionsV293TestJSON-1172188124 tempest-ServerActionsV293TestJSON-1172188124-project-member] Lock "08ecabd0-f539-4068-9150-74e873809133" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.459s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:14:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-53dcf65c-da72-4f01-8e92-1659ba4334d4 req-d259625c-4e55-4162-a3c0-1ef09dbe3f18 service nova] [instance: 08ecabd0-f539-4068-9150-74e873809133] Received event network-vif-deleted-895c0971-95b8-490f-95b5-386c50ba29c8 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:14:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:14:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:14:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:14:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:14:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:14:32 user nova-compute[73917]: INFO nova.compute.manager [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Terminating instance
Aug 26 19:14:32 user nova-compute[73917]: DEBUG nova.compute.manager [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:14:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-3f1f102a-8e4a-4bef-af03-6e7f69a25b11 req-c3c9cb2c-6c3e-4394-93cb-93764d19c28f service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-vif-unplugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:14:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3f1f102a-8e4a-4bef-af03-6e7f69a25b11 req-c3c9cb2c-6c3e-4394-93cb-93764d19c28f service nova] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:14:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3f1f102a-8e4a-4bef-af03-6e7f69a25b11 req-c3c9cb2c-6c3e-4394-93cb-93764d19c28f service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:14:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3f1f102a-8e4a-4bef-af03-6e7f69a25b11 req-c3c9cb2c-6c3e-4394-93cb-93764d19c28f service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:14:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-3f1f102a-8e4a-4bef-af03-6e7f69a25b11 req-c3c9cb2c-6c3e-4394-93cb-93764d19c28f service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] No waiting events found dispatching network-vif-unplugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:14:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-3f1f102a-8e4a-4bef-af03-6e7f69a25b11 req-c3c9cb2c-6c3e-4394-93cb-93764d19c28f service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-vif-unplugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:14:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:33 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Instance destroyed successfully.
Aug 26 19:14:33 user nova-compute[73917]: DEBUG nova.objects.instance [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lazy-loading 'resources' on Instance uuid 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:14:33 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-721860260',display_name='tempest-ServerStableDeviceRescueTest-server-721860260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-721860260',id=7,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJtE+qXdGZrkiAdBY0BxQ6ZEJ8XDZAjGtegAJ/SNt0X0lzJfk9WOgXrblFhQIglq06fSfLJPdWq+bnzSfz2VMsXVXqQKheHwQqItW7lqtTaiVh5HoXhBJLL+FVuuWpDjQ==',key_name='tempest-keypair-1387896357',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:11:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f09772507cd24e329e84aa3b9a3b9b7e',ramdisk_id='',reservation_id='r-0swkyi4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1025636115',owner_user_name='tempest-ServerStableDeviceRescueTest-1025636115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34c97061bd0a4b3897fb03769884043c',uuid=9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "address": "fa:16:3e:c9:58:2d", "network": {"id": "4fb39591-1339-423b-a17d-cec979856e60", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09772507cd24e329e84aa3b9a3b9b7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245e99f5-fb", "ovs_interfaceid": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:14:33 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Converting VIF {"id": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "address": "fa:16:3e:c9:58:2d", "network": {"id": "4fb39591-1339-423b-a17d-cec979856e60", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2089599400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09772507cd24e329e84aa3b9a3b9b7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245e99f5-fb", "ovs_interfaceid": "245e99f5-fb5c-4442-b5f7-c2b05207f2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:14:33 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:58:2d,bridge_name='br-int',has_traffic_filtering=True,id=245e99f5-fb5c-4442-b5f7-c2b05207f2fc,network=Network(4fb39591-1339-423b-a17d-cec979856e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap245e99f5-fb') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:14:33 user nova-compute[73917]: DEBUG os_vif [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:58:2d,bridge_name='br-int',has_traffic_filtering=True,id=245e99f5-fb5c-4442-b5f7-c2b05207f2fc,network=Network(4fb39591-1339-423b-a17d-cec979856e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap245e99f5-fb') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:14:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap245e99f5-fb, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:14:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:14:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:33 user nova-compute[73917]: INFO os_vif [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:58:2d,bridge_name='br-int',has_traffic_filtering=True,id=245e99f5-fb5c-4442-b5f7-c2b05207f2fc,network=Network(4fb39591-1339-423b-a17d-cec979856e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap245e99f5-fb')
Aug 26 19:14:33 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Deleting instance files /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6_del
Aug 26 19:14:33 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Deletion of /opt/stack/data/nova/instances/9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6_del complete
Aug 26 19:14:33 user nova-compute[73917]: INFO nova.compute.manager [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 26 19:14:33 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:14:33 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:14:33 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:14:34 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:14:34 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Took 1.01 seconds to deallocate network for instance.
Aug 26 19:14:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-8302801f-9608-4faf-b2df-148d441698f3 req-c9fa280d-44b4-450c-81dd-b0a53f00b00f service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-vif-deleted-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:14:34 user nova-compute[73917]: INFO nova.compute.manager [req-8302801f-9608-4faf-b2df-148d441698f3 req-c9fa280d-44b4-450c-81dd-b0a53f00b00f service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Neutron deleted interface 245e99f5-fb5c-4442-b5f7-c2b05207f2fc; detaching it from the instance and deleting it from the info cache
Aug 26 19:14:34 user nova-compute[73917]: DEBUG nova.network.neutron [req-8302801f-9608-4faf-b2df-148d441698f3 req-c9fa280d-44b4-450c-81dd-b0a53f00b00f service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:14:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-8302801f-9608-4faf-b2df-148d441698f3 req-c9fa280d-44b4-450c-81dd-b0a53f00b00f service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Detach interface failed, port_id=245e99f5-fb5c-4442-b5f7-c2b05207f2fc, reason: Instance 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:14:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:14:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:14:35 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:14:35 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:14:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.474s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:14:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-6d36fe99-bd8f-476f-a759-e364e6bd485d req-6f31362d-2136-4f03-8628-6ec6ccc92283 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:14:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d36fe99-bd8f-476f-a759-e364e6bd485d req-6f31362d-2136-4f03-8628-6ec6ccc92283 service nova] Acquiring lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:14:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d36fe99-bd8f-476f-a759-e364e6bd485d req-6f31362d-2136-4f03-8628-6ec6ccc92283 service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:14:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d36fe99-bd8f-476f-a759-e364e6bd485d req-6f31362d-2136-4f03-8628-6ec6ccc92283 service nova] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:14:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-6d36fe99-bd8f-476f-a759-e364e6bd485d req-6f31362d-2136-4f03-8628-6ec6ccc92283 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] No waiting events found dispatching network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:14:35 user nova-compute[73917]: WARNING nova.compute.manager [req-6d36fe99-bd8f-476f-a759-e364e6bd485d req-6f31362d-2136-4f03-8628-6ec6ccc92283 service nova] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Received unexpected event network-vif-plugged-245e99f5-fb5c-4442-b5f7-c2b05207f2fc for instance with vm_state deleted and task_state None.
Aug 26 19:14:35 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Deleted allocations for instance 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6
Aug 26 19:14:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-587c61e8-a2df-439f-84f1-1aad81421a4f tempest-ServerStableDeviceRescueTest-1025636115 tempest-ServerStableDeviceRescueTest-1025636115-project-member] Lock "9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.577s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:14:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:42 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077267.8702652, 08ecabd0-f539-4068-9150-74e873809133 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:14:42 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 08ecabd0-f539-4068-9150-74e873809133] VM Stopped (Lifecycle Event)
Aug 26 19:14:42 user nova-compute[73917]: DEBUG nova.compute.manager [None req-7acaf1dd-1229-497b-8fb9-3d30c9f78a92 None None] [instance: 08ecabd0-f539-4068-9150-74e873809133] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:14:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:48 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077273.5192986, 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:14:48 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] VM Stopped (Lifecycle Event)
Aug 26 19:14:48 user nova-compute[73917]: DEBUG nova.compute.manager [None req-cb8e79e4-8f9f-4873-8401-cc1aa29fcad7 None None] [instance: 9dea82f4-9ec3-4d81-b6fd-9e0f6c82d7a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:14:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:52 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:14:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:14:54 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:14:54 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:14:54 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:14:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:14:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:14:54 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:14:54 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid cc0ae046-2a39-4ab6-9327-2d9452c3035d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:14:54 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Updating instance_info_cache with network_info: [{"id": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "address": "fa:16:3e:89:79:8b", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8ac63b-61", "ovs_interfaceid": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:14:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:14:54 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:14:55 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:14:55 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:14:55 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:14:56 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:14:56 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:14:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:14:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:14:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:14:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:14:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:14:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:14:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:14:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:14:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:14:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:59 user nova-compute[73917]: DEBUG nova.objects.instance [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'flavor' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:14:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "refresh_cache-fdfb377e-119e-41ce-b9e0-6e21053306cc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:14:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquired lock "refresh_cache-fdfb377e-119e-41ce-b9e0-6e21053306cc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:14:59 user nova-compute[73917]: DEBUG nova.network.neutron [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:14:59 user nova-compute[73917]: DEBUG nova.objects.instance [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'info_cache' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:14:59 user nova-compute[73917]: DEBUG nova.objects.base [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Object Instance<fdfb377e-119e-41ce-b9e0-6e21053306cc> lazy-loaded attributes: flavor,info_cache {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:14:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:14:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:14:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.network.neutron [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Updating instance_info_cache with network_info: [{"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Releasing lock "refresh_cache-fdfb377e-119e-41ce-b9e0-6e21053306cc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:15:00 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Instance destroyed successfully.
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.objects.instance [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'resources' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.objects.base [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Object Instance<fdfb377e-119e-41ce-b9e0-6e21053306cc> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-699122116',display_name='tempest-AttachVolumeTestJSON-server-699122116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-699122116',id=5,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHqeZabK3+K4aaugpyX8ly8/1rj5SN4GU9OQYd/thmmFlRmAKDNGqPnSs6iFVbJTbvqYDOtwahR3/8AlpHMnz55bssLgo5XLS59T+WFQ51mc2/usyY8DYb7AasV3fI19A==',key_name='tempest-keypair-67322035',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='abdcca8609e849618526a8b78385f77b',ramdisk_id='',reservation_id='r-mcpim35c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1084822713',owner_user_name='tempest-AttachVolumeTestJSON-1084822713-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:13:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47b6f8fcb8f49dfa2383dfbf37d6c30',uuid=fdfb377e-119e-41ce-b9e0-6e21053306cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converting VIF {"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG os_vif [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37aa792a-c3, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:00 user nova-compute[73917]: INFO os_vif [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3')
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Start _get_guest_xml network_info=[{"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.objects.instance [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'numa_topology' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.objects.base [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Object Instance<fdfb377e-119e-41ce-b9e0-6e21053306cc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:15:00 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:15:00 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.objects.instance [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'vcpu_model' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.objects.base [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Object Instance<fdfb377e-119e-41ce-b9e0-6e21053306cc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-699122116',display_name='tempest-AttachVolumeTestJSON-server-699122116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-699122116',id=5,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHqeZabK3+K4aaugpyX8ly8/1rj5SN4GU9OQYd/thmmFlRmAKDNGqPnSs6iFVbJTbvqYDOtwahR3/8AlpHMnz55bssLgo5XLS59T+WFQ51mc2/usyY8DYb7AasV3fI19A==',key_name='tempest-keypair-67322035',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='abdcca8609e849618526a8b78385f77b',ramdisk_id='',reservation_id='r-mcpim35c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1084822713',owner_user_name='tempest-AttachVolumeTestJSON-1084822713-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:13:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47b6f8fcb8f49dfa2383dfbf37d6c30',uuid=fdfb377e-119e-41ce-b9e0-6e21053306cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converting VIF {"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.objects.instance [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'pci_devices' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.objects.base [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Object Instance<fdfb377e-119e-41ce-b9e0-6e21053306cc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:15:00 user nova-compute[73917]:   <uuid>fdfb377e-119e-41ce-b9e0-6e21053306cc</uuid>
Aug 26 19:15:00 user nova-compute[73917]:   <name>instance-00000005</name>
Aug 26 19:15:00 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:15:00 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:15:00 user nova-compute[73917]:   <metadata>
Aug 26 19:15:00 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:15:00 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:15:00 user nova-compute[73917]:       <nova:name>tempest-AttachVolumeTestJSON-server-699122116</nova:name>
Aug 26 19:15:00 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:15:00</nova:creationTime>
Aug 26 19:15:00 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:15:00 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:15:00 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:15:00 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:15:00 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:15:00 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:15:00 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:15:00 user nova-compute[73917]:       <nova:owner>
Aug 26 19:15:00 user nova-compute[73917]:         <nova:user uuid="a47b6f8fcb8f49dfa2383dfbf37d6c30">tempest-AttachVolumeTestJSON-1084822713-project-member</nova:user>
Aug 26 19:15:00 user nova-compute[73917]:         <nova:project uuid="abdcca8609e849618526a8b78385f77b">tempest-AttachVolumeTestJSON-1084822713</nova:project>
Aug 26 19:15:00 user nova-compute[73917]:       </nova:owner>
Aug 26 19:15:00 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:15:00 user nova-compute[73917]:       <nova:ports>
Aug 26 19:15:00 user nova-compute[73917]:         <nova:port uuid="37aa792a-c367-4dfd-b814-cb9c32ef373c">
Aug 26 19:15:00 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 19:15:00 user nova-compute[73917]:         </nova:port>
Aug 26 19:15:00 user nova-compute[73917]:       </nova:ports>
Aug 26 19:15:00 user nova-compute[73917]:     </nova:instance>
Aug 26 19:15:00 user nova-compute[73917]:   </metadata>
Aug 26 19:15:00 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:15:00 user nova-compute[73917]:     <system>
Aug 26 19:15:00 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:15:00 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:15:00 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:15:00 user nova-compute[73917]:       <entry name="serial">fdfb377e-119e-41ce-b9e0-6e21053306cc</entry>
Aug 26 19:15:00 user nova-compute[73917]:       <entry name="uuid">fdfb377e-119e-41ce-b9e0-6e21053306cc</entry>
Aug 26 19:15:00 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:15:00 user nova-compute[73917]:     </system>
Aug 26 19:15:00 user nova-compute[73917]:   </sysinfo>
Aug 26 19:15:00 user nova-compute[73917]:   <os>
Aug 26 19:15:00 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:15:00 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:15:00 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:15:00 user nova-compute[73917]:   </os>
Aug 26 19:15:00 user nova-compute[73917]:   <features>
Aug 26 19:15:00 user nova-compute[73917]:     <acpi/>
Aug 26 19:15:00 user nova-compute[73917]:     <apic/>
Aug 26 19:15:00 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:15:00 user nova-compute[73917]:   </features>
Aug 26 19:15:00 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:15:00 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:15:00 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:15:00 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:15:00 user nova-compute[73917]:   </clock>
Aug 26 19:15:00 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:15:00 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:15:00 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:15:00 user nova-compute[73917]:   </cpu>
Aug 26 19:15:00 user nova-compute[73917]:   <devices>
Aug 26 19:15:00 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:15:00 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:15:00 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk"/>
Aug 26 19:15:00 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:15:00 user nova-compute[73917]:     </disk>
Aug 26 19:15:00 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:15:00 user nova-compute[73917]:       <mac address="fa:16:3e:ce:ab:20"/>
Aug 26 19:15:00 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:15:00 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:15:00 user nova-compute[73917]:       <target dev="tap37aa792a-c3"/>
Aug 26 19:15:00 user nova-compute[73917]:     </interface>
Aug 26 19:15:00 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:15:00 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/console.log" append="off"/>
Aug 26 19:15:00 user nova-compute[73917]:     </serial>
Aug 26 19:15:00 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:15:00 user nova-compute[73917]:     <video>
Aug 26 19:15:00 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:15:00 user nova-compute[73917]:     </video>
Aug 26 19:15:00 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:15:00 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:15:00 user nova-compute[73917]:     </rng>
Aug 26 19:15:00 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:15:00 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:15:00 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:15:00 user nova-compute[73917]:     </memballoon>
Aug 26 19:15:00 user nova-compute[73917]:   </devices>
Aug 26 19:15:00 user nova-compute[73917]: </domain>
Aug 26 19:15:00 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.objects.instance [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'trusted_certs' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG nova.objects.base [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Object Instance<fdfb377e-119e-41ce-b9e0-6e21053306cc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.180s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Cannot resize image /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG nova.objects.instance [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'migration_context' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG nova.objects.base [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Object Instance<fdfb377e-119e-41ce-b9e0-6e21053306cc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-699122116',display_name='tempest-AttachVolumeTestJSON-server-699122116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-699122116',id=5,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHqeZabK3+K4aaugpyX8ly8/1rj5SN4GU9OQYd/thmmFlRmAKDNGqPnSs6iFVbJTbvqYDOtwahR3/8AlpHMnz55bssLgo5XLS59T+WFQ51mc2/usyY8DYb7AasV3fI19A==',key_name='tempest-keypair-67322035',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='abdcca8609e849618526a8b78385f77b',ramdisk_id='',reservation_id='r-mcpim35c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1084822713',owner_user_name='tempest-AttachVolumeTestJSON-1084822713-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:13:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47b6f8fcb8f49dfa2383dfbf37d6c30',uuid=fdfb377e-119e-41ce-b9e0-6e21053306cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converting VIF {"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG os_vif [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37aa792a-c3, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37aa792a-c3, col_values=(('external_ids', {'iface-id': '37aa792a-c367-4dfd-b814-cb9c32ef373c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:ab:20', 'vm-uuid': 'fdfb377e-119e-41ce-b9e0-6e21053306cc'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:01 user nova-compute[73917]: INFO os_vif [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3')
Aug 26 19:15:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f2eed3f-0aac-4fbb-a958-ee8934c0e41a/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f2eed3f-0aac-4fbb-a958-ee8934c0e41a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f2eed3f-0aac-4fbb-a958-ee8934c0e41a/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f2eed3f-0aac-4fbb-a958-ee8934c0e41a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077305.174862, fdfb377e-119e-41ce-b9e0-6e21053306cc => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:15:05 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] VM Resumed (Lifecycle Event)
Aug 26 19:15:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-1ee60e7b-2044-4e42-ba94-74465c8895fa req-0d485cde-f4d0-4b79-acff-46f692d5dd4a service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1ee60e7b-2044-4e42-ba94-74465c8895fa req-0d485cde-f4d0-4b79-acff-46f692d5dd4a service nova] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1ee60e7b-2044-4e42-ba94-74465c8895fa req-0d485cde-f4d0-4b79-acff-46f692d5dd4a service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1ee60e7b-2044-4e42-ba94-74465c8895fa req-0d485cde-f4d0-4b79-acff-46f692d5dd4a service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-1ee60e7b-2044-4e42-ba94-74465c8895fa req-0d485cde-f4d0-4b79-acff-46f692d5dd4a service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] No waiting events found dispatching network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:15:05 user nova-compute[73917]: WARNING nova.compute.manager [req-1ee60e7b-2044-4e42-ba94-74465c8895fa req-0d485cde-f4d0-4b79-acff-46f692d5dd4a service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received unexpected event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c for instance with vm_state stopped and task_state powering-on.
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-962b9c9d-f8af-42df-a842-9f509eb68658 req-6c14659f-c3a9-4fe0-af91-41ebd4d9d119 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received event network-changed-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-962b9c9d-f8af-42df-a842-9f509eb68658 req-6c14659f-c3a9-4fe0-af91-41ebd4d9d119 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Refreshing instance network info cache due to event network-changed-c63a3326-bd42-40f4-8559-b7f08e5f9a98. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-962b9c9d-f8af-42df-a842-9f509eb68658 req-6c14659f-c3a9-4fe0-af91-41ebd4d9d119 service nova] Acquiring lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-962b9c9d-f8af-42df-a842-9f509eb68658 req-6c14659f-c3a9-4fe0-af91-41ebd4d9d119 service nova] Acquired lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.network.neutron [req-962b9c9d-f8af-42df-a842-9f509eb68658 req-6c14659f-c3a9-4fe0-af91-41ebd4d9d119 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Refreshing network info cache for port c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-ec607097-96d6-4bba-9dc7-359de356ead1 req-392999d7-af42-4038-a26c-2f65486f73f3 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ec607097-96d6-4bba-9dc7-359de356ead1 req-392999d7-af42-4038-a26c-2f65486f73f3 service nova] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ec607097-96d6-4bba-9dc7-359de356ead1 req-392999d7-af42-4038-a26c-2f65486f73f3 service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ec607097-96d6-4bba-9dc7-359de356ead1 req-392999d7-af42-4038-a26c-2f65486f73f3 service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-ec607097-96d6-4bba-9dc7-359de356ead1 req-392999d7-af42-4038-a26c-2f65486f73f3 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] No waiting events found dispatching network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:15:05 user nova-compute[73917]: WARNING nova.compute.manager [req-ec607097-96d6-4bba-9dc7-359de356ead1 req-392999d7-af42-4038-a26c-2f65486f73f3 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received unexpected event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c for instance with vm_state stopped and task_state powering-on.
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:15:05 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:15:05 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=7056MB free_disk=25.378982543945312GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:05 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Instance rebooted successfully.
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9b333452-d0ad-43a2-87d6-9f03f9a8929d tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:15:05 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077305.1766078, fdfb377e-119e-41ce-b9e0-6e21053306cc => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:15:05 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] VM Started (Lifecycle Event)
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance cc0ae046-2a39-4ab6-9327-2d9452c3035d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fd801f18-34b6-4682-8d43-edf82bd216c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fdfb377e-119e-41ce-b9e0-6e21053306cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c4218678-e287-4f07-8af1-59469bbcd6bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 481cc682-2004-434d-b4eb-1688b0b07dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 94f8d4e7-f310-45df-a0ae-82e608ac0119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance dca28d65-37d0-4b60-b8aa-dcca61b6a187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 9628e76c-a137-4499-96d7-5f6a30eb6dad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:15:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:15:06 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:15:06 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:15:06 user nova-compute[73917]: DEBUG nova.network.neutron [req-962b9c9d-f8af-42df-a842-9f509eb68658 req-6c14659f-c3a9-4fe0-af91-41ebd4d9d119 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Updated VIF entry in instance network info cache for port c63a3326-bd42-40f4-8559-b7f08e5f9a98. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:15:06 user nova-compute[73917]: DEBUG nova.network.neutron [req-962b9c9d-f8af-42df-a842-9f509eb68658 req-6c14659f-c3a9-4fe0-af91-41ebd4d9d119 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Updating instance_info_cache with network_info: [{"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:15:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-962b9c9d-f8af-42df-a842-9f509eb68658 req-6c14659f-c3a9-4fe0-af91-41ebd4d9d119 service nova] Releasing lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:15:06 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:15:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.629s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:07 user nova-compute[73917]: DEBUG nova.compute.manager [req-05413799-84d0-4b94-9fd0-c9a33d0aeb0c req-c50a782c-d9dd-4a85-b973-df4a4068428c service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Received event network-changed-a3c97057-1f39-49d8-9f1b-d0f2deea9357 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:15:07 user nova-compute[73917]: DEBUG nova.compute.manager [req-05413799-84d0-4b94-9fd0-c9a33d0aeb0c req-c50a782c-d9dd-4a85-b973-df4a4068428c service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Refreshing instance network info cache due to event network-changed-a3c97057-1f39-49d8-9f1b-d0f2deea9357. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:15:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-05413799-84d0-4b94-9fd0-c9a33d0aeb0c req-c50a782c-d9dd-4a85-b973-df4a4068428c service nova] Acquiring lock "refresh_cache-f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:15:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-05413799-84d0-4b94-9fd0-c9a33d0aeb0c req-c50a782c-d9dd-4a85-b973-df4a4068428c service nova] Acquired lock "refresh_cache-f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:15:07 user nova-compute[73917]: DEBUG nova.network.neutron [req-05413799-84d0-4b94-9fd0-c9a33d0aeb0c req-c50a782c-d9dd-4a85-b973-df4a4068428c service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Refreshing network info cache for port a3c97057-1f39-49d8-9f1b-d0f2deea9357 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:15:08 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:15:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:08 user nova-compute[73917]: DEBUG nova.network.neutron [req-05413799-84d0-4b94-9fd0-c9a33d0aeb0c req-c50a782c-d9dd-4a85-b973-df4a4068428c service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Updated VIF entry in instance network info cache for port a3c97057-1f39-49d8-9f1b-d0f2deea9357. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:15:08 user nova-compute[73917]: DEBUG nova.network.neutron [req-05413799-84d0-4b94-9fd0-c9a33d0aeb0c req-c50a782c-d9dd-4a85-b973-df4a4068428c service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Updating instance_info_cache with network_info: [{"id": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "address": "fa:16:3e:dd:b4:69", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c97057-1f", "ovs_interfaceid": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:15:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-05413799-84d0-4b94-9fd0-c9a33d0aeb0c req-c50a782c-d9dd-4a85-b973-df4a4068428c service nova] Releasing lock "refresh_cache-f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:15:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:12 user nova-compute[73917]: DEBUG nova.objects.instance [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lazy-loading 'flavor' on Instance uuid f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:15:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:12 user nova-compute[73917]: INFO nova.compute.manager [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Attaching volume c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 to /dev/vdb
Aug 26 19:15:12 user nova-compute[73917]: DEBUG os_brick.utils [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:15:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57b12e4-f47b-4790-8449-eb98276c6516]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[13918f1b-10ce-40d7-a331-fc17eab4be3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[518889ad-03d3-42f7-879b-af1e2b01803c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caf2b60-a612-425e-a566-ebb5139309b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:15:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:15:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:15:13 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:15:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[53528640-1138-4a65-8486-abb40d9b4f4d]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:15:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:15:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:15:13 user nova-compute[73917]: DEBUG os_brick.utils [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:15:13 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Updating existing volume attachment record: 3487a738-a77d-4d99-bf0b-b33c95487715 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:15:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "df5c717a-62d8-444d-9968-ad682a31733c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "df5c717a-62d8-444d-9968-ad682a31733c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:15:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:23 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:15:23 user nova-compute[73917]: INFO nova.compute.claims [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Claim successful on node user
Aug 26 19:15:24 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:15:24 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:15:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:15:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:15:24 user nova-compute[73917]: DEBUG nova.network.neutron [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:15:24 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:15:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:15:24 user nova-compute[73917]: INFO nova.virt.block_device [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Booting with blank volume at /dev/vda
Aug 26 19:15:24 user nova-compute[73917]: DEBUG nova.policy [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e056c4ed5a18427a8fd1eaa6a3a795c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68229e3ed72a45fa8c2c9a33780479ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:15:25 user nova-compute[73917]: DEBUG nova.network.neutron [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Successfully created port: b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:15:25 user nova-compute[73917]: DEBUG nova.network.neutron [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Successfully updated port: b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:15:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "refresh_cache-df5c717a-62d8-444d-9968-ad682a31733c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:15:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquired lock "refresh_cache-df5c717a-62d8-444d-9968-ad682a31733c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:15:25 user nova-compute[73917]: DEBUG nova.network.neutron [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:15:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-9b254b87-180b-486e-a9ff-cec3a3c9154c req-f141d00d-0a78-4995-b5cb-b8f80442f62e service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received event network-changed-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:15:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-9b254b87-180b-486e-a9ff-cec3a3c9154c req-f141d00d-0a78-4995-b5cb-b8f80442f62e service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Refreshing instance network info cache due to event network-changed-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:15:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9b254b87-180b-486e-a9ff-cec3a3c9154c req-f141d00d-0a78-4995-b5cb-b8f80442f62e service nova] Acquiring lock "refresh_cache-df5c717a-62d8-444d-9968-ad682a31733c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:15:26 user nova-compute[73917]: DEBUG nova.network.neutron [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:15:26 user nova-compute[73917]: DEBUG nova.network.neutron [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Updating instance_info_cache with network_info: [{"id": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "address": "fa:16:3e:ca:39:fd", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79ade91-3e", "ovs_interfaceid": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:15:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Releasing lock "refresh_cache-df5c717a-62d8-444d-9968-ad682a31733c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:15:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Instance network_info: |[{"id": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "address": "fa:16:3e:ca:39:fd", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79ade91-3e", "ovs_interfaceid": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:15:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9b254b87-180b-486e-a9ff-cec3a3c9154c req-f141d00d-0a78-4995-b5cb-b8f80442f62e service nova] Acquired lock "refresh_cache-df5c717a-62d8-444d-9968-ad682a31733c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:15:26 user nova-compute[73917]: DEBUG nova.network.neutron [req-9b254b87-180b-486e-a9ff-cec3a3c9154c req-f141d00d-0a78-4995-b5cb-b8f80442f62e service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Refreshing network info cache for port b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:15:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:26 user nova-compute[73917]: DEBUG nova.network.neutron [req-9b254b87-180b-486e-a9ff-cec3a3c9154c req-f141d00d-0a78-4995-b5cb-b8f80442f62e service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Updated VIF entry in instance network info cache for port b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:15:26 user nova-compute[73917]: DEBUG nova.network.neutron [req-9b254b87-180b-486e-a9ff-cec3a3c9154c req-f141d00d-0a78-4995-b5cb-b8f80442f62e service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Updating instance_info_cache with network_info: [{"id": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "address": "fa:16:3e:ca:39:fd", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79ade91-3e", "ovs_interfaceid": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:15:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9b254b87-180b-486e-a9ff-cec3a3c9154c req-f141d00d-0a78-4995-b5cb-b8f80442f62e service nova] Releasing lock "refresh_cache-df5c717a-62d8-444d-9968-ad682a31733c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tIupEZoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:15:27 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:15:27 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:15:27 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b7cea4-3fc8-4824-a7a8-50797e5ed644]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:15:27 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ec34e8-1640-48b6-9948-e5d7b7150430]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040] added
Aug 26 19:15:27 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6d12cb-3450-4c6b-a497-c96455554da6]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74ca001-7f67-4860-b8f6-8b6610e68b5b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tIupEZoK {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tIupEZoK" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[72792d14-b6a6-4d15-a4f6-a5a0295e1082]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tIupEZoK'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f006d3-642d-46ed-a64c-ac97604b7782]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bd9b64-5b9e-4ecc-a1d9-00cd8832fe49]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)
Aug 26 19:15:27 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)
Aug 26 19:15:27 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a425e31-a72b-4921-8105-323db43d575c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040, portal: 172.16.0.220,3260]
Aug 26 19:15:27 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040, portal: 172.16.0.220,3260] successful.
Aug 26 19:15:27 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[56280564-931c-40cf-84c6-e401d68d5e2d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[40556328-1887-48d5-aa3c-6d7fb11e6025]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)
Aug 26 19:15:27 user nova-compute[73917]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 (non-flash)
Aug 26 19:15:27 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)
Aug 26 19:15:27 user nova-compute[73917]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 (non-flash)
Aug 26 19:15:27 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd650bd3-eb92-4263-a84c-4667b2fbcbcf]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:15:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:28 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:15:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tIupEZoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:15:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:15:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23736666666653830', 'path': '/dev/sdb'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:15:28 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736666666653830', 'path': '/dev/sdb'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:15:28 user nova-compute[73917]: DEBUG nova.objects.instance [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lazy-loading 'flavor' on Instance uuid f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:15:28 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:15:28 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:15:28 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 19:15:28 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:15:28 user nova-compute[73917]:   <serial>c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040</serial>
Aug 26 19:15:28 user nova-compute[73917]: </disk>
Aug 26 19:15:28 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:15:28 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:15:28 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:15:28 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] No VIF found with MAC fa:16:3e:dd:b4:69, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:15:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-63d8b95d-9c95-4511-b7ee-23ea27fdf43a tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.278s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG os_brick.utils [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7e8133-aae5-4616-819a-e832108c86a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8ca93e-9590-46bc-85cb-c5317b037395]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f993b0-9ec9-4698-b56b-62a05f3781cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d58d128-f203-4c0a-8514-8c54e6e90492]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:15:30 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:15:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e92ed14-328a-49f9-b08e-89c51517ef8e]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG os_brick.utils [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Updating existing volume attachment record: a053462d-8333-4de2-8ce9-0c7daf284f0d {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:30 user nova-compute[73917]: INFO nova.compute.manager [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Detaching volume c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040
Aug 26 19:15:30 user nova-compute[73917]: INFO nova.virt.block_device [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Attempting to driver detach volume c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 from mountpoint /dev/vdb
Aug 26 19:15:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Attempting to detach device vdb from instance f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:15:30 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:15:30 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 19:15:30 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:15:30 user nova-compute[73917]:   <serial>c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040</serial>
Aug 26 19:15:30 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:15:30 user nova-compute[73917]: </disk>
Aug 26 19:15:30 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:15:30 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Successfully detached device vdb from instance f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 from the persistent domain config.
Aug 26 19:15:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:15:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:15:30 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:15:30 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 19:15:30 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:15:30 user nova-compute[73917]:   <serial>c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040</serial>
Aug 26 19:15:30 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:15:30 user nova-compute[73917]: </disk>
Aug 26 19:15:30 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693077331.23191, f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:15:31 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Successfully detached device vdb from instance f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 from the live domain config.
Aug 26 19:15:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tIupEZoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:15:31 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:15:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d6ed8f-bd90-4730-90d9-b4f46252c374]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[db920489-3015-493e-8131-a40d3346d305]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)
Aug 26 19:15:31 user nova-compute[73917]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 (non-flash)
Aug 26 19:15:31 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)
Aug 26 19:15:31 user nova-compute[73917]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 (non-flash)
Aug 26 19:15:31 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b98376560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040'): ({'sdb'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Removing single pathed devices sdb {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68e784e-1a9b-4d46-b561-34313ceb75bc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca489a6a-cf8c-4be1-896e-6b46e50c5285]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Flushing IO for device /dev/sdb {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f371a32-218e-48b0-b882-d9e1f850d330]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68a5a96-195f-4fa1-84ef-5890c0040342]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee46e502-da7f-4212-bc2e-c4b2975b6d62]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c57c6d-4e84-4674-a5f7-c53e9c280a39]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040, portal: 172.16.0.220,3260]
Aug 26 19:15:31 user nova-compute[73917]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040, portal: 172.16.0.220,3260] successful.
Aug 26 19:15:31 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e2a8d7-84fa-41a0-9b7b-fb2d60ac2040 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee2fb8c-15c2-4f27-b0cb-1026f6d723ab]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] <== disconnect_volume: return (293ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:15:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:15:32 user nova-compute[73917]: DEBUG nova.objects.instance [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lazy-loading 'flavor' on Instance uuid f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:15:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-496248a4-f641-4bb0-a3fe-a0d2e84bc007 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.818s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:33 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:15:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:34 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:15:34 user nova-compute[73917]: INFO nova.compute.claims [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Claim successful on node user
Aug 26 19:15:34 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:15:34 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:15:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:34 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:15:34 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:15:34 user nova-compute[73917]: DEBUG nova.network.neutron [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:15:34 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:15:34 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:15:34 user nova-compute[73917]: DEBUG nova.policy [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '118080e0f2fe4533a25e002e894b99f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1298aa7a6ca478fb973d5a6d7bea7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:15:34 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:15:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:15:34 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Creating image(s)
Aug 26 19:15:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "/opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "/opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.215s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.236s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk 1073741824" returned: 0 in 0.053s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:35 user nova-compute[73917]: DEBUG nova.network.neutron [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Successfully created port: c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:15:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.219s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:35 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:15:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:35 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Cannot resize image /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:15:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:15:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Ensure instance console log exists: /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:15:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.network.neutron [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Successfully updated port: c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquired lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.network.neutron [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-3474ae2b-4bb8-4b03-b43a-f2fa67693928 req-14cfb5bf-3106-4423-92db-f76115e3d059 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received event network-changed-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-3474ae2b-4bb8-4b03-b43a-f2fa67693928 req-14cfb5bf-3106-4423-92db-f76115e3d059 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Refreshing instance network info cache due to event network-changed-c7ef21a0-d036-4b14-8067-594a1f2181ba. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3474ae2b-4bb8-4b03-b43a-f2fa67693928 req-14cfb5bf-3106-4423-92db-f76115e3d059 service nova] Acquiring lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.network.neutron [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.network.neutron [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Updating instance_info_cache with network_info: [{"id": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "address": "fa:16:3e:25:d1:18", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ef21a0-d0", "ovs_interfaceid": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Releasing lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Instance network_info: |[{"id": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "address": "fa:16:3e:25:d1:18", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ef21a0-d0", "ovs_interfaceid": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3474ae2b-4bb8-4b03-b43a-f2fa67693928 req-14cfb5bf-3106-4423-92db-f76115e3d059 service nova] Acquired lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.network.neutron [req-3474ae2b-4bb8-4b03-b43a-f2fa67693928 req-14cfb5bf-3106-4423-92db-f76115e3d059 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Refreshing network info cache for port c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Start _get_guest_xml network_info=[{"id": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "address": "fa:16:3e:25:d1:18", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ef21a0-d0", "ovs_interfaceid": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:15:36 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:15:36 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1308800063',display_name='tempest-ServerRescueNegativeTestJSON-server-1308800063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1308800063',id=24,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGjEgFmZWCuUIpbfIsdYNVrH57MJGBdjCsYvuXKTDomE8Sf1OwmCLTlNrmFypkCzReg1pf2c663Y/yL4RjOUVd7yq4SqAVhIAw4G8JOI8+uExEk9cM86FgJmqZfxMd1rw==',key_name='tempest-keypair-1145554874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1298aa7a6ca478fb973d5a6d7bea7be',ramdisk_id='',reservation_id='r-27guj55y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475026115',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475026115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:15:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='118080e0f2fe4533a25e002e894b99f9',uuid=f4e84db3-1f3b-471f-9f82-5a692fdb6c06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "address": "fa:16:3e:25:d1:18", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ef21a0-d0", "ovs_interfaceid": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converting VIF {"id": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "address": "fa:16:3e:25:d1:18", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ef21a0-d0", "ovs_interfaceid": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:d1:18,bridge_name='br-int',has_traffic_filtering=True,id=c7ef21a0-d036-4b14-8067-594a1f2181ba,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ef21a0-d0') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.objects.instance [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'pci_devices' on Instance uuid f4e84db3-1f3b-471f-9f82-5a692fdb6c06 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:15:36 user nova-compute[73917]:   <uuid>f4e84db3-1f3b-471f-9f82-5a692fdb6c06</uuid>
Aug 26 19:15:36 user nova-compute[73917]:   <name>instance-00000018</name>
Aug 26 19:15:36 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:15:36 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:15:36 user nova-compute[73917]:   <metadata>
Aug 26 19:15:36 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:15:36 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:15:36 user nova-compute[73917]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1308800063</nova:name>
Aug 26 19:15:36 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:15:36</nova:creationTime>
Aug 26 19:15:36 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:15:36 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:15:36 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:15:36 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:15:36 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:15:36 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:15:36 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:15:36 user nova-compute[73917]:       <nova:owner>
Aug 26 19:15:36 user nova-compute[73917]:         <nova:user uuid="118080e0f2fe4533a25e002e894b99f9">tempest-ServerRescueNegativeTestJSON-1475026115-project-member</nova:user>
Aug 26 19:15:36 user nova-compute[73917]:         <nova:project uuid="d1298aa7a6ca478fb973d5a6d7bea7be">tempest-ServerRescueNegativeTestJSON-1475026115</nova:project>
Aug 26 19:15:36 user nova-compute[73917]:       </nova:owner>
Aug 26 19:15:36 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:15:36 user nova-compute[73917]:       <nova:ports>
Aug 26 19:15:36 user nova-compute[73917]:         <nova:port uuid="c7ef21a0-d036-4b14-8067-594a1f2181ba">
Aug 26 19:15:36 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 19:15:36 user nova-compute[73917]:         </nova:port>
Aug 26 19:15:36 user nova-compute[73917]:       </nova:ports>
Aug 26 19:15:36 user nova-compute[73917]:     </nova:instance>
Aug 26 19:15:36 user nova-compute[73917]:   </metadata>
Aug 26 19:15:36 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:15:36 user nova-compute[73917]:     <system>
Aug 26 19:15:36 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:15:36 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:15:36 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:15:36 user nova-compute[73917]:       <entry name="serial">f4e84db3-1f3b-471f-9f82-5a692fdb6c06</entry>
Aug 26 19:15:36 user nova-compute[73917]:       <entry name="uuid">f4e84db3-1f3b-471f-9f82-5a692fdb6c06</entry>
Aug 26 19:15:36 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:15:36 user nova-compute[73917]:     </system>
Aug 26 19:15:36 user nova-compute[73917]:   </sysinfo>
Aug 26 19:15:36 user nova-compute[73917]:   <os>
Aug 26 19:15:36 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:15:36 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:15:36 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:15:36 user nova-compute[73917]:   </os>
Aug 26 19:15:36 user nova-compute[73917]:   <features>
Aug 26 19:15:36 user nova-compute[73917]:     <acpi/>
Aug 26 19:15:36 user nova-compute[73917]:     <apic/>
Aug 26 19:15:36 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:15:36 user nova-compute[73917]:   </features>
Aug 26 19:15:36 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:15:36 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:15:36 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:15:36 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:15:36 user nova-compute[73917]:   </clock>
Aug 26 19:15:36 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:15:36 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:15:36 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:15:36 user nova-compute[73917]:   </cpu>
Aug 26 19:15:36 user nova-compute[73917]:   <devices>
Aug 26 19:15:36 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:15:36 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:15:36 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk"/>
Aug 26 19:15:36 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:15:36 user nova-compute[73917]:     </disk>
Aug 26 19:15:36 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:15:36 user nova-compute[73917]:       <mac address="fa:16:3e:25:d1:18"/>
Aug 26 19:15:36 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:15:36 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:15:36 user nova-compute[73917]:       <target dev="tapc7ef21a0-d0"/>
Aug 26 19:15:36 user nova-compute[73917]:     </interface>
Aug 26 19:15:36 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:15:36 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/console.log" append="off"/>
Aug 26 19:15:36 user nova-compute[73917]:     </serial>
Aug 26 19:15:36 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:15:36 user nova-compute[73917]:     <video>
Aug 26 19:15:36 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:15:36 user nova-compute[73917]:     </video>
Aug 26 19:15:36 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:15:36 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:15:36 user nova-compute[73917]:     </rng>
Aug 26 19:15:36 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:15:36 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:15:36 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:15:36 user nova-compute[73917]:     </memballoon>
Aug 26 19:15:36 user nova-compute[73917]:   </devices>
Aug 26 19:15:36 user nova-compute[73917]: </domain>
Aug 26 19:15:36 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1308800063',display_name='tempest-ServerRescueNegativeTestJSON-server-1308800063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1308800063',id=24,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGjEgFmZWCuUIpbfIsdYNVrH57MJGBdjCsYvuXKTDomE8Sf1OwmCLTlNrmFypkCzReg1pf2c663Y/yL4RjOUVd7yq4SqAVhIAw4G8JOI8+uExEk9cM86FgJmqZfxMd1rw==',key_name='tempest-keypair-1145554874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1298aa7a6ca478fb973d5a6d7bea7be',ramdisk_id='',reservation_id='r-27guj55y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475026115',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475026115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:15:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='118080e0f2fe4533a25e002e894b99f9',uuid=f4e84db3-1f3b-471f-9f82-5a692fdb6c06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "address": "fa:16:3e:25:d1:18", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ef21a0-d0", "ovs_interfaceid": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converting VIF {"id": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "address": "fa:16:3e:25:d1:18", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ef21a0-d0", "ovs_interfaceid": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:d1:18,bridge_name='br-int',has_traffic_filtering=True,id=c7ef21a0-d036-4b14-8067-594a1f2181ba,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ef21a0-d0') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG os_vif [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:d1:18,bridge_name='br-int',has_traffic_filtering=True,id=c7ef21a0-d036-4b14-8067-594a1f2181ba,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ef21a0-d0') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7ef21a0-d0, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc7ef21a0-d0, col_values=(('external_ids', {'iface-id': 'c7ef21a0-d036-4b14-8067-594a1f2181ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:d1:18', 'vm-uuid': 'f4e84db3-1f3b-471f-9f82-5a692fdb6c06'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:15:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:15:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:37 user nova-compute[73917]: INFO os_vif [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:d1:18,bridge_name='br-int',has_traffic_filtering=True,id=c7ef21a0-d036-4b14-8067-594a1f2181ba,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ef21a0-d0')
Aug 26 19:15:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:15:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] No VIF found with MAC fa:16:3e:25:d1:18, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:15:37 user nova-compute[73917]: DEBUG nova.network.neutron [req-3474ae2b-4bb8-4b03-b43a-f2fa67693928 req-14cfb5bf-3106-4423-92db-f76115e3d059 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Updated VIF entry in instance network info cache for port c7ef21a0-d036-4b14-8067-594a1f2181ba. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:15:37 user nova-compute[73917]: DEBUG nova.network.neutron [req-3474ae2b-4bb8-4b03-b43a-f2fa67693928 req-14cfb5bf-3106-4423-92db-f76115e3d059 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Updating instance_info_cache with network_info: [{"id": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "address": "fa:16:3e:25:d1:18", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ef21a0-d0", "ovs_interfaceid": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:15:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3474ae2b-4bb8-4b03-b43a-f2fa67693928 req-14cfb5bf-3106-4423-92db-f76115e3d059 service nova] Releasing lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:15:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:38 user nova-compute[73917]: DEBUG nova.compute.manager [req-629b7a68-c2cd-4f93-9775-2d520659111f req-19029f30-b7c1-4529-8e3d-7e4b51964a12 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received event network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:15:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-629b7a68-c2cd-4f93-9775-2d520659111f req-19029f30-b7c1-4529-8e3d-7e4b51964a12 service nova] Acquiring lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-629b7a68-c2cd-4f93-9775-2d520659111f req-19029f30-b7c1-4529-8e3d-7e4b51964a12 service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-629b7a68-c2cd-4f93-9775-2d520659111f req-19029f30-b7c1-4529-8e3d-7e4b51964a12 service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:38 user nova-compute[73917]: DEBUG nova.compute.manager [req-629b7a68-c2cd-4f93-9775-2d520659111f req-19029f30-b7c1-4529-8e3d-7e4b51964a12 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] No waiting events found dispatching network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:15:38 user nova-compute[73917]: WARNING nova.compute.manager [req-629b7a68-c2cd-4f93-9775-2d520659111f req-19029f30-b7c1-4529-8e3d-7e4b51964a12 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received unexpected event network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba for instance with vm_state building and task_state spawning.
Aug 26 19:15:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.compute.manager [req-288c7559-d8fa-49b9-976d-17797377a88e req-a2d0d44d-7e4c-477f-83bc-6f394092c74a service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Received event network-changed-4c360957-8f3b-4887-8efb-74e42c75d777 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.compute.manager [req-288c7559-d8fa-49b9-976d-17797377a88e req-a2d0d44d-7e4c-477f-83bc-6f394092c74a service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Refreshing instance network info cache due to event network-changed-4c360957-8f3b-4887-8efb-74e42c75d777. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-288c7559-d8fa-49b9-976d-17797377a88e req-a2d0d44d-7e4c-477f-83bc-6f394092c74a service nova] Acquiring lock "refresh_cache-9628e76c-a137-4499-96d7-5f6a30eb6dad" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-288c7559-d8fa-49b9-976d-17797377a88e req-a2d0d44d-7e4c-477f-83bc-6f394092c74a service nova] Acquired lock "refresh_cache-9628e76c-a137-4499-96d7-5f6a30eb6dad" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.network.neutron [req-288c7559-d8fa-49b9-976d-17797377a88e req-a2d0d44d-7e4c-477f-83bc-6f394092c74a service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Refreshing network info cache for port 4c360957-8f3b-4887-8efb-74e42c75d777 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.network.neutron [req-288c7559-d8fa-49b9-976d-17797377a88e req-a2d0d44d-7e4c-477f-83bc-6f394092c74a service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Updated VIF entry in instance network info cache for port 4c360957-8f3b-4887-8efb-74e42c75d777. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.network.neutron [req-288c7559-d8fa-49b9-976d-17797377a88e req-a2d0d44d-7e4c-477f-83bc-6f394092c74a service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Updating instance_info_cache with network_info: [{"id": "4c360957-8f3b-4887-8efb-74e42c75d777", "address": "fa:16:3e:ac:6b:52", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c360957-8f", "ovs_interfaceid": "4c360957-8f3b-4887-8efb-74e42c75d777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-288c7559-d8fa-49b9-976d-17797377a88e req-a2d0d44d-7e4c-477f-83bc-6f394092c74a service nova] Releasing lock "refresh_cache-9628e76c-a137-4499-96d7-5f6a30eb6dad" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.compute.manager [req-749b6716-1d37-480a-9a80-466b5ab0acf1 req-620f1dc6-b1c9-4a2a-8e55-1854ca931080 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received event network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-749b6716-1d37-480a-9a80-466b5ab0acf1 req-620f1dc6-b1c9-4a2a-8e55-1854ca931080 service nova] Acquiring lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-749b6716-1d37-480a-9a80-466b5ab0acf1 req-620f1dc6-b1c9-4a2a-8e55-1854ca931080 service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-749b6716-1d37-480a-9a80-466b5ab0acf1 req-620f1dc6-b1c9-4a2a-8e55-1854ca931080 service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.compute.manager [req-749b6716-1d37-480a-9a80-466b5ab0acf1 req-620f1dc6-b1c9-4a2a-8e55-1854ca931080 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] No waiting events found dispatching network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:15:40 user nova-compute[73917]: WARNING nova.compute.manager [req-749b6716-1d37-480a-9a80-466b5ab0acf1 req-620f1dc6-b1c9-4a2a-8e55-1854ca931080 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received unexpected event network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba for instance with vm_state building and task_state spawning.
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077340.812699, f4e84db3-1f3b-471f-9f82-5a692fdb6c06 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:15:40 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] VM Resumed (Lifecycle Event)
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:15:40 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Instance spawned successfully.
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:15:40 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077340.81552, f4e84db3-1f3b-471f-9f82-5a692fdb6c06 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:15:40 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] VM Started (Lifecycle Event)
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:15:40 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:15:40 user nova-compute[73917]: INFO nova.compute.manager [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Took 6.13 seconds to spawn the instance on the hypervisor.
Aug 26 19:15:40 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:15:41 user nova-compute[73917]: INFO nova.compute.manager [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Took 7.04 seconds to build instance.
Aug 26 19:15:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c5308be-12e2-482a-a0b2-31fe15c74ef2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.171s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "9628e76c-a137-4499-96d7-5f6a30eb6dad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG nova.objects.instance [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lazy-loading 'flavor' on Instance uuid 9628e76c-a137-4499-96d7-5f6a30eb6dad {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "9628e76c-a137-4499-96d7-5f6a30eb6dad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:48 user nova-compute[73917]: INFO nova.compute.manager [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Attaching volume 3e2cd123-e943-4037-8879-49bc68cc4c43 to /dev/vdb
Aug 26 19:15:48 user nova-compute[73917]: DEBUG os_brick.utils [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[555ee569-71cd-4a72-af2c-b5236fef5ef0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78ac22c-a18d-4ff6-a5fc-c807f89d0c9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7750da92-b442-4ce3-9260-969be0866309]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfd7353-888d-45de-a3e6-bb7b8e85232c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:15:48 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:15:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d9c7c4-0d2d-4d2a-8931-f312221d2b30]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG os_brick.utils [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:15:48 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Updating existing volume attachment record: 2e42f005-3e5e-44ac-b587-a3b6cd50413c {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:15:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:54 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:15:54 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:15:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-fd801f18-34b6-4682-8d43-edf82bd216c2" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:15:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-fd801f18-34b6-4682-8d43-edf82bd216c2" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:15:54 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:15:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "c4218678-e287-4f07-8af1-59469bbcd6bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:54 user nova-compute[73917]: INFO nova.compute.manager [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Detaching volume 0c50da8f-60da-4a1a-8ba9-b0202b97349a
Aug 26 19:15:55 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Updating instance_info_cache with network_info: [{"id": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "address": "fa:16:3e:9c:f5:38", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b11e5e-5c", "ovs_interfaceid": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-fd801f18-34b6-4682-8d43-edf82bd216c2" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:15:55 user nova-compute[73917]: INFO nova.virt.block_device [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Attempting to driver detach volume 0c50da8f-60da-4a1a-8ba9-b0202b97349a from mountpoint /dev/vdb
Aug 26 19:15:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Attempting to detach device vdb from instance c4218678-e287-4f07-8af1-59469bbcd6bd from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:15:55 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:15:55 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:15:55 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:15:55 user nova-compute[73917]:   <serial>0c50da8f-60da-4a1a-8ba9-b0202b97349a</serial>
Aug 26 19:15:55 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 19:15:55 user nova-compute[73917]: </disk>
Aug 26 19:15:55 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:15:55 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Successfully detached device vdb from instance c4218678-e287-4f07-8af1-59469bbcd6bd from the persistent domain config.
Aug 26 19:15:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c4218678-e287-4f07-8af1-59469bbcd6bd from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:15:55 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:15:55 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:15:55 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:15:55 user nova-compute[73917]:   <serial>0c50da8f-60da-4a1a-8ba9-b0202b97349a</serial>
Aug 26 19:15:55 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 19:15:55 user nova-compute[73917]: </disk>
Aug 26 19:15:55 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693077355.5516248, c4218678-e287-4f07-8af1-59469bbcd6bd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c4218678-e287-4f07-8af1-59469bbcd6bd {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:15:55 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Successfully detached device vdb from instance c4218678-e287-4f07-8af1-59469bbcd6bd from the live domain config.
Aug 26 19:15:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeLCvVUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:15:55 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:15:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7eee6df-9e99-41f9-b614-3ed375a317e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6873d796-63c3-46c9-a09e-cf23ac21dfa6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)
Aug 26 19:15:55 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a (non-flash)
Aug 26 19:15:55 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b786b2680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a'): ({'sdc'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Removing single pathed devices sdc {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb60811-3dfa-40e7-b543-5da6dce9554a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cc7b01-a2e8-4fec-9ec8-c286e90efbc2]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Flushing IO for device /dev/sdc {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5af69f6-2279-4947-bdbe-92d3a50a2777]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[beed840a-b77e-4437-b4dd-7d3838fea5be]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef99c30-55c0-4046-bda5-2c669a469ece]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6eef1a1-ce11-4d88-ac1f-9ac289a91b0a]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a, portal: 172.16.0.220,3260]
Aug 26 19:15:55 user nova-compute[73917]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a, portal: 172.16.0.220,3260] successful.
Aug 26 19:15:55 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50da8f-60da-4a1a-8ba9-b0202b97349a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6993715-78b5-4eab-a500-25d323284e3e]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] <== disconnect_volume: return (289ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:15:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:15:56 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Creating image(s)
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Did not create local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Ensure instance console log exists: /opt/stack/data/nova/instances/df5c717a-62d8-444d-9968-ad682a31733c/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Start _get_guest_xml network_info=[{"id": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "address": "fa:16:3e:ca:39:fd", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79ade91-3e", "ovs_interfaceid": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igCIsrHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'df5c717a-62d8-444d-9968-ad682a31733c', 'attached_at': '', 'detached_at': '', 'volume_id': '6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8', 'serial': '6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'a053462d-8333-4de2-8ce9-0c7daf284f0d', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:15:56 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:15:56 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igCIsrHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:15:56 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:15:56 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:15:56 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e954c30d-1167-406e-bf68-e44d9ec28b65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:15:56 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf508c4a-38b2-4242-9527-d49d607dd817]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8] added
Aug 26 19:15:56 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d945c62e-a96b-4c2c-ab38-63e1195870b0]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d010534-5646-49c1-9881-494412ce8cfb]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v igCIsrHF {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v igCIsrHF" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3780e439-d8b4-4f34-ac5f-2e2ce7e28a34]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'igCIsrHF'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1a2dce-5029-4f48-b5fb-781de7b30d6c]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c5b2cb-a293-41ae-8c76-ca8a9b012e60]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 19:15:56 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 19:15:56 user nova-compute[73917]:  {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:15:56 user nova-compute[73917]: WARNING os_brick.initiator.connectors.iscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 19:15:56 user nova-compute[73917]: 
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[25162dfb-355c-4979-9acf-dd61e2f5ebe9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8, portal: 172.16.0.220,3260]
Aug 26 19:15:56 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8, portal: 172.16.0.220,3260] successful.
Aug 26 19:15:56 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9835048e-e77d-467a-9d1f-1349facf631f]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4802296-5d10-4668-aa31-d563224a4d60]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:15:56 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:15:56 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[407a6db3-4aad-4bc5-926b-1a5a40484faa]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: None {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Acquiring lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Acquiring lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:56 user nova-compute[73917]: INFO nova.compute.manager [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Terminating instance
Aug 26 19:15:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG nova.compute.manager [req-1529749d-3899-4487-bfa6-dfb36a7a76ef req-0d94b59e-decc-42e7-90fe-63a5ab93826f service nova] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Received event network-vif-unplugged-0c46d6d6-91e9-496f-9288-5f70608cf324 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1529749d-3899-4487-bfa6-dfb36a7a76ef req-0d94b59e-decc-42e7-90fe-63a5ab93826f service nova] Acquiring lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1529749d-3899-4487-bfa6-dfb36a7a76ef req-0d94b59e-decc-42e7-90fe-63a5ab93826f service nova] Lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1529749d-3899-4487-bfa6-dfb36a7a76ef req-0d94b59e-decc-42e7-90fe-63a5ab93826f service nova] Lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG nova.compute.manager [req-1529749d-3899-4487-bfa6-dfb36a7a76ef req-0d94b59e-decc-42e7-90fe-63a5ab93826f service nova] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] No waiting events found dispatching network-vif-unplugged-0c46d6d6-91e9-496f-9288-5f70608cf324 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG nova.compute.manager [req-1529749d-3899-4487-bfa6-dfb36a7a76ef req-0d94b59e-decc-42e7-90fe-63a5ab93826f service nova] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Received event network-vif-unplugged-0c46d6d6-91e9-496f-9288-5f70608cf324 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:15:57 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Instance destroyed successfully.
Aug 26 19:15:57 user nova-compute[73917]: DEBUG nova.objects.instance [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lazy-loading 'resources' on Instance uuid 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-135361502',display_name='tempest-ServersNegativeTestJSON-server-135361502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-135361502',id=22,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:14:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae04a1daa9c34775b7edfbce043b47c1',ramdisk_id='',reservation_id='r-mpxmqf0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-252207510',owner_user_name='tempest-ServersNegativeTestJSON-252207510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:14:13Z,user_data=None,user_id='811ce763d55a4aefb116079215d01fdb',uuid=8f2eed3f-0aac-4fbb-a958-ee8934c0e41a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c46d6d6-91e9-496f-9288-5f70608cf324", "address": "fa:16:3e:2b:eb:d6", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c46d6d6-91", "ovs_interfaceid": "0c46d6d6-91e9-496f-9288-5f70608cf324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Converting VIF {"id": "0c46d6d6-91e9-496f-9288-5f70608cf324", "address": "fa:16:3e:2b:eb:d6", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c46d6d6-91", "ovs_interfaceid": "0c46d6d6-91e9-496f-9288-5f70608cf324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:eb:d6,bridge_name='br-int',has_traffic_filtering=True,id=0c46d6d6-91e9-496f-9288-5f70608cf324,network=Network(06a65360-57e6-4419-8e18-8cfb937e1704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c46d6d6-91') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG os_vif [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:eb:d6,bridge_name='br-int',has_traffic_filtering=True,id=0c46d6d6-91e9-496f-9288-5f70608cf324,network=Network(06a65360-57e6-4419-8e18-8cfb937e1704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c46d6d6-91') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c46d6d6-91, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:15:57 user nova-compute[73917]: INFO os_vif [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:eb:d6,bridge_name='br-int',has_traffic_filtering=True,id=0c46d6d6-91e9-496f-9288-5f70608cf324,network=Network(06a65360-57e6-4419-8e18-8cfb937e1704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c46d6d6-91')
Aug 26 19:15:57 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Deleting instance files /opt/stack/data/nova/instances/8f2eed3f-0aac-4fbb-a958-ee8934c0e41a_del
Aug 26 19:15:57 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Deletion of /opt/stack/data/nova/instances/8f2eed3f-0aac-4fbb-a958-ee8934c0e41a_del complete
Aug 26 19:15:57 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igCIsrHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23136366333303664', 'path': '/dev/sdb'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136366333303664', 'path': '/dev/sdb'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:15:57 user nova-compute[73917]: INFO nova.compute.manager [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 26 19:15:57 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1063003833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1063003833',id=23,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68229e3ed72a45fa8c2c9a33780479ce',ramdisk_id='',reservation_id='r-3l0cspu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:15:24Z,user_data=None,user_id='e056c4ed5a18427a8fd1eaa6a3a795c0',uuid=df5c717a-62d8-444d-9968-ad682a31733c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "address": "fa:16:3e:ca:39:fd", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79ade91-3e", "ovs_interfaceid": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converting VIF {"id": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "address": "fa:16:3e:ca:39:fd", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79ade91-3e", "ovs_interfaceid": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:39:fd,bridge_name='br-int',has_traffic_filtering=True,id=b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb79ade91-3e') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG nova.objects.instance [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'pci_devices' on Instance uuid df5c717a-62d8-444d-9968-ad682a31733c {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:15:57 user nova-compute[73917]:   <uuid>df5c717a-62d8-444d-9968-ad682a31733c</uuid>
Aug 26 19:15:57 user nova-compute[73917]:   <name>instance-00000017</name>
Aug 26 19:15:57 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:15:57 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:15:57 user nova-compute[73917]:   <metadata>
Aug 26 19:15:57 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:15:57 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:15:57 user nova-compute[73917]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1063003833</nova:name>
Aug 26 19:15:57 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:15:56</nova:creationTime>
Aug 26 19:15:57 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:15:57 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:15:57 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:15:57 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:15:57 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:15:57 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:15:57 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:15:57 user nova-compute[73917]:       <nova:owner>
Aug 26 19:15:57 user nova-compute[73917]:         <nova:user uuid="e056c4ed5a18427a8fd1eaa6a3a795c0">tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member</nova:user>
Aug 26 19:15:57 user nova-compute[73917]:         <nova:project uuid="68229e3ed72a45fa8c2c9a33780479ce">tempest-ServerBootFromVolumeStableRescueTest-1067875450</nova:project>
Aug 26 19:15:57 user nova-compute[73917]:       </nova:owner>
Aug 26 19:15:57 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:15:57 user nova-compute[73917]:       <nova:ports>
Aug 26 19:15:57 user nova-compute[73917]:         <nova:port uuid="b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e">
Aug 26 19:15:57 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 19:15:57 user nova-compute[73917]:         </nova:port>
Aug 26 19:15:57 user nova-compute[73917]:       </nova:ports>
Aug 26 19:15:57 user nova-compute[73917]:     </nova:instance>
Aug 26 19:15:57 user nova-compute[73917]:   </metadata>
Aug 26 19:15:57 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:15:57 user nova-compute[73917]:     <system>
Aug 26 19:15:57 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:15:57 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:15:57 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:15:57 user nova-compute[73917]:       <entry name="serial">df5c717a-62d8-444d-9968-ad682a31733c</entry>
Aug 26 19:15:57 user nova-compute[73917]:       <entry name="uuid">df5c717a-62d8-444d-9968-ad682a31733c</entry>
Aug 26 19:15:57 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:15:57 user nova-compute[73917]:     </system>
Aug 26 19:15:57 user nova-compute[73917]:   </sysinfo>
Aug 26 19:15:57 user nova-compute[73917]:   <os>
Aug 26 19:15:57 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:15:57 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:15:57 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:15:57 user nova-compute[73917]:   </os>
Aug 26 19:15:57 user nova-compute[73917]:   <features>
Aug 26 19:15:57 user nova-compute[73917]:     <acpi/>
Aug 26 19:15:57 user nova-compute[73917]:     <apic/>
Aug 26 19:15:57 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:15:57 user nova-compute[73917]:   </features>
Aug 26 19:15:57 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:15:57 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:15:57 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:15:57 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:15:57 user nova-compute[73917]:   </clock>
Aug 26 19:15:57 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:15:57 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:15:57 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:15:57 user nova-compute[73917]:   </cpu>
Aug 26 19:15:57 user nova-compute[73917]:   <devices>
Aug 26 19:15:57 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:15:57 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:15:57 user nova-compute[73917]:       <source dev="/dev/sdb"/>
Aug 26 19:15:57 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:15:57 user nova-compute[73917]:       <serial>6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8</serial>
Aug 26 19:15:57 user nova-compute[73917]:     </disk>
Aug 26 19:15:57 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:15:57 user nova-compute[73917]:       <mac address="fa:16:3e:ca:39:fd"/>
Aug 26 19:15:57 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:15:57 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:15:57 user nova-compute[73917]:       <target dev="tapb79ade91-3e"/>
Aug 26 19:15:57 user nova-compute[73917]:     </interface>
Aug 26 19:15:57 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:15:57 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/df5c717a-62d8-444d-9968-ad682a31733c/console.log" append="off"/>
Aug 26 19:15:57 user nova-compute[73917]:     </serial>
Aug 26 19:15:57 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:15:57 user nova-compute[73917]:     <video>
Aug 26 19:15:57 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:15:57 user nova-compute[73917]:     </video>
Aug 26 19:15:57 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:15:57 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:15:57 user nova-compute[73917]:     </rng>
Aug 26 19:15:57 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:15:57 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:15:57 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:15:57 user nova-compute[73917]:     </memballoon>
Aug 26 19:15:57 user nova-compute[73917]:   </devices>
Aug 26 19:15:57 user nova-compute[73917]: </domain>
Aug 26 19:15:57 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1063003833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1063003833',id=23,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68229e3ed72a45fa8c2c9a33780479ce',ramdisk_id='',reservation_id='r-3l0cspu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:15:24Z,user_data=None,user_id='e056c4ed5a18427a8fd1eaa6a3a795c0',uuid=df5c717a-62d8-444d-9968-ad682a31733c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "address": "fa:16:3e:ca:39:fd", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79ade91-3e", "ovs_interfaceid": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converting VIF {"id": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "address": "fa:16:3e:ca:39:fd", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79ade91-3e", "ovs_interfaceid": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:39:fd,bridge_name='br-int',has_traffic_filtering=True,id=b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb79ade91-3e') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG os_vif [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:39:fd,bridge_name='br-int',has_traffic_filtering=True,id=b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb79ade91-3e') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb79ade91-3e, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb79ade91-3e, col_values=(('external_ids', {'iface-id': 'b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:39:fd', 'vm-uuid': 'df5c717a-62d8-444d-9968-ad682a31733c'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:15:57 user nova-compute[73917]: INFO os_vif [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:39:fd,bridge_name='br-int',has_traffic_filtering=True,id=b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb79ade91-3e')
Aug 26 19:15:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:15:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] No VIF found with MAC fa:16:3e:ca:39:fd, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:15:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:58 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:15:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:58 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Took 0.59 seconds to deallocate network for instance.
Aug 26 19:15:58 user nova-compute[73917]: DEBUG nova.compute.manager [req-a366d7f8-3afb-4b2b-9fcd-e735a245d003 req-278824e0-c8f1-428e-a87b-203aeddb82bd service nova] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Received event network-vif-deleted-0c46d6d6-91e9-496f-9288-5f70608cf324 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:15:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:58 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:15:59 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:15:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.594s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:59 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Deleted allocations for instance 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a
Aug 26 19:15:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-47ac1b34-8d4f-4c39-b28f-934735c3ecd7 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.345s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:59 user nova-compute[73917]: DEBUG nova.compute.manager [req-0e7dd75b-2ed9-420d-82ea-c44b14e3039d req-4b79c615-4589-4941-bb8e-3cb1c29d1871 service nova] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Received event network-vif-plugged-0c46d6d6-91e9-496f-9288-5f70608cf324 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:15:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0e7dd75b-2ed9-420d-82ea-c44b14e3039d req-4b79c615-4589-4941-bb8e-3cb1c29d1871 service nova] Acquiring lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:15:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0e7dd75b-2ed9-420d-82ea-c44b14e3039d req-4b79c615-4589-4941-bb8e-3cb1c29d1871 service nova] Lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:15:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0e7dd75b-2ed9-420d-82ea-c44b14e3039d req-4b79c615-4589-4941-bb8e-3cb1c29d1871 service nova] Lock "8f2eed3f-0aac-4fbb-a958-ee8934c0e41a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:15:59 user nova-compute[73917]: DEBUG nova.compute.manager [req-0e7dd75b-2ed9-420d-82ea-c44b14e3039d req-4b79c615-4589-4941-bb8e-3cb1c29d1871 service nova] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] No waiting events found dispatching network-vif-plugged-0c46d6d6-91e9-496f-9288-5f70608cf324 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:15:59 user nova-compute[73917]: WARNING nova.compute.manager [req-0e7dd75b-2ed9-420d-82ea-c44b14e3039d req-4b79c615-4589-4941-bb8e-3cb1c29d1871 service nova] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Received unexpected event network-vif-plugged-0c46d6d6-91e9-496f-9288-5f70608cf324 for instance with vm_state deleted and task_state None.
Aug 26 19:15:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:15:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:15:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:15:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.compute.manager [req-78ab17c0-5831-4846-b9e4-4f643a6aca62 req-0ce0aa83-86d6-4f79-a7af-fed1f5014ff7 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received event network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-78ab17c0-5831-4846-b9e4-4f643a6aca62 req-0ce0aa83-86d6-4f79-a7af-fed1f5014ff7 service nova] Acquiring lock "df5c717a-62d8-444d-9968-ad682a31733c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-78ab17c0-5831-4846-b9e4-4f643a6aca62 req-0ce0aa83-86d6-4f79-a7af-fed1f5014ff7 service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-78ab17c0-5831-4846-b9e4-4f643a6aca62 req-0ce0aa83-86d6-4f79-a7af-fed1f5014ff7 service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.compute.manager [req-78ab17c0-5831-4846-b9e4-4f643a6aca62 req-0ce0aa83-86d6-4f79-a7af-fed1f5014ff7 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] No waiting events found dispatching network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:16:01 user nova-compute[73917]: WARNING nova.compute.manager [req-78ab17c0-5831-4846-b9e4-4f643a6aca62 req-0ce0aa83-86d6-4f79-a7af-fed1f5014ff7 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received unexpected event network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e for instance with vm_state building and task_state spawning.
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.compute.manager [req-78ab17c0-5831-4846-b9e4-4f643a6aca62 req-0ce0aa83-86d6-4f79-a7af-fed1f5014ff7 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received event network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-78ab17c0-5831-4846-b9e4-4f643a6aca62 req-0ce0aa83-86d6-4f79-a7af-fed1f5014ff7 service nova] Acquiring lock "df5c717a-62d8-444d-9968-ad682a31733c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-78ab17c0-5831-4846-b9e4-4f643a6aca62 req-0ce0aa83-86d6-4f79-a7af-fed1f5014ff7 service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-78ab17c0-5831-4846-b9e4-4f643a6aca62 req-0ce0aa83-86d6-4f79-a7af-fed1f5014ff7 service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.compute.manager [req-78ab17c0-5831-4846-b9e4-4f643a6aca62 req-0ce0aa83-86d6-4f79-a7af-fed1f5014ff7 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] No waiting events found dispatching network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:16:01 user nova-compute[73917]: WARNING nova.compute.manager [req-78ab17c0-5831-4846-b9e4-4f643a6aca62 req-0ce0aa83-86d6-4f79-a7af-fed1f5014ff7 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received unexpected event network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e for instance with vm_state building and task_state spawning.
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHKFmAWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:16:01 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:16:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.006s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:16:01 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:16:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:16:01 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8cf390-e39e-4447-a8c2-68a212f92a04]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:16:01 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[45eb34b1-de43-47d5-a124-1a8ed0ca16eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43] added
Aug 26 19:16:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[369bca8d-2e41-4694-bb33-755214d5c408]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd85cf4c-2415-490c-9b88-4f0e6706352f]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rHKFmAWZ {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rHKFmAWZ" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8923fce2-486e-4c82-af33-15b16d827829]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rHKFmAWZ'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077361.7343428, df5c717a-62d8-444d-9968-ad682a31733c => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:16:01 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] VM Resumed (Lifecycle Event)
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:16:01 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Instance spawned successfully.
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92dc8fc-2e9a-46e2-b5e9-e71f8094ac1f]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c74fcd8-6823-4248-abff-3c44f1b95a97]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:16:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:16:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4508c159-3f39-4f8a-bad0-5d5b8076f5b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.objects.instance [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lazy-loading 'flavor' on Instance uuid c4218678-e287-4f07-8af1-59469bbcd6bd {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:16:01 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077361.7371454, df5c717a-62d8-444d-9968-ad682a31733c => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:16:01 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] VM Started (Lifecycle Event)
Aug 26 19:16:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43, portal: 172.16.0.220,3260]
Aug 26 19:16:01 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43, portal: 172.16.0.220,3260] successful.
Aug 26 19:16:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:01 user nova-compute[73917]: INFO nova.compute.manager [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Took 5.56 seconds to spawn the instance on the hypervisor.
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0e51bd-1615-4c6b-a426-12133b6a98a2]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3723ca34-f8f7-4c1c-b1ba-a347fd12c3af tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.030s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e456996-c84f-4730-a647-298aa7c216f3]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:16:02 user nova-compute[73917]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 (non-flash)
Aug 26 19:16:02 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:16:02 user nova-compute[73917]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 (non-flash)
Aug 26 19:16:02 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:02 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:16:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[547537b8-e426-410d-add9-94702b80611c]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHKFmAWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:16:02 user nova-compute[73917]: INFO nova.compute.manager [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Took 38.50 seconds to build instance.
Aug 26 19:16:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d19018f5-e03b-4b11-bdd1-450f6ef1d842 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "df5c717a-62d8-444d-9968-ad682a31733c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.671s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:02 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Error from libvirt while getting description of instance-00000016: [Error Code 42] Domain not found: no domain with matching uuid '8f2eed3f-0aac-4fbb-a958-ee8934c0e41a' (instance-00000016): libvirt.libvirtError: Domain not found: no domain with matching uuid '8f2eed3f-0aac-4fbb-a958-ee8934c0e41a' (instance-00000016)
Aug 26 19:16:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.988s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] <== connect_volume: return (1994ms) {'type': 'block', 'scsi_wwn': '26238393537616662', 'path': '/dev/sdc'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238393537616662', 'path': '/dev/sdc'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:16:03 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:16:03 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:16:03 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=7102MB free_disk=25.337947845458984GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG nova.objects.instance [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lazy-loading 'flavor' on Instance uuid 9628e76c-a137-4499-96d7-5f6a30eb6dad {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:16:03 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:16:03 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:16:03 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:16:03 user nova-compute[73917]:   <serial>3e2cd123-e943-4037-8879-49bc68cc4c43</serial>
Aug 26 19:16:03 user nova-compute[73917]: </disk>
Aug 26 19:16:03 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance cc0ae046-2a39-4ab6-9327-2d9452c3035d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fd801f18-34b6-4682-8d43-edf82bd216c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fdfb377e-119e-41ce-b9e0-6e21053306cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c4218678-e287-4f07-8af1-59469bbcd6bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 481cc682-2004-434d-b4eb-1688b0b07dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 94f8d4e7-f310-45df-a0ae-82e608ac0119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance dca28d65-37d0-4b60-b8aa-dcca61b6a187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 9628e76c-a137-4499-96d7-5f6a30eb6dad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance df5c717a-62d8-444d-9968-ad682a31733c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f4e84db3-1f3b-471f-9f82-5a692fdb6c06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:16:03 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:16:04 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:16:04 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:16:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:16:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:16:04 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] No VIF found with MAC fa:16:3e:ac:6b:52, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:16:04 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:16:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.757s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-23acfa00-006e-4c39-b18c-45c497a753b3 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.901s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "9628e76c-a137-4499-96d7-5f6a30eb6dad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:05 user nova-compute[73917]: INFO nova.compute.manager [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Detaching volume 3e2cd123-e943-4037-8879-49bc68cc4c43
Aug 26 19:16:05 user nova-compute[73917]: INFO nova.virt.block_device [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Attempting to driver detach volume 3e2cd123-e943-4037-8879-49bc68cc4c43 from mountpoint /dev/vdb
Aug 26 19:16:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Attempting to detach device vdb from instance 9628e76c-a137-4499-96d7-5f6a30eb6dad from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:16:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:16:05 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:16:05 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:16:05 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:16:05 user nova-compute[73917]:   <serial>3e2cd123-e943-4037-8879-49bc68cc4c43</serial>
Aug 26 19:16:05 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:16:05 user nova-compute[73917]: </disk>
Aug 26 19:16:05 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:16:05 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Successfully detached device vdb from instance 9628e76c-a137-4499-96d7-5f6a30eb6dad from the persistent domain config.
Aug 26 19:16:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9628e76c-a137-4499-96d7-5f6a30eb6dad from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:16:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:16:05 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:16:05 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:16:05 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:16:05 user nova-compute[73917]:   <serial>3e2cd123-e943-4037-8879-49bc68cc4c43</serial>
Aug 26 19:16:05 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:16:05 user nova-compute[73917]: </disk>
Aug 26 19:16:05 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693077366.3048806, 9628e76c-a137-4499-96d7-5f6a30eb6dad => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9628e76c-a137-4499-96d7-5f6a30eb6dad {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:16:06 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Successfully detached device vdb from instance 9628e76c-a137-4499-96d7-5f6a30eb6dad from the live domain config.
Aug 26 19:16:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHKFmAWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:16:06 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:16:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cead3cd8-2ebb-4b7a-9a5a-1c289ed585d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10e1b1b-13ef-4a30-87b9-e91825c291b4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:16:06 user nova-compute[73917]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 (non-flash)
Aug 26 19:16:06 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:16:06 user nova-compute[73917]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 (non-flash)
Aug 26 19:16:06 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b985225f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43'): ({'sdc'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Removing single pathed devices sdc {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d18bc8-a6ff-4e9f-a5be-4e94bff37977]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53b5795-6d42-453c-9409-a402d6b6c059]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Flushing IO for device /dev/sdc {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb1c3ae-d4be-42c7-8221-a2c53796d906]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ad8d27-abca-458a-94ef-a22d910a13e4]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03b4821-6f58-4a87-aaa7-fd47716952d9]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3523b16-f146-46ea-89bb-b76d093cb667]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43, portal: 172.16.0.220,3260]
Aug 26 19:16:06 user nova-compute[73917]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43, portal: 172.16.0.220,3260] successful.
Aug 26 19:16:06 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2cd123-e943-4037-8879-49bc68cc4c43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f394014c-2697-430b-884a-c0012ccdfef7]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] <== disconnect_volume: return (298ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:16:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:16:07 user nova-compute[73917]: DEBUG nova.objects.instance [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lazy-loading 'flavor' on Instance uuid 9628e76c-a137-4499-96d7-5f6a30eb6dad {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:16:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c828af93-fa21-4e8b-8a47-d3abae4f85c2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.808s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:08 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:16:12 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077357.6094685, 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:16:12 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] VM Stopped (Lifecycle Event)
Aug 26 19:16:12 user nova-compute[73917]: DEBUG nova.compute.manager [None req-fc132e67-d3aa-4c68-96ca-98c729866c6b None None] [instance: 8f2eed3f-0aac-4fbb-a958-ee8934c0e41a] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:16:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:16:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:16:22 user nova-compute[73917]: INFO nova.compute.claims [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Claim successful on node user
Aug 26 19:16:22 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:16:22 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:16:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:16:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:16:22 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:16:23 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:16:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:16:23 user nova-compute[73917]: DEBUG nova.policy [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4db077369ef04a9eb5c0654b96550468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f7803cd6f44ed19fe59bd7286b6498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:16:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:16:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:16:23 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Creating image(s)
Aug 26 19:16:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "/opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "/opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.190s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.215s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c/disk 1073741824" returned: 0 in 0.052s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.180s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:23 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:16:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:24 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Successfully created port: bdb9253b-4cd9-4b30-95c4-1ae4416064a4 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:16:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:24 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Cannot resize image /opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:16:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:16:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Ensure instance console log exists: /opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:16:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:24 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Successfully updated port: bdb9253b-4cd9-4b30-95c4-1ae4416064a4 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:16:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "refresh_cache-e2b9dc2e-7b89-4b47-bacc-2b562649db8c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:16:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquired lock "refresh_cache-e2b9dc2e-7b89-4b47-bacc-2b562649db8c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:16:24 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:16:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-3c61de87-b460-461a-9199-19837767184e req-af855306-addc-41d3-9b44-081d4b28da0a service nova] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Received event network-changed-bdb9253b-4cd9-4b30-95c4-1ae4416064a4 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:16:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-3c61de87-b460-461a-9199-19837767184e req-af855306-addc-41d3-9b44-081d4b28da0a service nova] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Refreshing instance network info cache due to event network-changed-bdb9253b-4cd9-4b30-95c4-1ae4416064a4. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:16:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3c61de87-b460-461a-9199-19837767184e req-af855306-addc-41d3-9b44-081d4b28da0a service nova] Acquiring lock "refresh_cache-e2b9dc2e-7b89-4b47-bacc-2b562649db8c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Updating instance_info_cache with network_info: [{"id": "bdb9253b-4cd9-4b30-95c4-1ae4416064a4", "address": "fa:16:3e:3a:25:d4", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdb9253b-4c", "ovs_interfaceid": "bdb9253b-4cd9-4b30-95c4-1ae4416064a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Releasing lock "refresh_cache-e2b9dc2e-7b89-4b47-bacc-2b562649db8c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Instance network_info: |[{"id": "bdb9253b-4cd9-4b30-95c4-1ae4416064a4", "address": "fa:16:3e:3a:25:d4", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdb9253b-4c", "ovs_interfaceid": "bdb9253b-4cd9-4b30-95c4-1ae4416064a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3c61de87-b460-461a-9199-19837767184e req-af855306-addc-41d3-9b44-081d4b28da0a service nova] Acquired lock "refresh_cache-e2b9dc2e-7b89-4b47-bacc-2b562649db8c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.network.neutron [req-3c61de87-b460-461a-9199-19837767184e req-af855306-addc-41d3-9b44-081d4b28da0a service nova] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Refreshing network info cache for port bdb9253b-4cd9-4b30-95c4-1ae4416064a4 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Start _get_guest_xml network_info=[{"id": "bdb9253b-4cd9-4b30-95c4-1ae4416064a4", "address": "fa:16:3e:3a:25:d4", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdb9253b-4c", "ovs_interfaceid": "bdb9253b-4cd9-4b30-95c4-1ae4416064a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:16:25 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:16:25 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:16:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-797864761',display_name='tempest-VolumesAdminNegativeTest-server-797864761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-797864761',id=25,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5f7803cd6f44ed19fe59bd7286b6498',ramdisk_id='',reservation_id='r-eaxm570y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-13801866',owner_user_name='tempest-VolumesAdminNegativeTest-13801866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:16:23Z,user_data=None,user_id='4db077369ef04a9eb5c0654b96550468',uuid=e2b9dc2e-7b89-4b47-bacc-2b562649db8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdb9253b-4cd9-4b30-95c4-1ae4416064a4", "address": "fa:16:3e:3a:25:d4", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdb9253b-4c", "ovs_interfaceid": "bdb9253b-4cd9-4b30-95c4-1ae4416064a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Converting VIF {"id": "bdb9253b-4cd9-4b30-95c4-1ae4416064a4", "address": "fa:16:3e:3a:25:d4", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdb9253b-4c", "ovs_interfaceid": "bdb9253b-4cd9-4b30-95c4-1ae4416064a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:25:d4,bridge_name='br-int',has_traffic_filtering=True,id=bdb9253b-4cd9-4b30-95c4-1ae4416064a4,network=Network(7da3a70d-3593-4f44-8572-3ae03e3cf9c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdb9253b-4c') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.objects.instance [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lazy-loading 'pci_devices' on Instance uuid e2b9dc2e-7b89-4b47-bacc-2b562649db8c {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:16:25 user nova-compute[73917]:   <uuid>e2b9dc2e-7b89-4b47-bacc-2b562649db8c</uuid>
Aug 26 19:16:25 user nova-compute[73917]:   <name>instance-00000019</name>
Aug 26 19:16:25 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:16:25 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:16:25 user nova-compute[73917]:   <metadata>
Aug 26 19:16:25 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:16:25 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:16:25 user nova-compute[73917]:       <nova:name>tempest-VolumesAdminNegativeTest-server-797864761</nova:name>
Aug 26 19:16:25 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:16:25</nova:creationTime>
Aug 26 19:16:25 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:16:25 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:16:25 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:16:25 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:16:25 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:16:25 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:16:25 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:16:25 user nova-compute[73917]:       <nova:owner>
Aug 26 19:16:25 user nova-compute[73917]:         <nova:user uuid="4db077369ef04a9eb5c0654b96550468">tempest-VolumesAdminNegativeTest-13801866-project-member</nova:user>
Aug 26 19:16:25 user nova-compute[73917]:         <nova:project uuid="f5f7803cd6f44ed19fe59bd7286b6498">tempest-VolumesAdminNegativeTest-13801866</nova:project>
Aug 26 19:16:25 user nova-compute[73917]:       </nova:owner>
Aug 26 19:16:25 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:16:25 user nova-compute[73917]:       <nova:ports>
Aug 26 19:16:25 user nova-compute[73917]:         <nova:port uuid="bdb9253b-4cd9-4b30-95c4-1ae4416064a4">
Aug 26 19:16:25 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 19:16:25 user nova-compute[73917]:         </nova:port>
Aug 26 19:16:25 user nova-compute[73917]:       </nova:ports>
Aug 26 19:16:25 user nova-compute[73917]:     </nova:instance>
Aug 26 19:16:25 user nova-compute[73917]:   </metadata>
Aug 26 19:16:25 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:16:25 user nova-compute[73917]:     <system>
Aug 26 19:16:25 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:16:25 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:16:25 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:16:25 user nova-compute[73917]:       <entry name="serial">e2b9dc2e-7b89-4b47-bacc-2b562649db8c</entry>
Aug 26 19:16:25 user nova-compute[73917]:       <entry name="uuid">e2b9dc2e-7b89-4b47-bacc-2b562649db8c</entry>
Aug 26 19:16:25 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:16:25 user nova-compute[73917]:     </system>
Aug 26 19:16:25 user nova-compute[73917]:   </sysinfo>
Aug 26 19:16:25 user nova-compute[73917]:   <os>
Aug 26 19:16:25 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:16:25 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:16:25 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:16:25 user nova-compute[73917]:   </os>
Aug 26 19:16:25 user nova-compute[73917]:   <features>
Aug 26 19:16:25 user nova-compute[73917]:     <acpi/>
Aug 26 19:16:25 user nova-compute[73917]:     <apic/>
Aug 26 19:16:25 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:16:25 user nova-compute[73917]:   </features>
Aug 26 19:16:25 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:16:25 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:16:25 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:16:25 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:16:25 user nova-compute[73917]:   </clock>
Aug 26 19:16:25 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:16:25 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:16:25 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:16:25 user nova-compute[73917]:   </cpu>
Aug 26 19:16:25 user nova-compute[73917]:   <devices>
Aug 26 19:16:25 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:16:25 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:16:25 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c/disk"/>
Aug 26 19:16:25 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:16:25 user nova-compute[73917]:     </disk>
Aug 26 19:16:25 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:16:25 user nova-compute[73917]:       <mac address="fa:16:3e:3a:25:d4"/>
Aug 26 19:16:25 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:16:25 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:16:25 user nova-compute[73917]:       <target dev="tapbdb9253b-4c"/>
Aug 26 19:16:25 user nova-compute[73917]:     </interface>
Aug 26 19:16:25 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:16:25 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c/console.log" append="off"/>
Aug 26 19:16:25 user nova-compute[73917]:     </serial>
Aug 26 19:16:25 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:16:25 user nova-compute[73917]:     <video>
Aug 26 19:16:25 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:16:25 user nova-compute[73917]:     </video>
Aug 26 19:16:25 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:16:25 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:16:25 user nova-compute[73917]:     </rng>
Aug 26 19:16:25 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:16:25 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:16:25 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:16:25 user nova-compute[73917]:     </memballoon>
Aug 26 19:16:25 user nova-compute[73917]:   </devices>
Aug 26 19:16:25 user nova-compute[73917]: </domain>
Aug 26 19:16:25 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:16:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-797864761',display_name='tempest-VolumesAdminNegativeTest-server-797864761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-797864761',id=25,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5f7803cd6f44ed19fe59bd7286b6498',ramdisk_id='',reservation_id='r-eaxm570y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-13801866',owner_user_name='tempest-VolumesAdminNegativeTest-13801866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:16:23Z,user_data=None,user_id='4db077369ef04a9eb5c0654b96550468',uuid=e2b9dc2e-7b89-4b47-bacc-2b562649db8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdb9253b-4cd9-4b30-95c4-1ae4416064a4", "address": "fa:16:3e:3a:25:d4", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdb9253b-4c", "ovs_interfaceid": "bdb9253b-4cd9-4b30-95c4-1ae4416064a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Converting VIF {"id": "bdb9253b-4cd9-4b30-95c4-1ae4416064a4", "address": "fa:16:3e:3a:25:d4", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdb9253b-4c", "ovs_interfaceid": "bdb9253b-4cd9-4b30-95c4-1ae4416064a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:25:d4,bridge_name='br-int',has_traffic_filtering=True,id=bdb9253b-4cd9-4b30-95c4-1ae4416064a4,network=Network(7da3a70d-3593-4f44-8572-3ae03e3cf9c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdb9253b-4c') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG os_vif [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:25:d4,bridge_name='br-int',has_traffic_filtering=True,id=bdb9253b-4cd9-4b30-95c4-1ae4416064a4,network=Network(7da3a70d-3593-4f44-8572-3ae03e3cf9c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdb9253b-4c') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdb9253b-4c, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbdb9253b-4c, col_values=(('external_ids', {'iface-id': 'bdb9253b-4cd9-4b30-95c4-1ae4416064a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:25:d4', 'vm-uuid': 'e2b9dc2e-7b89-4b47-bacc-2b562649db8c'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:25 user nova-compute[73917]: INFO os_vif [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:25:d4,bridge_name='br-int',has_traffic_filtering=True,id=bdb9253b-4cd9-4b30-95c4-1ae4416064a4,network=Network(7da3a70d-3593-4f44-8572-3ae03e3cf9c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdb9253b-4c')
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] No VIF found with MAC fa:16:3e:3a:25:d4, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.network.neutron [req-3c61de87-b460-461a-9199-19837767184e req-af855306-addc-41d3-9b44-081d4b28da0a service nova] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Updated VIF entry in instance network info cache for port bdb9253b-4cd9-4b30-95c4-1ae4416064a4. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG nova.network.neutron [req-3c61de87-b460-461a-9199-19837767184e req-af855306-addc-41d3-9b44-081d4b28da0a service nova] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Updating instance_info_cache with network_info: [{"id": "bdb9253b-4cd9-4b30-95c4-1ae4416064a4", "address": "fa:16:3e:3a:25:d4", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdb9253b-4c", "ovs_interfaceid": "bdb9253b-4cd9-4b30-95c4-1ae4416064a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:16:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3c61de87-b460-461a-9199-19837767184e req-af855306-addc-41d3-9b44-081d4b28da0a service nova] Releasing lock "refresh_cache-e2b9dc2e-7b89-4b47-bacc-2b562649db8c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:16:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-128bcd19-9a3a-46df-b30e-e40484d0137a req-ca83d0eb-96c8-443e-bbae-2267e1f43872 service nova] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Received event network-vif-plugged-bdb9253b-4cd9-4b30-95c4-1ae4416064a4 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:16:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-128bcd19-9a3a-46df-b30e-e40484d0137a req-ca83d0eb-96c8-443e-bbae-2267e1f43872 service nova] Acquiring lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-128bcd19-9a3a-46df-b30e-e40484d0137a req-ca83d0eb-96c8-443e-bbae-2267e1f43872 service nova] Lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-128bcd19-9a3a-46df-b30e-e40484d0137a req-ca83d0eb-96c8-443e-bbae-2267e1f43872 service nova] Lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-128bcd19-9a3a-46df-b30e-e40484d0137a req-ca83d0eb-96c8-443e-bbae-2267e1f43872 service nova] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] No waiting events found dispatching network-vif-plugged-bdb9253b-4cd9-4b30-95c4-1ae4416064a4 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:16:27 user nova-compute[73917]: WARNING nova.compute.manager [req-128bcd19-9a3a-46df-b30e-e40484d0137a req-ca83d0eb-96c8-443e-bbae-2267e1f43872 service nova] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Received unexpected event network-vif-plugged-bdb9253b-4cd9-4b30-95c4-1ae4416064a4 for instance with vm_state building and task_state spawning.
Aug 26 19:16:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-3b81d671-5035-4300-b1c7-ca74c0f27ced req-d80e1629-64cf-4c16-805b-b86b792e49b7 service nova] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Received event network-vif-plugged-bdb9253b-4cd9-4b30-95c4-1ae4416064a4 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:16:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3b81d671-5035-4300-b1c7-ca74c0f27ced req-d80e1629-64cf-4c16-805b-b86b792e49b7 service nova] Acquiring lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3b81d671-5035-4300-b1c7-ca74c0f27ced req-d80e1629-64cf-4c16-805b-b86b792e49b7 service nova] Lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3b81d671-5035-4300-b1c7-ca74c0f27ced req-d80e1629-64cf-4c16-805b-b86b792e49b7 service nova] Lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-3b81d671-5035-4300-b1c7-ca74c0f27ced req-d80e1629-64cf-4c16-805b-b86b792e49b7 service nova] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] No waiting events found dispatching network-vif-plugged-bdb9253b-4cd9-4b30-95c4-1ae4416064a4 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:16:29 user nova-compute[73917]: WARNING nova.compute.manager [req-3b81d671-5035-4300-b1c7-ca74c0f27ced req-d80e1629-64cf-4c16-805b-b86b792e49b7 service nova] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Received unexpected event network-vif-plugged-bdb9253b-4cd9-4b30-95c4-1ae4416064a4 for instance with vm_state building and task_state spawning.
Aug 26 19:16:29 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077389.338155, e2b9dc2e-7b89-4b47-bacc-2b562649db8c => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:16:29 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] VM Resumed (Lifecycle Event)
Aug 26 19:16:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:16:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:16:29 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Instance spawned successfully.
Aug 26 19:16:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:16:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:16:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:16:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:16:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:16:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:16:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:16:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:16:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:16:29 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:16:29 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077389.339738, e2b9dc2e-7b89-4b47-bacc-2b562649db8c => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:16:29 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] VM Started (Lifecycle Event)
Aug 26 19:16:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:16:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:16:29 user nova-compute[73917]: INFO nova.compute.manager [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Took 6.32 seconds to spawn the instance on the hypervisor.
Aug 26 19:16:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:16:29 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:16:29 user nova-compute[73917]: INFO nova.compute.manager [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Took 7.18 seconds to build instance.
Aug 26 19:16:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b6abd6a8-31b6-4f5f-ab5e-1edf368f89f6 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.306s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:16:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:16:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:16:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:16:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:16:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:16:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:16:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:16:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Acquiring lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:42 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:16:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:16:42 user nova-compute[73917]: INFO nova.compute.claims [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Claim successful on node user
Aug 26 19:16:43 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:16:43 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:16:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.647s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:43 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:16:43 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:16:43 user nova-compute[73917]: DEBUG nova.network.neutron [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:16:43 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:16:43 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:16:43 user nova-compute[73917]: DEBUG nova.policy [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65a8225c5a6c46e8a7c106fab238aa32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc299008d98463697ee227ba83a931c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:16:43 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:16:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:16:43 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Creating image(s)
Aug 26 19:16:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Acquiring lock "/opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Lock "/opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Lock "/opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.182s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437/disk 1073741824" returned: 0 in 0.058s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.186s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:44 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:16:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:44 user nova-compute[73917]: DEBUG nova.network.neutron [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Successfully created port: 93e113c1-23f5-4f62-81b4-fff7b3dd2099 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:16:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:44 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Cannot resize image /opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:16:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:16:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Ensure instance console log exists: /opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:16:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:44 user nova-compute[73917]: DEBUG nova.network.neutron [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Successfully updated port: 93e113c1-23f5-4f62-81b4-fff7b3dd2099 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:16:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Acquiring lock "refresh_cache-d61ab2cf-7bfb-4d39-8f6b-db688872c437" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:16:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Acquired lock "refresh_cache-d61ab2cf-7bfb-4d39-8f6b-db688872c437" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:16:44 user nova-compute[73917]: DEBUG nova.network.neutron [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:16:44 user nova-compute[73917]: DEBUG nova.compute.manager [req-127c9989-a74c-482b-b8ac-90410c7a7150 req-deea8c34-5a6b-4b83-b152-573ec3b83548 service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Received event network-changed-93e113c1-23f5-4f62-81b4-fff7b3dd2099 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:16:44 user nova-compute[73917]: DEBUG nova.compute.manager [req-127c9989-a74c-482b-b8ac-90410c7a7150 req-deea8c34-5a6b-4b83-b152-573ec3b83548 service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Refreshing instance network info cache due to event network-changed-93e113c1-23f5-4f62-81b4-fff7b3dd2099. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:16:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-127c9989-a74c-482b-b8ac-90410c7a7150 req-deea8c34-5a6b-4b83-b152-573ec3b83548 service nova] Acquiring lock "refresh_cache-d61ab2cf-7bfb-4d39-8f6b-db688872c437" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.network.neutron [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "c4218678-e287-4f07-8af1-59469bbcd6bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:45 user nova-compute[73917]: INFO nova.compute.manager [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Terminating instance
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.network.neutron [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Updating instance_info_cache with network_info: [{"id": "93e113c1-23f5-4f62-81b4-fff7b3dd2099", "address": "fa:16:3e:ac:25:6a", "network": {"id": "81d8e758-90e4-4c8f-8afc-082eaf39d764", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4f48ef7195434beeafa4341e0e7018ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93e113c1-23", "ovs_interfaceid": "93e113c1-23f5-4f62-81b4-fff7b3dd2099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Releasing lock "refresh_cache-d61ab2cf-7bfb-4d39-8f6b-db688872c437" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Instance network_info: |[{"id": "93e113c1-23f5-4f62-81b4-fff7b3dd2099", "address": "fa:16:3e:ac:25:6a", "network": {"id": "81d8e758-90e4-4c8f-8afc-082eaf39d764", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4f48ef7195434beeafa4341e0e7018ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93e113c1-23", "ovs_interfaceid": "93e113c1-23f5-4f62-81b4-fff7b3dd2099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-127c9989-a74c-482b-b8ac-90410c7a7150 req-deea8c34-5a6b-4b83-b152-573ec3b83548 service nova] Acquired lock "refresh_cache-d61ab2cf-7bfb-4d39-8f6b-db688872c437" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.network.neutron [req-127c9989-a74c-482b-b8ac-90410c7a7150 req-deea8c34-5a6b-4b83-b152-573ec3b83548 service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Refreshing network info cache for port 93e113c1-23f5-4f62-81b4-fff7b3dd2099 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Start _get_guest_xml network_info=[{"id": "93e113c1-23f5-4f62-81b4-fff7b3dd2099", "address": "fa:16:3e:ac:25:6a", "network": {"id": "81d8e758-90e4-4c8f-8afc-082eaf39d764", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4f48ef7195434beeafa4341e0e7018ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93e113c1-23", "ovs_interfaceid": "93e113c1-23f5-4f62-81b4-fff7b3dd2099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:16:45 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:16:45 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2056762851',display_name='tempest-VolumesNegativeTest-instance-2056762851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2056762851',id=26,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fc299008d98463697ee227ba83a931c',ramdisk_id='',reservation_id='r-db0at2po',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-867248285',owner_user_name='tempest-VolumesNegativeTest-867248285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:16:43Z,user_data=None,user_id='65a8225c5a6c46e8a7c106fab238aa32',uuid=d61ab2cf-7bfb-4d39-8f6b-db688872c437,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93e113c1-23f5-4f62-81b4-fff7b3dd2099", "address": "fa:16:3e:ac:25:6a", "network": {"id": "81d8e758-90e4-4c8f-8afc-082eaf39d764", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4f48ef7195434beeafa4341e0e7018ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93e113c1-23", "ovs_interfaceid": "93e113c1-23f5-4f62-81b4-fff7b3dd2099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Converting VIF {"id": "93e113c1-23f5-4f62-81b4-fff7b3dd2099", "address": "fa:16:3e:ac:25:6a", "network": {"id": "81d8e758-90e4-4c8f-8afc-082eaf39d764", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4f48ef7195434beeafa4341e0e7018ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93e113c1-23", "ovs_interfaceid": "93e113c1-23f5-4f62-81b4-fff7b3dd2099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:25:6a,bridge_name='br-int',has_traffic_filtering=True,id=93e113c1-23f5-4f62-81b4-fff7b3dd2099,network=Network(81d8e758-90e4-4c8f-8afc-082eaf39d764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93e113c1-23') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.objects.instance [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Lazy-loading 'pci_devices' on Instance uuid d61ab2cf-7bfb-4d39-8f6b-db688872c437 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:16:45 user nova-compute[73917]:   <uuid>d61ab2cf-7bfb-4d39-8f6b-db688872c437</uuid>
Aug 26 19:16:45 user nova-compute[73917]:   <name>instance-0000001a</name>
Aug 26 19:16:45 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:16:45 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:16:45 user nova-compute[73917]:   <metadata>
Aug 26 19:16:45 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:16:45 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:16:45 user nova-compute[73917]:       <nova:name>tempest-VolumesNegativeTest-instance-2056762851</nova:name>
Aug 26 19:16:45 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:16:45</nova:creationTime>
Aug 26 19:16:45 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:16:45 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:16:45 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:16:45 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:16:45 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:16:45 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:16:45 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:16:45 user nova-compute[73917]:       <nova:owner>
Aug 26 19:16:45 user nova-compute[73917]:         <nova:user uuid="65a8225c5a6c46e8a7c106fab238aa32">tempest-VolumesNegativeTest-867248285-project-member</nova:user>
Aug 26 19:16:45 user nova-compute[73917]:         <nova:project uuid="5fc299008d98463697ee227ba83a931c">tempest-VolumesNegativeTest-867248285</nova:project>
Aug 26 19:16:45 user nova-compute[73917]:       </nova:owner>
Aug 26 19:16:45 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:16:45 user nova-compute[73917]:       <nova:ports>
Aug 26 19:16:45 user nova-compute[73917]:         <nova:port uuid="93e113c1-23f5-4f62-81b4-fff7b3dd2099">
Aug 26 19:16:45 user nova-compute[73917]:           <nova:ip type="fixed" address="192.168.233.253" ipVersion="4"/>
Aug 26 19:16:45 user nova-compute[73917]:         </nova:port>
Aug 26 19:16:45 user nova-compute[73917]:       </nova:ports>
Aug 26 19:16:45 user nova-compute[73917]:     </nova:instance>
Aug 26 19:16:45 user nova-compute[73917]:   </metadata>
Aug 26 19:16:45 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:16:45 user nova-compute[73917]:     <system>
Aug 26 19:16:45 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:16:45 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:16:45 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:16:45 user nova-compute[73917]:       <entry name="serial">d61ab2cf-7bfb-4d39-8f6b-db688872c437</entry>
Aug 26 19:16:45 user nova-compute[73917]:       <entry name="uuid">d61ab2cf-7bfb-4d39-8f6b-db688872c437</entry>
Aug 26 19:16:45 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:16:45 user nova-compute[73917]:     </system>
Aug 26 19:16:45 user nova-compute[73917]:   </sysinfo>
Aug 26 19:16:45 user nova-compute[73917]:   <os>
Aug 26 19:16:45 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:16:45 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:16:45 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:16:45 user nova-compute[73917]:   </os>
Aug 26 19:16:45 user nova-compute[73917]:   <features>
Aug 26 19:16:45 user nova-compute[73917]:     <acpi/>
Aug 26 19:16:45 user nova-compute[73917]:     <apic/>
Aug 26 19:16:45 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:16:45 user nova-compute[73917]:   </features>
Aug 26 19:16:45 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:16:45 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:16:45 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:16:45 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:16:45 user nova-compute[73917]:   </clock>
Aug 26 19:16:45 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:16:45 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:16:45 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:16:45 user nova-compute[73917]:   </cpu>
Aug 26 19:16:45 user nova-compute[73917]:   <devices>
Aug 26 19:16:45 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:16:45 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:16:45 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437/disk"/>
Aug 26 19:16:45 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:16:45 user nova-compute[73917]:     </disk>
Aug 26 19:16:45 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:16:45 user nova-compute[73917]:       <mac address="fa:16:3e:ac:25:6a"/>
Aug 26 19:16:45 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:16:45 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:16:45 user nova-compute[73917]:       <target dev="tap93e113c1-23"/>
Aug 26 19:16:45 user nova-compute[73917]:     </interface>
Aug 26 19:16:45 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:16:45 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437/console.log" append="off"/>
Aug 26 19:16:45 user nova-compute[73917]:     </serial>
Aug 26 19:16:45 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:16:45 user nova-compute[73917]:     <video>
Aug 26 19:16:45 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:16:45 user nova-compute[73917]:     </video>
Aug 26 19:16:45 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:16:45 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:16:45 user nova-compute[73917]:     </rng>
Aug 26 19:16:45 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:16:45 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:16:45 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:16:45 user nova-compute[73917]:     </memballoon>
Aug 26 19:16:45 user nova-compute[73917]:   </devices>
Aug 26 19:16:45 user nova-compute[73917]: </domain>
Aug 26 19:16:45 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2056762851',display_name='tempest-VolumesNegativeTest-instance-2056762851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2056762851',id=26,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fc299008d98463697ee227ba83a931c',ramdisk_id='',reservation_id='r-db0at2po',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-867248285',owner_user_name='tempest-VolumesNegativeTest-867248285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:16:43Z,user_data=None,user_id='65a8225c5a6c46e8a7c106fab238aa32',uuid=d61ab2cf-7bfb-4d39-8f6b-db688872c437,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93e113c1-23f5-4f62-81b4-fff7b3dd2099", "address": "fa:16:3e:ac:25:6a", "network": {"id": "81d8e758-90e4-4c8f-8afc-082eaf39d764", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4f48ef7195434beeafa4341e0e7018ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93e113c1-23", "ovs_interfaceid": "93e113c1-23f5-4f62-81b4-fff7b3dd2099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Converting VIF {"id": "93e113c1-23f5-4f62-81b4-fff7b3dd2099", "address": "fa:16:3e:ac:25:6a", "network": {"id": "81d8e758-90e4-4c8f-8afc-082eaf39d764", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4f48ef7195434beeafa4341e0e7018ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93e113c1-23", "ovs_interfaceid": "93e113c1-23f5-4f62-81b4-fff7b3dd2099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:25:6a,bridge_name='br-int',has_traffic_filtering=True,id=93e113c1-23f5-4f62-81b4-fff7b3dd2099,network=Network(81d8e758-90e4-4c8f-8afc-082eaf39d764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93e113c1-23') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG os_vif [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:25:6a,bridge_name='br-int',has_traffic_filtering=True,id=93e113c1-23f5-4f62-81b4-fff7b3dd2099,network=Network(81d8e758-90e4-4c8f-8afc-082eaf39d764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93e113c1-23') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93e113c1-23, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap93e113c1-23, col_values=(('external_ids', {'iface-id': '93e113c1-23f5-4f62-81b4-fff7b3dd2099', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:25:6a', 'vm-uuid': 'd61ab2cf-7bfb-4d39-8f6b-db688872c437'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:45 user nova-compute[73917]: INFO os_vif [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:25:6a,bridge_name='br-int',has_traffic_filtering=True,id=93e113c1-23f5-4f62-81b4-fff7b3dd2099,network=Network(81d8e758-90e4-4c8f-8afc-082eaf39d764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93e113c1-23')
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] No VIF found with MAC fa:16:3e:ac:25:6a, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.network.neutron [req-127c9989-a74c-482b-b8ac-90410c7a7150 req-deea8c34-5a6b-4b83-b152-573ec3b83548 service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Updated VIF entry in instance network info cache for port 93e113c1-23f5-4f62-81b4-fff7b3dd2099. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG nova.network.neutron [req-127c9989-a74c-482b-b8ac-90410c7a7150 req-deea8c34-5a6b-4b83-b152-573ec3b83548 service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Updating instance_info_cache with network_info: [{"id": "93e113c1-23f5-4f62-81b4-fff7b3dd2099", "address": "fa:16:3e:ac:25:6a", "network": {"id": "81d8e758-90e4-4c8f-8afc-082eaf39d764", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4f48ef7195434beeafa4341e0e7018ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93e113c1-23", "ovs_interfaceid": "93e113c1-23f5-4f62-81b4-fff7b3dd2099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:16:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-127c9989-a74c-482b-b8ac-90410c7a7150 req-deea8c34-5a6b-4b83-b152-573ec3b83548 service nova] Releasing lock "refresh_cache-d61ab2cf-7bfb-4d39-8f6b-db688872c437" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:16:46 user nova-compute[73917]: DEBUG nova.compute.manager [req-a97ac911-ce92-4846-a0e5-85fd2e4186ce req-621f4c45-9391-4ea0-9730-4c853f2b3085 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Received event network-vif-unplugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:16:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a97ac911-ce92-4846-a0e5-85fd2e4186ce req-621f4c45-9391-4ea0-9730-4c853f2b3085 service nova] Acquiring lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a97ac911-ce92-4846-a0e5-85fd2e4186ce req-621f4c45-9391-4ea0-9730-4c853f2b3085 service nova] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a97ac911-ce92-4846-a0e5-85fd2e4186ce req-621f4c45-9391-4ea0-9730-4c853f2b3085 service nova] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:46 user nova-compute[73917]: DEBUG nova.compute.manager [req-a97ac911-ce92-4846-a0e5-85fd2e4186ce req-621f4c45-9391-4ea0-9730-4c853f2b3085 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] No waiting events found dispatching network-vif-unplugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:16:46 user nova-compute[73917]: DEBUG nova.compute.manager [req-a97ac911-ce92-4846-a0e5-85fd2e4186ce req-621f4c45-9391-4ea0-9730-4c853f2b3085 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Received event network-vif-unplugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:16:46 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Instance destroyed successfully.
Aug 26 19:16:46 user nova-compute[73917]: DEBUG nova.objects.instance [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lazy-loading 'resources' on Instance uuid c4218678-e287-4f07-8af1-59469bbcd6bd {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:16:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T19:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-843239325',display_name='tempest-ServerActionsTestOtherA-server-628875920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-843239325',id=16,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOklNSOL9r1q/zNv/+3lsUzJeS13Yy6booypQqav1LdRa4o4bUXxStD8Zbc/LQrFJOxHm0LxGHgW2WZ+4aH+DXEkJob/ZjlhQDrC3ATS52MugxelqEnl2LwwmyLXCgc3bw==',key_name='tempest-keypair-258176439',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:13:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2e09fe7b38e4bb991bfaaf5b4ad357a',ramdisk_id='',reservation_id='r-cn28ztmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2069094918',owner_user_name='tempest-ServerActionsTestOtherA-2069094918-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:13:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd1b7d3fe22c4b239cf03235866e17d4',uuid=c4218678-e287-4f07-8af1-59469bbcd6bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "address": "fa:16:3e:ee:57:64", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf9dd57-b9", "ovs_interfaceid": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:16:46 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converting VIF {"id": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "address": "fa:16:3e:ee:57:64", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf9dd57-b9", "ovs_interfaceid": "faf9dd57-b9f3-4eec-af4d-b95205ffea78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:16:46 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:57:64,bridge_name='br-int',has_traffic_filtering=True,id=faf9dd57-b9f3-4eec-af4d-b95205ffea78,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf9dd57-b9') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:16:46 user nova-compute[73917]: DEBUG os_vif [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:57:64,bridge_name='br-int',has_traffic_filtering=True,id=faf9dd57-b9f3-4eec-af4d-b95205ffea78,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf9dd57-b9') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:16:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfaf9dd57-b9, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:16:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:16:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:46 user nova-compute[73917]: INFO os_vif [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:57:64,bridge_name='br-int',has_traffic_filtering=True,id=faf9dd57-b9f3-4eec-af4d-b95205ffea78,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf9dd57-b9')
Aug 26 19:16:46 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Deleting instance files /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd_del
Aug 26 19:16:46 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Deletion of /opt/stack/data/nova/instances/c4218678-e287-4f07-8af1-59469bbcd6bd_del complete
Aug 26 19:16:46 user nova-compute[73917]: INFO nova.compute.manager [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Took 1.38 seconds to destroy the instance on the hypervisor.
Aug 26 19:16:46 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:16:46 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:16:46 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:16:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:48 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Took 1.34 seconds to deallocate network for instance.
Aug 26 19:16:48 user nova-compute[73917]: DEBUG nova.compute.manager [req-e344564d-4784-4a90-91ac-1277eb5929ba req-f87a690b-55ea-4518-a6de-a20714a68730 service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Received event network-vif-deleted-faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG nova.compute.manager [req-2d46ce82-6fe0-4371-89b1-cc027f1d578b req-1cc47488-d5a7-4097-9b46-4f4f1e7219bb service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Received event network-vif-plugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2d46ce82-6fe0-4371-89b1-cc027f1d578b req-1cc47488-d5a7-4097-9b46-4f4f1e7219bb service nova] Acquiring lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2d46ce82-6fe0-4371-89b1-cc027f1d578b req-1cc47488-d5a7-4097-9b46-4f4f1e7219bb service nova] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2d46ce82-6fe0-4371-89b1-cc027f1d578b req-1cc47488-d5a7-4097-9b46-4f4f1e7219bb service nova] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG nova.compute.manager [req-2d46ce82-6fe0-4371-89b1-cc027f1d578b req-1cc47488-d5a7-4097-9b46-4f4f1e7219bb service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] No waiting events found dispatching network-vif-plugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:16:48 user nova-compute[73917]: WARNING nova.compute.manager [req-2d46ce82-6fe0-4371-89b1-cc027f1d578b req-1cc47488-d5a7-4097-9b46-4f4f1e7219bb service nova] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Received unexpected event network-vif-plugged-faf9dd57-b9f3-4eec-af4d-b95205ffea78 for instance with vm_state deleted and task_state None.
Aug 26 19:16:48 user nova-compute[73917]: DEBUG nova.compute.manager [req-2d46ce82-6fe0-4371-89b1-cc027f1d578b req-1cc47488-d5a7-4097-9b46-4f4f1e7219bb service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Received event network-vif-plugged-93e113c1-23f5-4f62-81b4-fff7b3dd2099 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2d46ce82-6fe0-4371-89b1-cc027f1d578b req-1cc47488-d5a7-4097-9b46-4f4f1e7219bb service nova] Acquiring lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2d46ce82-6fe0-4371-89b1-cc027f1d578b req-1cc47488-d5a7-4097-9b46-4f4f1e7219bb service nova] Lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2d46ce82-6fe0-4371-89b1-cc027f1d578b req-1cc47488-d5a7-4097-9b46-4f4f1e7219bb service nova] Lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG nova.compute.manager [req-2d46ce82-6fe0-4371-89b1-cc027f1d578b req-1cc47488-d5a7-4097-9b46-4f4f1e7219bb service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] No waiting events found dispatching network-vif-plugged-93e113c1-23f5-4f62-81b4-fff7b3dd2099 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:16:48 user nova-compute[73917]: WARNING nova.compute.manager [req-2d46ce82-6fe0-4371-89b1-cc027f1d578b req-1cc47488-d5a7-4097-9b46-4f4f1e7219bb service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Received unexpected event network-vif-plugged-93e113c1-23f5-4f62-81b4-fff7b3dd2099 for instance with vm_state building and task_state spawning.
Aug 26 19:16:48 user nova-compute[73917]: DEBUG nova.compute.manager [req-2d46ce82-6fe0-4371-89b1-cc027f1d578b req-1cc47488-d5a7-4097-9b46-4f4f1e7219bb service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Received event network-vif-plugged-93e113c1-23f5-4f62-81b4-fff7b3dd2099 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2d46ce82-6fe0-4371-89b1-cc027f1d578b req-1cc47488-d5a7-4097-9b46-4f4f1e7219bb service nova] Acquiring lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2d46ce82-6fe0-4371-89b1-cc027f1d578b req-1cc47488-d5a7-4097-9b46-4f4f1e7219bb service nova] Lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2d46ce82-6fe0-4371-89b1-cc027f1d578b req-1cc47488-d5a7-4097-9b46-4f4f1e7219bb service nova] Lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG nova.compute.manager [req-2d46ce82-6fe0-4371-89b1-cc027f1d578b req-1cc47488-d5a7-4097-9b46-4f4f1e7219bb service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] No waiting events found dispatching network-vif-plugged-93e113c1-23f5-4f62-81b4-fff7b3dd2099 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:16:48 user nova-compute[73917]: WARNING nova.compute.manager [req-2d46ce82-6fe0-4371-89b1-cc027f1d578b req-1cc47488-d5a7-4097-9b46-4f4f1e7219bb service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Received unexpected event network-vif-plugged-93e113c1-23f5-4f62-81b4-fff7b3dd2099 for instance with vm_state building and task_state spawning.
Aug 26 19:16:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:16:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:48 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Deleted allocations for instance c4218678-e287-4f07-8af1-59469bbcd6bd
Aug 26 19:16:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ff4cb1a2-bd0d-4e33-9c0a-4b3864ada334 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "c4218678-e287-4f07-8af1-59469bbcd6bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.402s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:49 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077409.5554645, d61ab2cf-7bfb-4d39-8f6b-db688872c437 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:16:49 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] VM Resumed (Lifecycle Event)
Aug 26 19:16:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:16:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:16:49 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Instance spawned successfully.
Aug 26 19:16:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:16:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:16:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:16:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:16:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:16:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:16:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:16:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:16:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:16:49 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:16:49 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077409.5591004, d61ab2cf-7bfb-4d39-8f6b-db688872c437 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:16:49 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] VM Started (Lifecycle Event)
Aug 26 19:16:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:16:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:16:49 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:16:49 user nova-compute[73917]: INFO nova.compute.manager [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Took 6.18 seconds to spawn the instance on the hypervisor.
Aug 26 19:16:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:16:49 user nova-compute[73917]: INFO nova.compute.manager [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Took 7.18 seconds to build instance.
Aug 26 19:16:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c96b0167-3ed9-4bef-adf8-99ea5ef0b1e3 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.277s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:50 user nova-compute[73917]: INFO nova.compute.manager [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Terminating instance
Aug 26 19:16:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:16:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-db57a968-6681-492e-aca4-7c80af1dd0c9 req-0d622e33-51d0-4870-93c8-05e42370c7c5 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received event network-vif-unplugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:16:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-db57a968-6681-492e-aca4-7c80af1dd0c9 req-0d622e33-51d0-4870-93c8-05e42370c7c5 service nova] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-db57a968-6681-492e-aca4-7c80af1dd0c9 req-0d622e33-51d0-4870-93c8-05e42370c7c5 service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-db57a968-6681-492e-aca4-7c80af1dd0c9 req-0d622e33-51d0-4870-93c8-05e42370c7c5 service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-db57a968-6681-492e-aca4-7c80af1dd0c9 req-0d622e33-51d0-4870-93c8-05e42370c7c5 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] No waiting events found dispatching network-vif-unplugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:16:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-db57a968-6681-492e-aca4-7c80af1dd0c9 req-0d622e33-51d0-4870-93c8-05e42370c7c5 service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received event network-vif-unplugged-37aa792a-c367-4dfd-b814-cb9c32ef373c for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:16:51 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Instance destroyed successfully.
Aug 26 19:16:51 user nova-compute[73917]: DEBUG nova.objects.instance [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'resources' on Instance uuid fdfb377e-119e-41ce-b9e0-6e21053306cc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:16:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-699122116',display_name='tempest-AttachVolumeTestJSON-server-699122116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-699122116',id=5,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHqeZabK3+K4aaugpyX8ly8/1rj5SN4GU9OQYd/thmmFlRmAKDNGqPnSs6iFVbJTbvqYDOtwahR3/8AlpHMnz55bssLgo5XLS59T+WFQ51mc2/usyY8DYb7AasV3fI19A==',key_name='tempest-keypair-67322035',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='abdcca8609e849618526a8b78385f77b',ramdisk_id='',reservation_id='r-mcpim35c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1084822713',owner_user_name='tempest-AttachVolumeTestJSON-1084822713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:15:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47b6f8fcb8f49dfa2383dfbf37d6c30',uuid=fdfb377e-119e-41ce-b9e0-6e21053306cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:16:51 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converting VIF {"id": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "address": "fa:16:3e:ce:ab:20", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa792a-c3", "ovs_interfaceid": "37aa792a-c367-4dfd-b814-cb9c32ef373c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:16:51 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:16:51 user nova-compute[73917]: DEBUG os_vif [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:16:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37aa792a-c3, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:16:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:51 user nova-compute[73917]: INFO os_vif [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ab:20,bridge_name='br-int',has_traffic_filtering=True,id=37aa792a-c367-4dfd-b814-cb9c32ef373c,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa792a-c3')
Aug 26 19:16:51 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Deleting instance files /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc_del
Aug 26 19:16:51 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Deletion of /opt/stack/data/nova/instances/fdfb377e-119e-41ce-b9e0-6e21053306cc_del complete
Aug 26 19:16:51 user nova-compute[73917]: INFO nova.compute.manager [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 26 19:16:51 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:16:51 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:16:51 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:16:52 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:16:52 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Took 0.83 seconds to deallocate network for instance.
Aug 26 19:16:52 user nova-compute[73917]: DEBUG nova.compute.manager [req-ae510e52-a929-46fa-9b35-8d4763f7ec4a req-fd59c747-8777-4225-8f0c-84d79b42160a service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received event network-vif-deleted-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:16:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:52 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:16:52 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:16:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:53 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Deleted allocations for instance fdfb377e-119e-41ce-b9e0-6e21053306cc
Aug 26 19:16:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-da9f7cb3-6b2a-44e4-b19c-1750ee0c35d7 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.359s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-cd741db9-b661-4bae-af29-d6b4fbd8808c req-7ab53600-7e41-4ed5-bf21-be3fb377764d service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:16:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cd741db9-b661-4bae-af29-d6b4fbd8808c req-7ab53600-7e41-4ed5-bf21-be3fb377764d service nova] Acquiring lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cd741db9-b661-4bae-af29-d6b4fbd8808c req-7ab53600-7e41-4ed5-bf21-be3fb377764d service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cd741db9-b661-4bae-af29-d6b4fbd8808c req-7ab53600-7e41-4ed5-bf21-be3fb377764d service nova] Lock "fdfb377e-119e-41ce-b9e0-6e21053306cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-cd741db9-b661-4bae-af29-d6b4fbd8808c req-7ab53600-7e41-4ed5-bf21-be3fb377764d service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] No waiting events found dispatching network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:16:53 user nova-compute[73917]: WARNING nova.compute.manager [req-cd741db9-b661-4bae-af29-d6b4fbd8808c req-7ab53600-7e41-4ed5-bf21-be3fb377764d service nova] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Received unexpected event network-vif-plugged-37aa792a-c367-4dfd-b814-cb9c32ef373c for instance with vm_state deleted and task_state None.
Aug 26 19:16:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "9628e76c-a137-4499-96d7-5f6a30eb6dad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "9628e76c-a137-4499-96d7-5f6a30eb6dad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:56 user nova-compute[73917]: INFO nova.compute.manager [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Terminating instance
Aug 26 19:16:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG nova.compute.manager [req-106dd268-d410-49d8-9116-c271bb4fb00d req-399dfbe3-1f19-4d7a-96f8-6f93fe1b90bb service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Received event network-vif-unplugged-4c360957-8f3b-4887-8efb-74e42c75d777 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-106dd268-d410-49d8-9116-c271bb4fb00d req-399dfbe3-1f19-4d7a-96f8-6f93fe1b90bb service nova] Acquiring lock "9628e76c-a137-4499-96d7-5f6a30eb6dad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-106dd268-d410-49d8-9116-c271bb4fb00d req-399dfbe3-1f19-4d7a-96f8-6f93fe1b90bb service nova] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-106dd268-d410-49d8-9116-c271bb4fb00d req-399dfbe3-1f19-4d7a-96f8-6f93fe1b90bb service nova] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG nova.compute.manager [req-106dd268-d410-49d8-9116-c271bb4fb00d req-399dfbe3-1f19-4d7a-96f8-6f93fe1b90bb service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] No waiting events found dispatching network-vif-unplugged-4c360957-8f3b-4887-8efb-74e42c75d777 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG nova.compute.manager [req-106dd268-d410-49d8-9116-c271bb4fb00d req-399dfbe3-1f19-4d7a-96f8-6f93fe1b90bb service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Received event network-vif-unplugged-4c360957-8f3b-4887-8efb-74e42c75d777 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:56 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Instance destroyed successfully.
Aug 26 19:16:56 user nova-compute[73917]: DEBUG nova.objects.instance [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lazy-loading 'resources' on Instance uuid 9628e76c-a137-4499-96d7-5f6a30eb6dad {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:13:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1420235405',display_name='tempest-AttachVolumeNegativeTest-server-1420235405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1420235405',id=21,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1YpS+TXJKk4Vg5AorFwW+tnQUyrnWcOEEM698/15bFv55YCaGSj+tzNnthXg21SQiRfWjQ5YsX0zkYX+n9hocscdH0H67zFqD1X0Dfn3i99IIwk24tqVHGrS2Mzjw/RA==',key_name='tempest-keypair-501160362',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:13:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b291bbf9aedc4414a1ab402602849140',ramdisk_id='',reservation_id='r-kid0ja94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2066333616',owner_user_name='tempest-AttachVolumeNegativeTest-2066333616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:13:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c64a5d226b8b4d60af840d49315bf60f',uuid=9628e76c-a137-4499-96d7-5f6a30eb6dad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c360957-8f3b-4887-8efb-74e42c75d777", "address": "fa:16:3e:ac:6b:52", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c360957-8f", "ovs_interfaceid": "4c360957-8f3b-4887-8efb-74e42c75d777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converting VIF {"id": "4c360957-8f3b-4887-8efb-74e42c75d777", "address": "fa:16:3e:ac:6b:52", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c360957-8f", "ovs_interfaceid": "4c360957-8f3b-4887-8efb-74e42c75d777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:6b:52,bridge_name='br-int',has_traffic_filtering=True,id=4c360957-8f3b-4887-8efb-74e42c75d777,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c360957-8f') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG os_vif [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:6b:52,bridge_name='br-int',has_traffic_filtering=True,id=4c360957-8f3b-4887-8efb-74e42c75d777,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c360957-8f') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c360957-8f, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:16:56 user nova-compute[73917]: INFO os_vif [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:6b:52,bridge_name='br-int',has_traffic_filtering=True,id=4c360957-8f3b-4887-8efb-74e42c75d777,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c360957-8f')
Aug 26 19:16:56 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Deleting instance files /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad_del
Aug 26 19:16:56 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Deletion of /opt/stack/data/nova/instances/9628e76c-a137-4499-96d7-5f6a30eb6dad_del complete
Aug 26 19:16:56 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Updating instance_info_cache with network_info: [{"id": "2738a59b-9109-4fef-8868-920d458dfaa1", "address": "fa:16:3e:e9:a2:a3", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2738a59b-91", "ovs_interfaceid": "2738a59b-9109-4fef-8868-920d458dfaa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:16:56 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:16:57 user nova-compute[73917]: INFO nova.compute.manager [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 26 19:16:57 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:16:57 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:16:57 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:16:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:16:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:16:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:16:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:16:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:16:58 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Took 1.02 seconds to deallocate network for instance.
Aug 26 19:16:58 user nova-compute[73917]: DEBUG nova.compute.manager [req-a22ce517-9a22-4699-95da-0ccde0468fde req-bb02f80a-d447-4693-ba6d-83f2835fb492 service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Received event network-vif-deleted-4c360957-8f3b-4887-8efb-74e42c75d777 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:16:58 user nova-compute[73917]: INFO nova.compute.manager [req-a22ce517-9a22-4699-95da-0ccde0468fde req-bb02f80a-d447-4693-ba6d-83f2835fb492 service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Neutron deleted interface 4c360957-8f3b-4887-8efb-74e42c75d777; detaching it from the instance and deleting it from the info cache
Aug 26 19:16:58 user nova-compute[73917]: DEBUG nova.network.neutron [req-a22ce517-9a22-4699-95da-0ccde0468fde req-bb02f80a-d447-4693-ba6d-83f2835fb492 service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG nova.compute.manager [req-a22ce517-9a22-4699-95da-0ccde0468fde req-bb02f80a-d447-4693-ba6d-83f2835fb492 service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Detach interface failed, port_id=4c360957-8f3b-4887-8efb-74e42c75d777, reason: Instance 9628e76c-a137-4499-96d7-5f6a30eb6dad could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG nova.compute.manager [req-953eab35-412b-4806-82d6-ef6fbd8240d9 req-835ffe9c-ea98-44c7-ba3a-bc9cf00001cf service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Received event network-vif-plugged-4c360957-8f3b-4887-8efb-74e42c75d777 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-953eab35-412b-4806-82d6-ef6fbd8240d9 req-835ffe9c-ea98-44c7-ba3a-bc9cf00001cf service nova] Acquiring lock "9628e76c-a137-4499-96d7-5f6a30eb6dad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-953eab35-412b-4806-82d6-ef6fbd8240d9 req-835ffe9c-ea98-44c7-ba3a-bc9cf00001cf service nova] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-953eab35-412b-4806-82d6-ef6fbd8240d9 req-835ffe9c-ea98-44c7-ba3a-bc9cf00001cf service nova] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG nova.compute.manager [req-953eab35-412b-4806-82d6-ef6fbd8240d9 req-835ffe9c-ea98-44c7-ba3a-bc9cf00001cf service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] No waiting events found dispatching network-vif-plugged-4c360957-8f3b-4887-8efb-74e42c75d777 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:16:58 user nova-compute[73917]: WARNING nova.compute.manager [req-953eab35-412b-4806-82d6-ef6fbd8240d9 req-835ffe9c-ea98-44c7-ba3a-bc9cf00001cf service nova] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Received unexpected event network-vif-plugged-4c360957-8f3b-4887-8efb-74e42c75d777 for instance with vm_state deleted and task_state None.
Aug 26 19:16:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.626s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:58 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Deleted allocations for instance 9628e76c-a137-4499-96d7-5f6a30eb6dad
Aug 26 19:16:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2d7bb90d-dee4-4da0-925b-ac50a259d6f2 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "9628e76c-a137-4499-96d7-5f6a30eb6dad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.945s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:16:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:16:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:16:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG nova.objects.instance [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lazy-loading 'flavor' on Instance uuid dca28d65-37d0-4b60-b8aa-dcca61b6a187 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:00 user nova-compute[73917]: INFO nova.compute.manager [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Attaching volume 15a7f1e0-2183-4228-bec3-0489f0238cd3 to /dev/vdb
Aug 26 19:17:00 user nova-compute[73917]: DEBUG os_brick.utils [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12be48a-f947-4a95-a63e-5196e3707775]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa86d17-1ad2-4a16-8b82-e5d60dcde699]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4016ef-6b74-4eec-9bba-84fe7a25642e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[853512ff-de14-4249-bcbe-e648d93d2d83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:17:00 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a01e80-65d9-4f92-afb0-f537317ae750]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG os_brick.utils [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] <== get_connector_properties: return (190ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Updating existing volume attachment record: c1e2b545-8147-4211-a85f-46df21e90454 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:01 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077406.585443, c4218678-e287-4f07-8af1-59469bbcd6bd => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:17:01 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] VM Stopped (Lifecycle Event)
Aug 26 19:17:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-376d2c6e-e166-4508-be0c-735afaf022d6 None None] [instance: c4218678-e287-4f07-8af1-59469bbcd6bd] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:17:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:02 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:17:02 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:17:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=7195MB free_disk=25.405731201171875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:17:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance cc0ae046-2a39-4ab6-9327-2d9452c3035d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:17:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fd801f18-34b6-4682-8d43-edf82bd216c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:17:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:17:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 481cc682-2004-434d-b4eb-1688b0b07dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:17:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 94f8d4e7-f310-45df-a0ae-82e608ac0119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:17:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance dca28d65-37d0-4b60-b8aa-dcca61b6a187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:17:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:17:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance df5c717a-62d8-444d-9968-ad682a31733c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:17:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f4e84db3-1f3b-471f-9f82-5a692fdb6c06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:17:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance e2b9dc2e-7b89-4b47-bacc-2b562649db8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:17:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance d61ab2cf-7bfb-4d39-8f6b-db688872c437 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:17:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:17:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:17:02 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:17:02 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:17:03 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:17:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:04 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:17:04 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:17:04 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:17:04 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:17:04 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:17:04 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:17:06 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077411.5090668, fdfb377e-119e-41ce-b9e0-6e21053306cc => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:17:06 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] VM Stopped (Lifecycle Event)
Aug 26 19:17:06 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f6dba7e1-5070-4b30-81b5-98d0d1647543 None None] [instance: fdfb377e-119e-41ce-b9e0-6e21053306cc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:17:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:11 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077416.8791468, 9628e76c-a137-4499-96d7-5f6a30eb6dad => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:17:11 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] VM Stopped (Lifecycle Event)
Aug 26 19:17:11 user nova-compute[73917]: DEBUG nova.compute.manager [None req-6f3f2259-09ce-4428-a36a-6b5fc2b57688 None None] [instance: 9628e76c-a137-4499-96d7-5f6a30eb6dad] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:17:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjNosbWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:17:12 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:17:12 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:17:12 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc5a44e-3f0b-477f-9ca1-1adb342931db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:17:12 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4440af88-aacd-4094-b1b8-24ec73276d37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3] added
Aug 26 19:17:12 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f750adcb-4ad3-4018-984f-ba4cf161b0e6]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e70718f-0a6c-4247-9d0d-6a4a08911a65]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LjNosbWr {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LjNosbWr" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10924e3-87ef-44b2-8c03-657a9334a4a5]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LjNosbWr'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[512fe14f-2a2b-4961-96cc-8569a10b7754]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9d0ba1-9b62-4896-9bb9-268f439b1765]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:17:12 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:17:12 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5825cf83-204c-463e-b9b6-83603d88f2a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260]
Aug 26 19:17:12 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260] successful.
Aug 26 19:17:12 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1465f56b-bbaa-4649-8c77-cffa16acfc40]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[73212f90-105e-4816-b6ec-8e14caab1cf9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:17:12 user nova-compute[73917]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:17:12 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:17:12 user nova-compute[73917]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:17:12 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[403cda5e-0a02-490d-8504-aafc6e441e31]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:17:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjNosbWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:17:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:17:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26464326433623030', 'path': '/dev/sdc'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:17:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464326433623030', 'path': '/dev/sdc'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:17:13 user nova-compute[73917]: DEBUG nova.objects.instance [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lazy-loading 'flavor' on Instance uuid dca28d65-37d0-4b60-b8aa-dcca61b6a187 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:17:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:17:13 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:17:13 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:17:13 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:17:13 user nova-compute[73917]:   <serial>15a7f1e0-2183-4228-bec3-0489f0238cd3</serial>
Aug 26 19:17:13 user nova-compute[73917]: </disk>
Aug 26 19:17:13 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:17:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:17:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:17:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] No VIF found with MAC fa:16:3e:14:4e:59, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:17:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-da3869dd-8331-427f-947c-a9912ffd4f20 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.870s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:14 user nova-compute[73917]: INFO nova.compute.manager [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Rescuing
Aug 26 19:17:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "refresh_cache-df5c717a-62d8-444d-9968-ad682a31733c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:17:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquired lock "refresh_cache-df5c717a-62d8-444d-9968-ad682a31733c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:17:14 user nova-compute[73917]: DEBUG nova.network.neutron [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:17:15 user nova-compute[73917]: DEBUG nova.network.neutron [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Updating instance_info_cache with network_info: [{"id": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "address": "fa:16:3e:ca:39:fd", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79ade91-3e", "ovs_interfaceid": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:17:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Releasing lock "refresh_cache-df5c717a-62d8-444d-9968-ad682a31733c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:17:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-de5ab7cc-75e0-4344-994a-531e62019a1a req-ab6ecace-8540-4f90-ba67-da36db6d156f service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received event network-vif-unplugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:17:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-de5ab7cc-75e0-4344-994a-531e62019a1a req-ab6ecace-8540-4f90-ba67-da36db6d156f service nova] Acquiring lock "df5c717a-62d8-444d-9968-ad682a31733c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-de5ab7cc-75e0-4344-994a-531e62019a1a req-ab6ecace-8540-4f90-ba67-da36db6d156f service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-de5ab7cc-75e0-4344-994a-531e62019a1a req-ab6ecace-8540-4f90-ba67-da36db6d156f service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-de5ab7cc-75e0-4344-994a-531e62019a1a req-ab6ecace-8540-4f90-ba67-da36db6d156f service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] No waiting events found dispatching network-vif-unplugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:17:15 user nova-compute[73917]: WARNING nova.compute.manager [req-de5ab7cc-75e0-4344-994a-531e62019a1a req-ab6ecace-8540-4f90-ba67-da36db6d156f service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received unexpected event network-vif-unplugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e for instance with vm_state active and task_state rescuing.
Aug 26 19:17:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:15 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Instance destroyed successfully.
Aug 26 19:17:15 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Attempting a stable device rescue
Aug 26 19:17:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73917) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 19:17:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Instance directory exists: not creating {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 19:17:16 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Creating image(s)
Aug 26 19:17:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "/opt/stack/data/nova/instances/df5c717a-62d8-444d-9968-ad682a31733c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "/opt/stack/data/nova/instances/df5c717a-62d8-444d-9968-ad682a31733c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "/opt/stack/data/nova/instances/df5c717a-62d8-444d-9968-ad682a31733c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:16 user nova-compute[73917]: DEBUG nova.objects.instance [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'trusted_certs' on Instance uuid df5c717a-62d8-444d-9968-ad682a31733c {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:17:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "a15323ee82a3bcab9aa06d020bc0524039708e62" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "a15323ee82a3bcab9aa06d020bc0524039708e62" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15323ee82a3bcab9aa06d020bc0524039708e62.part --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:17 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Stashing vm_state: active {{(pid=73917) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 19:17:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15323ee82a3bcab9aa06d020bc0524039708e62.part --force-share --output=json" returned: 0 in 0.187s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:17 user nova-compute[73917]: DEBUG nova.virt.images [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] 6fbc4d09-e425-4a44-8453-eb70d7448330 was qcow2, converting to raw {{(pid=73917) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 19:17:17 user nova-compute[73917]: DEBUG nova.privsep.utils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73917) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 19:17:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a15323ee82a3bcab9aa06d020bc0524039708e62.part /opt/stack/data/nova/instances/_base/a15323ee82a3bcab9aa06d020bc0524039708e62.converted {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:17 user nova-compute[73917]: DEBUG nova.compute.manager [req-d55db4e5-9d8e-449d-929e-a20131ac0e5f req-8b4716a4-2c1c-4a97-b7a0-ea815cf975dd service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received event network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:17:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d55db4e5-9d8e-449d-929e-a20131ac0e5f req-8b4716a4-2c1c-4a97-b7a0-ea815cf975dd service nova] Acquiring lock "df5c717a-62d8-444d-9968-ad682a31733c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d55db4e5-9d8e-449d-929e-a20131ac0e5f req-8b4716a4-2c1c-4a97-b7a0-ea815cf975dd service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d55db4e5-9d8e-449d-929e-a20131ac0e5f req-8b4716a4-2c1c-4a97-b7a0-ea815cf975dd service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:17 user nova-compute[73917]: DEBUG nova.compute.manager [req-d55db4e5-9d8e-449d-929e-a20131ac0e5f req-8b4716a4-2c1c-4a97-b7a0-ea815cf975dd service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] No waiting events found dispatching network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:17:17 user nova-compute[73917]: WARNING nova.compute.manager [req-d55db4e5-9d8e-449d-929e-a20131ac0e5f req-8b4716a4-2c1c-4a97-b7a0-ea815cf975dd service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received unexpected event network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e for instance with vm_state active and task_state rescuing.
Aug 26 19:17:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a15323ee82a3bcab9aa06d020bc0524039708e62.part /opt/stack/data/nova/instances/_base/a15323ee82a3bcab9aa06d020bc0524039708e62.converted" returned: 0 in 0.321s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15323ee82a3bcab9aa06d020bc0524039708e62.converted --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:17 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:17:17 user nova-compute[73917]: INFO nova.compute.claims [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Claim successful on node user
Aug 26 19:17:17 user nova-compute[73917]: INFO nova.compute.resource_tracker [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Updating resource usage from migration 353ee397-ba9d-49a3-b4e1-13dc2a981649
Aug 26 19:17:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15323ee82a3bcab9aa06d020bc0524039708e62.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "a15323ee82a3bcab9aa06d020bc0524039708e62" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.811s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "a15323ee82a3bcab9aa06d020bc0524039708e62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "a15323ee82a3bcab9aa06d020bc0524039708e62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15323ee82a3bcab9aa06d020bc0524039708e62 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15323ee82a3bcab9aa06d020bc0524039708e62 --force-share --output=json" returned: 0 in 0.169s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15323ee82a3bcab9aa06d020bc0524039708e62,backing_fmt=raw /opt/stack/data/nova/instances/df5c717a-62d8-444d-9968-ad682a31733c/disk.rescue {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15323ee82a3bcab9aa06d020bc0524039708e62,backing_fmt=raw /opt/stack/data/nova/instances/df5c717a-62d8-444d-9968-ad682a31733c/disk.rescue" returned: 0 in 0.045s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "a15323ee82a3bcab9aa06d020bc0524039708e62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.objects.instance [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'migration_context' on Instance uuid df5c717a-62d8-444d-9968-ad682a31733c {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.objects.base [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Object Instance<df5c717a-62d8-444d-9968-ad682a31733c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Start _get_guest_xml network_info=[{"id": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "address": "fa:16:3e:ca:39:fd", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "vif_mac": "fa:16:3e:ca:39:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79ade91-3e", "ovs_interfaceid": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6fbc4d09-e425-4a44-8453-eb70d7448330', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igCIsrHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'df5c717a-62d8-444d-9968-ad682a31733c', 'attached_at': '', 'detached_at': '', 'volume_id': '6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8', 'serial': '6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'a053462d-8333-4de2-8ce9-0c7daf284f0d', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.objects.instance [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'resources' on Instance uuid df5c717a-62d8-444d-9968-ad682a31733c {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.objects.base [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Object Instance<df5c717a-62d8-444d-9968-ad682a31733c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.objects.instance [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'numa_topology' on Instance uuid df5c717a-62d8-444d-9968-ad682a31733c {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.objects.base [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Object Instance<df5c717a-62d8-444d-9968-ad682a31733c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:17:18 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:17:18 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.objects.instance [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'vcpu_model' on Instance uuid df5c717a-62d8-444d-9968-ad682a31733c {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.objects.base [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Object Instance<df5c717a-62d8-444d-9968-ad682a31733c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igCIsrHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:17:18 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:17:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:17:18 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:17:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:17:18 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6a4ebe-e85a-475e-aa09-3230e42f4318]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = igCIsrHF\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 19:17:18 user nova-compute[73917]: node.name = iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8
Aug 26 19:17:18 user nova-compute[73917]: node.tpgt = -1
Aug 26 19:17:18 user nova-compute[73917]: node.startup = automatic
Aug 26 19:17:18 user nova-compute[73917]: node.leading_login = No
Aug 26 19:17:18 user nova-compute[73917]: iface.iscsi_ifacename = default
Aug 26 19:17:18 user nova-compute[73917]: iface.net_ifacename = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.ipaddress = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.prefix_len = 0
Aug 26 19:17:18 user nova-compute[73917]: iface.hwaddress = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.transport_name = tcp
Aug 26 19:17:18 user nova-compute[73917]: iface.initiatorname = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.state = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.vlan_id = 0
Aug 26 19:17:18 user nova-compute[73917]: iface.vlan_priority = 0
Aug 26 19:17:18 user nova-compute[73917]: iface.vlan_state = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.iface_num = 0
Aug 26 19:17:18 user nova-compute[73917]: iface.mtu = 0
Aug 26 19:17:18 user nova-compute[73917]: iface.port = 0
Aug 26 19:17:18 user nova-compute[73917]: iface.bootproto = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.subnet_mask = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.gateway = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.dhcp_alt_client_id = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.dhcp_dns = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.dhcp_learn_iqn = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.dhcp_vendor_id_state = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.dhcp_vendor_id = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.dhcp_slp_da = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.fragmentation = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.gratuitous_arp = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.incoming_forwarding = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.tos_state = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.tos = 0
Aug 26 19:17:18 user nova-compute[73917]: iface.ttl = 0
Aug 26 19:17:18 user nova-compute[73917]: iface.delayed_ack = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.tcp_nagle = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.tcp_wsf_state = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.tcp_wsf = 0
Aug 26 19:17:18 user nova-compute[73917]: iface.tcp_timer_scale = 0
Aug 26 19:17:18 user nova-compute[73917]: iface.tcp_timestamp = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.redirect = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.def_task_mgmt_timeout = 0
Aug 26 19:17:18 user nova-compute[73917]: iface.header_digest = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.data_digest = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.immediate_data = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.initial_r2t = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.data_seq_inorder = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.data_pdu_inorder = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.erl = 0
Aug 26 19:17:18 user nova-compute[73917]: iface.max_receive_data_len = 0
Aug 26 19:17:18 user nova-compute[73917]: iface.first_burst_len = 0
Aug 26 19:17:18 user nova-compute[73917]: iface.max_outstanding_r2t = 0
Aug 26 19:17:18 user nova-compute[73917]: iface.max_burst_len = 0
Aug 26 19:17:18 user nova-compute[73917]: iface.chap_auth = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.bidi_chap = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.strict_login_compliance = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.discovery_auth = <empty>
Aug 26 19:17:18 user nova-compute[73917]: iface.discovery_logout = <empty>
Aug 26 19:17:18 user nova-compute[73917]: node.discovery_address = <empty>
Aug 26 19:17:18 user nova-compute[73917]: node.discovery_port = 0
Aug 26 19:17:18 user nova-compute[73917]: node.discovery_type = static
Aug 26 19:17:18 user nova-compute[73917]: node.session.initial_cmdsn = 0
Aug 26 19:17:18 user nova-compute[73917]: node.session.initial_login_retry_max = 8
Aug 26 19:17:18 user nova-compute[73917]: node.session.xmit_thread_priority = -20
Aug 26 19:17:18 user nova-compute[73917]: node.session.cmds_max = 128
Aug 26 19:17:18 user nova-compute[73917]: node.session.queue_depth = 32
Aug 26 19:17:18 user nova-compute[73917]: node.session.nr_sessions = 1
Aug 26 19:17:18 user nova-compute[73917]: node.session.auth.authmethod = CHAP
Aug 26 19:17:18 user nova-compute[73917]: node.session.auth.username = igCIsrHF
Aug 26 19:17:18 user nova-compute[73917]: node.session.auth.password = ***
Aug 26 19:17:18 user nova-compute[73917]: node.session.auth.username_in = <empty>
Aug 26 19:17:18 user nova-compute[73917]: node.session.auth.password_in = <empty>
Aug 26 19:17:18 user nova-compute[73917]: node.session.auth.chap_algs = MD5
Aug 26 19:17:18 user nova-compute[73917]: node.session.timeo.replacement_timeout = 120
Aug 26 19:17:18 user nova-compute[73917]: node.session.err_timeo.abort_timeout = 15
Aug 26 19:17:18 user nova-compute[73917]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 19:17:18 user nova-compute[73917]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 19:17:18 user nova-compute[73917]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 19:17:18 user nova-compute[73917]: node.session.iscsi.FastAbort = Yes
Aug 26 19:17:18 user nova-compute[73917]: node.session.iscsi.InitialR2T = No
Aug 26 19:17:18 user nova-compute[73917]: node.session.iscsi.ImmediateData = Yes
Aug 26 19:17:18 user nova-compute[73917]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 19:17:18 user nova-compute[73917]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 19:17:18 user nova-compute[73917]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 19:17:18 user nova-compute[73917]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 19:17:18 user nova-compute[73917]: node.session.iscsi.MaxConnections = 1
Aug 26 19:17:18 user nova-compute[73917]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 19:17:18 user nova-compute[73917]: node.session.iscsi.ERL = 0
Aug 26 19:17:18 user nova-compute[73917]: node.session.scan = manual
Aug 26 19:17:18 user nova-compute[73917]: node.session.reopen_max = 0
Aug 26 19:17:18 user nova-compute[73917]: node.conn[0].address = 172.16.0.220
Aug 26 19:17:18 user nova-compute[73917]: node.conn[0].port = 3260
Aug 26 19:17:18 user nova-compute[73917]: node.conn[0].startup = manual
Aug 26 19:17:18 user nova-compute[73917]: node.conn[0].tcp.window_size = 524288
Aug 26 19:17:18 user nova-compute[73917]: node.conn[0].tcp.type_of_service = 0
Aug 26 19:17:18 user nova-compute[73917]: node.conn[0].timeo.logout_timeout = 15
Aug 26 19:17:18 user nova-compute[73917]: node.conn[0].timeo.login_timeout = 15
Aug 26 19:17:18 user nova-compute[73917]: node.conn[0].timeo.auth_timeout = 45
Aug 26 19:17:18 user nova-compute[73917]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 19:17:18 user nova-compute[73917]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 19:17:18 user nova-compute[73917]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 19:17:18 user nova-compute[73917]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 19:17:18 user nova-compute[73917]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 19:17:18 user nova-compute[73917]: node.conn[0].iscsi.DataDigest = None
Aug 26 19:17:18 user nova-compute[73917]: node.conn[0].iscsi.IFMarker = No
Aug 26 19:17:18 user nova-compute[73917]: node.conn[0].iscsi.OFMarker = No
Aug 26 19:17:18 user nova-compute[73917]: # END RECORD
Aug 26 19:17:18 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.679s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:18 user nova-compute[73917]: INFO nova.compute.manager [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Migrating
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:17:18 user nova-compute[73917]: INFO nova.compute.rpcapi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6a6139-0e2a-438e-9325-393a14a82ffb]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b04ccbe-03ed-41e9-ab68-1926100ea9fd]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v igCIsrHF {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquired lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.network.neutron [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v igCIsrHF" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f19455-b688-47b9-a4ed-623623a1b67b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'igCIsrHF'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5996e9-8935-474d-a1cf-2b5952fa01a5]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2046db-04a6-4f35-a60d-1da4edde34d7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:17:18 user nova-compute[73917]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:17:18 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:17:18 user nova-compute[73917]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:17:18 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.170s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] HCTL ('33', '0', '0', 0) found on session 25 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9524025d-33d1-4f35-8e85-f97e54f8fe95]: (4, ('0 0 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Searching for a device in session 25 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igCIsrHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.194s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] <== connect_volume: return (196ms) {'type': 'block', 'scsi_wwn': '23136366333303664', 'path': '/dev/sdb'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136366333303664', 'path': '/dev/sdb'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1063003833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1063003833',id=23,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:16:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68229e3ed72a45fa8c2c9a33780479ce',ramdisk_id='',reservation_id='r-3l0cspu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:16:02Z,user_data=None,user_id='e056c4ed5a18427a8fd1eaa6a3a795c0',uuid=df5c717a-62d8-444d-9968-ad682a31733c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "address": "fa:16:3e:ca:39:fd", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "vif_mac": "fa:16:3e:ca:39:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79ade91-3e", "ovs_interfaceid": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converting VIF {"id": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "address": "fa:16:3e:ca:39:fd", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "vif_mac": "fa:16:3e:ca:39:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79ade91-3e", "ovs_interfaceid": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:39:fd,bridge_name='br-int',has_traffic_filtering=True,id=b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb79ade91-3e') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.objects.instance [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'pci_devices' on Instance uuid df5c717a-62d8-444d-9968-ad682a31733c {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.objects.base [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Object Instance<df5c717a-62d8-444d-9968-ad682a31733c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:17:18 user nova-compute[73917]:   <uuid>df5c717a-62d8-444d-9968-ad682a31733c</uuid>
Aug 26 19:17:18 user nova-compute[73917]:   <name>instance-00000017</name>
Aug 26 19:17:18 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:17:18 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:17:18 user nova-compute[73917]:   <metadata>
Aug 26 19:17:18 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:17:18 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:17:18 user nova-compute[73917]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1063003833</nova:name>
Aug 26 19:17:18 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:17:18</nova:creationTime>
Aug 26 19:17:18 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:17:18 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:17:18 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:17:18 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:17:18 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:17:18 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:17:18 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:17:18 user nova-compute[73917]:       <nova:owner>
Aug 26 19:17:18 user nova-compute[73917]:         <nova:user uuid="e056c4ed5a18427a8fd1eaa6a3a795c0">tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member</nova:user>
Aug 26 19:17:18 user nova-compute[73917]:         <nova:project uuid="68229e3ed72a45fa8c2c9a33780479ce">tempest-ServerBootFromVolumeStableRescueTest-1067875450</nova:project>
Aug 26 19:17:18 user nova-compute[73917]:       </nova:owner>
Aug 26 19:17:18 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:17:18 user nova-compute[73917]:       <nova:ports>
Aug 26 19:17:18 user nova-compute[73917]:         <nova:port uuid="b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e">
Aug 26 19:17:18 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 19:17:18 user nova-compute[73917]:         </nova:port>
Aug 26 19:17:18 user nova-compute[73917]:       </nova:ports>
Aug 26 19:17:18 user nova-compute[73917]:     </nova:instance>
Aug 26 19:17:18 user nova-compute[73917]:   </metadata>
Aug 26 19:17:18 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:17:18 user nova-compute[73917]:     <system>
Aug 26 19:17:18 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:17:18 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:17:18 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:17:18 user nova-compute[73917]:       <entry name="serial">df5c717a-62d8-444d-9968-ad682a31733c</entry>
Aug 26 19:17:18 user nova-compute[73917]:       <entry name="uuid">df5c717a-62d8-444d-9968-ad682a31733c</entry>
Aug 26 19:17:18 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:17:18 user nova-compute[73917]:     </system>
Aug 26 19:17:18 user nova-compute[73917]:   </sysinfo>
Aug 26 19:17:18 user nova-compute[73917]:   <os>
Aug 26 19:17:18 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:17:18 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:17:18 user nova-compute[73917]:   </os>
Aug 26 19:17:18 user nova-compute[73917]:   <features>
Aug 26 19:17:18 user nova-compute[73917]:     <acpi/>
Aug 26 19:17:18 user nova-compute[73917]:     <apic/>
Aug 26 19:17:18 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:17:18 user nova-compute[73917]:   </features>
Aug 26 19:17:18 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:17:18 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:17:18 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:17:18 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:17:18 user nova-compute[73917]:   </clock>
Aug 26 19:17:18 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:17:18 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:17:18 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:17:18 user nova-compute[73917]:   </cpu>
Aug 26 19:17:18 user nova-compute[73917]:   <devices>
Aug 26 19:17:18 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:17:18 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:17:18 user nova-compute[73917]:       <source dev="/dev/sdb"/>
Aug 26 19:17:18 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:17:18 user nova-compute[73917]:       <serial>6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8</serial>
Aug 26 19:17:18 user nova-compute[73917]:     </disk>
Aug 26 19:17:18 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:17:18 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:17:18 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/df5c717a-62d8-444d-9968-ad682a31733c/disk.rescue"/>
Aug 26 19:17:18 user nova-compute[73917]:       <target dev="vdb" bus="virtio"/>
Aug 26 19:17:18 user nova-compute[73917]:       <boot order="1"/>
Aug 26 19:17:18 user nova-compute[73917]:     </disk>
Aug 26 19:17:18 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:17:18 user nova-compute[73917]:       <mac address="fa:16:3e:ca:39:fd"/>
Aug 26 19:17:18 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:17:18 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:17:18 user nova-compute[73917]:       <target dev="tapb79ade91-3e"/>
Aug 26 19:17:18 user nova-compute[73917]:     </interface>
Aug 26 19:17:18 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:17:18 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/df5c717a-62d8-444d-9968-ad682a31733c/console.log" append="off"/>
Aug 26 19:17:18 user nova-compute[73917]:     </serial>
Aug 26 19:17:18 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:17:18 user nova-compute[73917]:     <video>
Aug 26 19:17:18 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:17:18 user nova-compute[73917]:     </video>
Aug 26 19:17:18 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:17:18 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:17:18 user nova-compute[73917]:     </rng>
Aug 26 19:17:18 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:17:18 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:17:18 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:17:18 user nova-compute[73917]:     </memballoon>
Aug 26 19:17:18 user nova-compute[73917]:   </devices>
Aug 26 19:17:18 user nova-compute[73917]: </domain>
Aug 26 19:17:18 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:17:18 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Instance destroyed successfully.
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] No VIF found with MAC fa:16:3e:ca:39:fd, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.network.neutron [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Updating instance_info_cache with network_info: [{"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Releasing lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Starting migrate_disk_and_power_off {{(pid=73917) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 19:17:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:19 user nova-compute[73917]: DEBUG nova.compute.manager [req-058e86a9-93f9-45fd-a141-93c3cf30ce71 req-1df498aa-9622-4fad-b900-de9dc1f2b912 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received event network-vif-unplugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:17:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-058e86a9-93f9-45fd-a141-93c3cf30ce71 req-1df498aa-9622-4fad-b900-de9dc1f2b912 service nova] Acquiring lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-058e86a9-93f9-45fd-a141-93c3cf30ce71 req-1df498aa-9622-4fad-b900-de9dc1f2b912 service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-058e86a9-93f9-45fd-a141-93c3cf30ce71 req-1df498aa-9622-4fad-b900-de9dc1f2b912 service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:19 user nova-compute[73917]: DEBUG nova.compute.manager [req-058e86a9-93f9-45fd-a141-93c3cf30ce71 req-1df498aa-9622-4fad-b900-de9dc1f2b912 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] No waiting events found dispatching network-vif-unplugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:17:19 user nova-compute[73917]: WARNING nova.compute.manager [req-058e86a9-93f9-45fd-a141-93c3cf30ce71 req-1df498aa-9622-4fad-b900-de9dc1f2b912 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received unexpected event network-vif-unplugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 for instance with vm_state active and task_state resize_migrating.
Aug 26 19:17:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:20 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Instance destroyed successfully.
Aug 26 19:17:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1165082774',display_name='tempest-ServerActionsTestOtherB-server-1165082774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1165082774',id=19,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf6A+tLmlhXN1ex/7jOISEFChezRDQZ5m7P/4PRHH+2Viff3bm+/OVarrZ0hky07ll3BRX4g048OhpV/rgYZ4nSom5KVv2Uu0RHTe6WT8eoSMJzatFMKJ/1TpRz/DQQnw==',key_name='tempest-keypair-2090853106',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='36d3d1cb213442cc9a672abe4a5c2b61',ramdisk_id='',reservation_id='r-0fa34jg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-824485866',owner_user_name='tempest-ServerActionsTestOtherB-824485866-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:17:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff1648bb2044c0e9fd90ece565c4e8e',uuid=dca28d65-37d0-4b60-b8aa-dcca61b6a187,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1228910982-network", "vif_mac": "fa:16:3e:14:4e:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Converting VIF {"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1228910982-network", "vif_mac": "fa:16:3e:14:4e:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG os_vif [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc63a3326-bd, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:20 user nova-compute[73917]: INFO os_vif [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd')
Aug 26 19:17:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjNosbWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:17:20 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:17:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57ff0c6-196c-43b3-be81-65ef6013097c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c215613-37f8-4bd3-9221-dbaf8757da6a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:17:20 user nova-compute[73917]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:17:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:17:20 user nova-compute[73917]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:17:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b7870b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3'): ({'sdc'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Removing single pathed devices sdc {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28bb19f-fc96-4ea0-979c-dc92b8b9440c]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab126dd0-17e7-4491-8e2b-3324beccf68c]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Flushing IO for device /dev/sdc {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[622b80ab-eb1c-4efa-8d60-5b48b03203e5]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c9c8d9-3709-4e3e-b0eb-11a749e6d5c9]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a9cfee-d861-4f27-8c74-baa3db68b701]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG nova.compute.manager [req-fd0fc542-6080-4484-9996-bc18e16408a2 req-ae5e8c2b-c694-40b8-90c4-e0b94af384b4 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received event network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fd0fc542-6080-4484-9996-bc18e16408a2 req-ae5e8c2b-c694-40b8-90c4-e0b94af384b4 service nova] Acquiring lock "df5c717a-62d8-444d-9968-ad682a31733c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fd0fc542-6080-4484-9996-bc18e16408a2 req-ae5e8c2b-c694-40b8-90c4-e0b94af384b4 service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fd0fc542-6080-4484-9996-bc18e16408a2 req-ae5e8c2b-c694-40b8-90c4-e0b94af384b4 service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG nova.compute.manager [req-fd0fc542-6080-4484-9996-bc18e16408a2 req-ae5e8c2b-c694-40b8-90c4-e0b94af384b4 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] No waiting events found dispatching network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:17:20 user nova-compute[73917]: WARNING nova.compute.manager [req-fd0fc542-6080-4484-9996-bc18e16408a2 req-ae5e8c2b-c694-40b8-90c4-e0b94af384b4 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received unexpected event network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e for instance with vm_state active and task_state rescuing.
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fd276a-ce1d-42c4-9f3f-2ff06f6364f3]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260]
Aug 26 19:17:20 user nova-compute[73917]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260] successful.
Aug 26 19:17:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8a9e6d-e084-4a72-807b-ba2d73807849]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] <== disconnect_volume: return (301ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:17:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187_resize/disk /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CMD "cp -r /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187_resize/disk /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk" returned: 0 in 0.284s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187_resize/disk.info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk.info {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CMD "cp -r /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187_resize/disk.info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk.info" returned: 0 in 0.045s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-8a9cb7d7-8e78-4f4c-ab98-7f1cb6b53bdb req-77b41807-c8ac-409f-9b7f-037e7985257d service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received event network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:17:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8a9cb7d7-8e78-4f4c-ab98-7f1cb6b53bdb req-77b41807-c8ac-409f-9b7f-037e7985257d service nova] Acquiring lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8a9cb7d7-8e78-4f4c-ab98-7f1cb6b53bdb req-77b41807-c8ac-409f-9b7f-037e7985257d service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8a9cb7d7-8e78-4f4c-ab98-7f1cb6b53bdb req-77b41807-c8ac-409f-9b7f-037e7985257d service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-8a9cb7d7-8e78-4f4c-ab98-7f1cb6b53bdb req-77b41807-c8ac-409f-9b7f-037e7985257d service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] No waiting events found dispatching network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:17:21 user nova-compute[73917]: WARNING nova.compute.manager [req-8a9cb7d7-8e78-4f4c-ab98-7f1cb6b53bdb req-77b41807-c8ac-409f-9b7f-037e7985257d service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received unexpected event network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 for instance with vm_state active and task_state resize_migrating.
Aug 26 19:17:22 user nova-compute[73917]: DEBUG nova.network.neutron [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Port c63a3326-bd42-40f4-8559-b7f08e5f9a98 binding to destination host user is already ACTIVE {{(pid=73917) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 19:17:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Removed pending event for df5c717a-62d8-444d-9968-ad682a31733c due to event {{(pid=73917) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 19:17:22 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077442.3122795, df5c717a-62d8-444d-9968-ad682a31733c => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:17:22 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] VM Resumed (Lifecycle Event)
Aug 26 19:17:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-e995d486-76a9-4096-b5b6-26537e7706fb tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:17:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:17:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:17:22 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 19:17:22 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077442.3138902, df5c717a-62d8-444d-9968-ad682a31733c => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:17:22 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] VM Started (Lifecycle Event)
Aug 26 19:17:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:17:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:17:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-ef070a78-880b-498c-a72a-6d778f32e4db req-4908225b-238a-44f9-970a-565fbe0d3b22 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received event network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:17:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ef070a78-880b-498c-a72a-6d778f32e4db req-4908225b-238a-44f9-970a-565fbe0d3b22 service nova] Acquiring lock "df5c717a-62d8-444d-9968-ad682a31733c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ef070a78-880b-498c-a72a-6d778f32e4db req-4908225b-238a-44f9-970a-565fbe0d3b22 service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ef070a78-880b-498c-a72a-6d778f32e4db req-4908225b-238a-44f9-970a-565fbe0d3b22 service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-ef070a78-880b-498c-a72a-6d778f32e4db req-4908225b-238a-44f9-970a-565fbe0d3b22 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] No waiting events found dispatching network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:17:22 user nova-compute[73917]: WARNING nova.compute.manager [req-ef070a78-880b-498c-a72a-6d778f32e4db req-4908225b-238a-44f9-970a-565fbe0d3b22 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received unexpected event network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e for instance with vm_state rescued and task_state None.
Aug 26 19:17:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:17:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquired lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:17:22 user nova-compute[73917]: DEBUG nova.network.neutron [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG nova.network.neutron [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Updating instance_info_cache with network_info: [{"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Releasing lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG os_brick.utils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f831ec-8c05-4b67-8e73-1551d628d488]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6a3a3a-3b5f-4893-a5af-d96b0bd9115d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da4b028-21e5-4131-b9e9-2771f149d45f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a7b452-5cf4-49a9-aaf4-696c771ce5ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:17:23 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:17:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c7c4bf-d98b-424b-86ab-722a0ba8e57f]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:17:23 user nova-compute[73917]: DEBUG os_brick.utils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:17:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-a24e4b5c-1f44-47a6-b868-af21df5b70b0 req-deb8285c-4bb4-4f75-a547-6409731a54c8 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received event network-changed-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:17:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-a24e4b5c-1f44-47a6-b868-af21df5b70b0 req-deb8285c-4bb4-4f75-a547-6409731a54c8 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Refreshing instance network info cache due to event network-changed-c7ef21a0-d036-4b14-8067-594a1f2181ba. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:17:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a24e4b5c-1f44-47a6-b868-af21df5b70b0 req-deb8285c-4bb4-4f75-a547-6409731a54c8 service nova] Acquiring lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:17:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a24e4b5c-1f44-47a6-b868-af21df5b70b0 req-deb8285c-4bb4-4f75-a547-6409731a54c8 service nova] Acquired lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:17:25 user nova-compute[73917]: DEBUG nova.network.neutron [req-a24e4b5c-1f44-47a6-b868-af21df5b70b0 req-deb8285c-4bb4-4f75-a547-6409731a54c8 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Refreshing network info cache for port c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:17:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:25 user nova-compute[73917]: DEBUG nova.objects.instance [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'flavor' on Instance uuid f4e84db3-1f3b-471f-9f82-5a692fdb6c06 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:17:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG nova.network.neutron [req-a24e4b5c-1f44-47a6-b868-af21df5b70b0 req-deb8285c-4bb4-4f75-a547-6409731a54c8 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Updated VIF entry in instance network info cache for port c7ef21a0-d036-4b14-8067-594a1f2181ba. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG nova.network.neutron [req-a24e4b5c-1f44-47a6-b868-af21df5b70b0 req-deb8285c-4bb4-4f75-a547-6409731a54c8 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Updating instance_info_cache with network_info: [{"id": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "address": "fa:16:3e:25:d1:18", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ef21a0-d0", "ovs_interfaceid": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:26 user nova-compute[73917]: INFO nova.compute.manager [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Attaching volume a464dbc8-9a4b-45d3-abbd-6925b661738c to /dev/vdb
Aug 26 19:17:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a24e4b5c-1f44-47a6-b868-af21df5b70b0 req-deb8285c-4bb4-4f75-a547-6409731a54c8 service nova] Releasing lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG os_brick.utils [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcc8112-6275-4c42-afa2-c5b2735cbdf2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafae31c-216f-4fcc-afd1-46742853b6b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fed07b-169c-44dc-9cb4-86a92ff1da9e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7668b57a-5f39-4e94-9354-34237e8284ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:17:26 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:17:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc63ebe-7d91-4aab-86b2-d2b66c0060ff]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG os_brick.utils [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] <== get_connector_properties: return (228ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:17:26 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Updating existing volume attachment record: 870f2a51-1ece-4165-9303-aa0aaae489f3 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:17:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077440.1667082, dca28d65-37d0-4b60-b8aa-dcca61b6a187 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:17:35 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] VM Stopped (Lifecycle Event)
Aug 26 19:17:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ff0c585c-c75e-4558-8611-9641a9cc182c None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ff0c585c-c75e-4558-8611-9641a9cc182c None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:17:35 user nova-compute[73917]: INFO nova.compute.manager [None req-ff0c585c-c75e-4558-8611-9641a9cc182c None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Starting finish_migration {{(pid=73917) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Instance directory exists: not creating {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 19:17:35 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Creating image(s)
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk. size=21474836480 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk 21474836480 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk 21474836480" returned: 0 in 0.140s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Did not create local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Ensure instance console log exists: /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Start _get_guest_xml network_info=[{"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1228910982-network", "vif_mac": "fa:16:3e:14:4e:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjNosbWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'dca28d65-37d0-4b60-b8aa-dcca61b6a187', 'attached_at': '2023-08-26T19:17:35.000000', 'detached_at': '', 'volume_id': '15a7f1e0-2183-4228-bec3-0489f0238cd3', 'serial': '15a7f1e0-2183-4228-bec3-0489f0238cd3'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '78294d88-a3cf-4322-88f7-28020e7b63a0', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:17:35 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:17:35 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjNosbWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:17:35 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:17:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:17:35 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:17:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:17:35 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0068537-b7da-4208-9562-28b81ec295bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:17:35 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[999b28a0-17ef-440d-aa65-55663eed3a2c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3] added
Aug 26 19:17:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87d5475-27a3-47cf-970a-398bb0d8136d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa78da23-94c6-4230-b723-d6ccf95208d3]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LjNosbWr {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LjNosbWr" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbda4256-6941-47df-b0f9-4ae8cf9b8d85]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LjNosbWr'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[49764df6-ad5d-40c4-bfd8-efa8fb7b8e48]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbed0bc-a16e-480e-8659-5cfb332e7ea4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:17:36 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:17:36 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[53774c52-40ae-41ee-9a5a-ccdd91a9a5b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260]
Aug 26 19:17:36 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260] successful.
Aug 26 19:17:36 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a628ca8-bf58-4a5b-b369-a6e139885e6d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a13952-3f38-4e82-8146-2ceb8de84ade]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:17:36 user nova-compute[73917]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:17:36 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:17:36 user nova-compute[73917]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:17:36 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c155369b-b3b7-4e7a-b118-6c4b9ffab043]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:17:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjNosbWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26464326433623030', 'path': '/dev/sdc'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464326433623030', 'path': '/dev/sdc'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1165082774',display_name='tempest-ServerActionsTestOtherB-server-1165082774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1165082774',id=19,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf6A+tLmlhXN1ex/7jOISEFChezRDQZ5m7P/4PRHH+2Viff3bm+/OVarrZ0hky07ll3BRX4g048OhpV/rgYZ4nSom5KVv2Uu0RHTe6WT8eoSMJzatFMKJ/1TpRz/DQQnw==',key_name='tempest-keypair-2090853106',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='36d3d1cb213442cc9a672abe4a5c2b61',ramdisk_id='',reservation_id='r-0fa34jg8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-824485866',owner_user_name='tempest-ServerActionsTestOtherB-824485866-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:17:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff1648bb2044c0e9fd90ece565c4e8e',uuid=dca28d65-37d0-4b60-b8aa-dcca61b6a187,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1228910982-network", "vif_mac": "fa:16:3e:14:4e:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Converting VIF {"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1228910982-network", "vif_mac": "fa:16:3e:14:4e:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:17:37 user nova-compute[73917]:   <uuid>dca28d65-37d0-4b60-b8aa-dcca61b6a187</uuid>
Aug 26 19:17:37 user nova-compute[73917]:   <name>instance-00000013</name>
Aug 26 19:17:37 user nova-compute[73917]:   <memory>2097152</memory>
Aug 26 19:17:37 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:17:37 user nova-compute[73917]:   <metadata>
Aug 26 19:17:37 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:17:37 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:17:37 user nova-compute[73917]:       <nova:name>tempest-ServerActionsTestOtherB-server-1165082774</nova:name>
Aug 26 19:17:37 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:17:35</nova:creationTime>
Aug 26 19:17:37 user nova-compute[73917]:       <nova:flavor name="m1.small">
Aug 26 19:17:37 user nova-compute[73917]:         <nova:memory>2048</nova:memory>
Aug 26 19:17:37 user nova-compute[73917]:         <nova:disk>20</nova:disk>
Aug 26 19:17:37 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:17:37 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:17:37 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:17:37 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:17:37 user nova-compute[73917]:       <nova:owner>
Aug 26 19:17:37 user nova-compute[73917]:         <nova:user uuid="0ff1648bb2044c0e9fd90ece565c4e8e">tempest-ServerActionsTestOtherB-824485866-project-member</nova:user>
Aug 26 19:17:37 user nova-compute[73917]:         <nova:project uuid="36d3d1cb213442cc9a672abe4a5c2b61">tempest-ServerActionsTestOtherB-824485866</nova:project>
Aug 26 19:17:37 user nova-compute[73917]:       </nova:owner>
Aug 26 19:17:37 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:17:37 user nova-compute[73917]:       <nova:ports>
Aug 26 19:17:37 user nova-compute[73917]:         <nova:port uuid="c63a3326-bd42-40f4-8559-b7f08e5f9a98">
Aug 26 19:17:37 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 19:17:37 user nova-compute[73917]:         </nova:port>
Aug 26 19:17:37 user nova-compute[73917]:       </nova:ports>
Aug 26 19:17:37 user nova-compute[73917]:     </nova:instance>
Aug 26 19:17:37 user nova-compute[73917]:   </metadata>
Aug 26 19:17:37 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:17:37 user nova-compute[73917]:     <system>
Aug 26 19:17:37 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:17:37 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:17:37 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:17:37 user nova-compute[73917]:       <entry name="serial">dca28d65-37d0-4b60-b8aa-dcca61b6a187</entry>
Aug 26 19:17:37 user nova-compute[73917]:       <entry name="uuid">dca28d65-37d0-4b60-b8aa-dcca61b6a187</entry>
Aug 26 19:17:37 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:17:37 user nova-compute[73917]:     </system>
Aug 26 19:17:37 user nova-compute[73917]:   </sysinfo>
Aug 26 19:17:37 user nova-compute[73917]:   <os>
Aug 26 19:17:37 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:17:37 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:17:37 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:17:37 user nova-compute[73917]:   </os>
Aug 26 19:17:37 user nova-compute[73917]:   <features>
Aug 26 19:17:37 user nova-compute[73917]:     <acpi/>
Aug 26 19:17:37 user nova-compute[73917]:     <apic/>
Aug 26 19:17:37 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:17:37 user nova-compute[73917]:   </features>
Aug 26 19:17:37 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:17:37 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:17:37 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:17:37 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:17:37 user nova-compute[73917]:   </clock>
Aug 26 19:17:37 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:17:37 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:17:37 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:17:37 user nova-compute[73917]:   </cpu>
Aug 26 19:17:37 user nova-compute[73917]:   <devices>
Aug 26 19:17:37 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:17:37 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:17:37 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk"/>
Aug 26 19:17:37 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:17:37 user nova-compute[73917]:     </disk>
Aug 26 19:17:37 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:17:37 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:17:37 user nova-compute[73917]:       <source dev="/dev/sdc"/>
Aug 26 19:17:37 user nova-compute[73917]:       <target dev="vdb" bus="virtio"/>
Aug 26 19:17:37 user nova-compute[73917]:       <serial>15a7f1e0-2183-4228-bec3-0489f0238cd3</serial>
Aug 26 19:17:37 user nova-compute[73917]:     </disk>
Aug 26 19:17:37 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:17:37 user nova-compute[73917]:       <mac address="fa:16:3e:14:4e:59"/>
Aug 26 19:17:37 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:17:37 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:17:37 user nova-compute[73917]:       <target dev="tapc63a3326-bd"/>
Aug 26 19:17:37 user nova-compute[73917]:     </interface>
Aug 26 19:17:37 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:17:37 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/console.log" append="off"/>
Aug 26 19:17:37 user nova-compute[73917]:     </serial>
Aug 26 19:17:37 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:17:37 user nova-compute[73917]:     <video>
Aug 26 19:17:37 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:17:37 user nova-compute[73917]:     </video>
Aug 26 19:17:37 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:17:37 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:17:37 user nova-compute[73917]:     </rng>
Aug 26 19:17:37 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:17:37 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:17:37 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:17:37 user nova-compute[73917]:     </memballoon>
Aug 26 19:17:37 user nova-compute[73917]:   </devices>
Aug 26 19:17:37 user nova-compute[73917]: </domain>
Aug 26 19:17:37 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1165082774',display_name='tempest-ServerActionsTestOtherB-server-1165082774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1165082774',id=19,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf6A+tLmlhXN1ex/7jOISEFChezRDQZ5m7P/4PRHH+2Viff3bm+/OVarrZ0hky07ll3BRX4g048OhpV/rgYZ4nSom5KVv2Uu0RHTe6WT8eoSMJzatFMKJ/1TpRz/DQQnw==',key_name='tempest-keypair-2090853106',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='36d3d1cb213442cc9a672abe4a5c2b61',ramdisk_id='',reservation_id='r-0fa34jg8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-824485866',owner_user_name='tempest-ServerActionsTestOtherB-824485866-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:17:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff1648bb2044c0e9fd90ece565c4e8e',uuid=dca28d65-37d0-4b60-b8aa-dcca61b6a187,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1228910982-network", "vif_mac": "fa:16:3e:14:4e:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Converting VIF {"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1228910982-network", "vif_mac": "fa:16:3e:14:4e:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG os_vif [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc63a3326-bd, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc63a3326-bd, col_values=(('external_ids', {'iface-id': 'c63a3326-bd42-40f4-8559-b7f08e5f9a98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:4e:59', 'vm-uuid': 'dca28d65-37d0-4b60-b8aa-dcca61b6a187'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:37 user nova-compute[73917]: INFO os_vif [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd')
Aug 26 19:17:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:17:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] No VIF found with MAC fa:16:3e:14:4e:59, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScghMnab', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:17:38 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:17:38 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:17:38 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fa945a-9d40-4494-8ef7-953707e81ff4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:17:38 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6190bb1f-9c75-42a4-b7a8-b48b7bd0f513]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c] added
Aug 26 19:17:38 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[551ebe65-9ff3-442d-80b5-31ed8dad9404]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28f0ba6-8f3c-42ee-a169-1205b7513f93]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ScghMnab {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ScghMnab" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[308fbd08-272b-49a5-9ad5-6ffe27252863]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ScghMnab'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a12bdf-1cfc-431d-a71d-72b24a57f00b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bc502e-19e4-497e-841d-5807f2a1bec3]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:17:38 user nova-compute[73917]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:17:38 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:17:38 user nova-compute[73917]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:17:38 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[851520e1-c4a7-42ef-ba20-944406dc71cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c, portal: 172.16.0.220,3260]
Aug 26 19:17:38 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c, portal: 172.16.0.220,3260] successful.
Aug 26 19:17:38 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d5292a-e4fd-42ae-a0e2-b8513626dbcc]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec681372-7cdd-4aab-bc91-cbc546631e83]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:17:38 user nova-compute[73917]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:17:38 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:17:38 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:17:38 user nova-compute[73917]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:17:38 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:17:38 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b91e2ee-2908-41ca-89fc-c6a688c38c58]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScghMnab', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:39 user nova-compute[73917]: DEBUG nova.compute.manager [req-f4afcd9d-562c-40fc-9ac8-fa71c3e4a126 req-93a16726-a97f-49b3-b5cc-6e2bcddd0de1 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received event network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:17:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f4afcd9d-562c-40fc-9ac8-fa71c3e4a126 req-93a16726-a97f-49b3-b5cc-6e2bcddd0de1 service nova] Acquiring lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f4afcd9d-562c-40fc-9ac8-fa71c3e4a126 req-93a16726-a97f-49b3-b5cc-6e2bcddd0de1 service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f4afcd9d-562c-40fc-9ac8-fa71c3e4a126 req-93a16726-a97f-49b3-b5cc-6e2bcddd0de1 service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:39 user nova-compute[73917]: DEBUG nova.compute.manager [req-f4afcd9d-562c-40fc-9ac8-fa71c3e4a126 req-93a16726-a97f-49b3-b5cc-6e2bcddd0de1 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] No waiting events found dispatching network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:17:39 user nova-compute[73917]: WARNING nova.compute.manager [req-f4afcd9d-562c-40fc-9ac8-fa71c3e4a126 req-93a16726-a97f-49b3-b5cc-6e2bcddd0de1 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received unexpected event network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 for instance with vm_state active and task_state resize_finish.
Aug 26 19:17:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:17:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26531303631386166', 'path': '/dev/sdd'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:17:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531303631386166', 'path': '/dev/sdd'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:17:39 user nova-compute[73917]: DEBUG nova.objects.instance [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'flavor' on Instance uuid f4e84db3-1f3b-471f-9f82-5a692fdb6c06 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:17:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:17:39 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:17:39 user nova-compute[73917]:   <source dev="/dev/sdd"/>
Aug 26 19:17:39 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:17:39 user nova-compute[73917]:   <serial>a464dbc8-9a4b-45d3-abbd-6925b661738c</serial>
Aug 26 19:17:39 user nova-compute[73917]: </disk>
Aug 26 19:17:39 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:17:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:17:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:17:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] No VIF found with MAC fa:16:3e:25:d1:18, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:17:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3967cf7b-ef4a-47e8-b782-2a62ccd34145 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.022s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:40 user nova-compute[73917]: INFO nova.compute.manager [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Rescuing
Aug 26 19:17:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:17:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquired lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:17:40 user nova-compute[73917]: DEBUG nova.network.neutron [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:17:40 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077460.9108021, dca28d65-37d0-4b60-b8aa-dcca61b6a187 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:17:40 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] VM Resumed (Lifecycle Event)
Aug 26 19:17:40 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:17:40 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Instance running successfully.
Aug 26 19:17:40 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:17:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Failed to set time: agent not configured {{(pid=73917) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 26 19:17:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2ddd99f4-e5f0-40ba-af8b-373d6eff4e9f tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] finish_migration finished successfully. {{(pid=73917) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 26 19:17:40 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:17:40 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 19:17:40 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077460.9172971, dca28d65-37d0-4b60-b8aa-dcca61b6a187 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:17:40 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] VM Started (Lifecycle Event)
Aug 26 19:17:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:17:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:17:41 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 19:17:41 user nova-compute[73917]: DEBUG nova.compute.manager [req-58c6a278-9f45-456a-a2d6-78ba02127623 req-86c3d54e-b543-4f16-842d-3a9c3fe68df1 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received event network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:17:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-58c6a278-9f45-456a-a2d6-78ba02127623 req-86c3d54e-b543-4f16-842d-3a9c3fe68df1 service nova] Acquiring lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-58c6a278-9f45-456a-a2d6-78ba02127623 req-86c3d54e-b543-4f16-842d-3a9c3fe68df1 service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-58c6a278-9f45-456a-a2d6-78ba02127623 req-86c3d54e-b543-4f16-842d-3a9c3fe68df1 service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:41 user nova-compute[73917]: DEBUG nova.compute.manager [req-58c6a278-9f45-456a-a2d6-78ba02127623 req-86c3d54e-b543-4f16-842d-3a9c3fe68df1 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] No waiting events found dispatching network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:17:41 user nova-compute[73917]: WARNING nova.compute.manager [req-58c6a278-9f45-456a-a2d6-78ba02127623 req-86c3d54e-b543-4f16-842d-3a9c3fe68df1 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received unexpected event network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 for instance with vm_state active and task_state resize_finish.
Aug 26 19:17:41 user nova-compute[73917]: DEBUG nova.network.neutron [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Updating instance_info_cache with network_info: [{"id": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "address": "fa:16:3e:25:d1:18", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ef21a0-d0", "ovs_interfaceid": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:17:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Releasing lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:17:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:42 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Instance destroyed successfully.
Aug 26 19:17:42 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Attempting rescue
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73917) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Instance directory exists: not creating {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 19:17:42 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Creating image(s)
Aug 26 19:17:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "/opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "/opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.objects.instance [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'trusted_certs' on Instance uuid f4e84db3-1f3b-471f-9f82-5a692fdb6c06 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.194s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk.rescue {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk.rescue" returned: 0 in 0.066s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.objects.instance [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'migration_context' on Instance uuid f4e84db3-1f3b-471f-9f82-5a692fdb6c06 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.objects.base [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Object Instance<f4e84db3-1f3b-471f-9f82-5a692fdb6c06> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Start _get_guest_xml network_info=[{"id": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "address": "fa:16:3e:25:d1:18", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "vif_mac": "fa:16:3e:25:d1:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ef21a0-d0", "ovs_interfaceid": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.objects.instance [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'resources' on Instance uuid f4e84db3-1f3b-471f-9f82-5a692fdb6c06 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.objects.base [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Object Instance<f4e84db3-1f3b-471f-9f82-5a692fdb6c06> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.objects.instance [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'numa_topology' on Instance uuid f4e84db3-1f3b-471f-9f82-5a692fdb6c06 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.objects.base [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Object Instance<f4e84db3-1f3b-471f-9f82-5a692fdb6c06> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:17:42 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:17:42 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.objects.instance [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'vcpu_model' on Instance uuid f4e84db3-1f3b-471f-9f82-5a692fdb6c06 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.objects.base [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Object Instance<f4e84db3-1f3b-471f-9f82-5a692fdb6c06> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1308800063',display_name='tempest-ServerRescueNegativeTestJSON-server-1308800063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1308800063',id=24,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGjEgFmZWCuUIpbfIsdYNVrH57MJGBdjCsYvuXKTDomE8Sf1OwmCLTlNrmFypkCzReg1pf2c663Y/yL4RjOUVd7yq4SqAVhIAw4G8JOI8+uExEk9cM86FgJmqZfxMd1rw==',key_name='tempest-keypair-1145554874',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:15:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1298aa7a6ca478fb973d5a6d7bea7be',ramdisk_id='',reservation_id='r-27guj55y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475026115',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475026115-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:15:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='118080e0f2fe4533a25e002e894b99f9',uuid=f4e84db3-1f3b-471f-9f82-5a692fdb6c06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "address": "fa:16:3e:25:d1:18", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "vif_mac": "fa:16:3e:25:d1:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ef21a0-d0", "ovs_interfaceid": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converting VIF {"id": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "address": "fa:16:3e:25:d1:18", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "vif_mac": "fa:16:3e:25:d1:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ef21a0-d0", "ovs_interfaceid": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:d1:18,bridge_name='br-int',has_traffic_filtering=True,id=c7ef21a0-d036-4b14-8067-594a1f2181ba,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ef21a0-d0') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.objects.instance [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'pci_devices' on Instance uuid f4e84db3-1f3b-471f-9f82-5a692fdb6c06 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.objects.base [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Object Instance<f4e84db3-1f3b-471f-9f82-5a692fdb6c06> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:17:42 user nova-compute[73917]:   <uuid>f4e84db3-1f3b-471f-9f82-5a692fdb6c06</uuid>
Aug 26 19:17:42 user nova-compute[73917]:   <name>instance-00000018</name>
Aug 26 19:17:42 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:17:42 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:17:42 user nova-compute[73917]:   <metadata>
Aug 26 19:17:42 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:17:42 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:17:42 user nova-compute[73917]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1308800063</nova:name>
Aug 26 19:17:42 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:17:42</nova:creationTime>
Aug 26 19:17:42 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:17:42 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:17:42 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:17:42 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:17:42 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:17:42 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:17:42 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:17:42 user nova-compute[73917]:       <nova:owner>
Aug 26 19:17:42 user nova-compute[73917]:         <nova:user uuid="118080e0f2fe4533a25e002e894b99f9">tempest-ServerRescueNegativeTestJSON-1475026115-project-member</nova:user>
Aug 26 19:17:42 user nova-compute[73917]:         <nova:project uuid="d1298aa7a6ca478fb973d5a6d7bea7be">tempest-ServerRescueNegativeTestJSON-1475026115</nova:project>
Aug 26 19:17:42 user nova-compute[73917]:       </nova:owner>
Aug 26 19:17:42 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:17:42 user nova-compute[73917]:       <nova:ports>
Aug 26 19:17:42 user nova-compute[73917]:         <nova:port uuid="c7ef21a0-d036-4b14-8067-594a1f2181ba">
Aug 26 19:17:42 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 19:17:42 user nova-compute[73917]:         </nova:port>
Aug 26 19:17:42 user nova-compute[73917]:       </nova:ports>
Aug 26 19:17:42 user nova-compute[73917]:     </nova:instance>
Aug 26 19:17:42 user nova-compute[73917]:   </metadata>
Aug 26 19:17:42 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:17:42 user nova-compute[73917]:     <system>
Aug 26 19:17:42 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:17:42 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:17:42 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:17:42 user nova-compute[73917]:       <entry name="serial">f4e84db3-1f3b-471f-9f82-5a692fdb6c06</entry>
Aug 26 19:17:42 user nova-compute[73917]:       <entry name="uuid">f4e84db3-1f3b-471f-9f82-5a692fdb6c06</entry>
Aug 26 19:17:42 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:17:42 user nova-compute[73917]:     </system>
Aug 26 19:17:42 user nova-compute[73917]:   </sysinfo>
Aug 26 19:17:42 user nova-compute[73917]:   <os>
Aug 26 19:17:42 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:17:42 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:17:42 user nova-compute[73917]:   </os>
Aug 26 19:17:42 user nova-compute[73917]:   <features>
Aug 26 19:17:42 user nova-compute[73917]:     <acpi/>
Aug 26 19:17:42 user nova-compute[73917]:     <apic/>
Aug 26 19:17:42 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:17:42 user nova-compute[73917]:   </features>
Aug 26 19:17:42 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:17:42 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:17:42 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:17:42 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:17:42 user nova-compute[73917]:   </clock>
Aug 26 19:17:42 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:17:42 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:17:42 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:17:42 user nova-compute[73917]:   </cpu>
Aug 26 19:17:42 user nova-compute[73917]:   <devices>
Aug 26 19:17:42 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:17:42 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:17:42 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk.rescue"/>
Aug 26 19:17:42 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:17:42 user nova-compute[73917]:     </disk>
Aug 26 19:17:42 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:17:42 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:17:42 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk"/>
Aug 26 19:17:42 user nova-compute[73917]:       <target dev="vdb" bus="virtio"/>
Aug 26 19:17:42 user nova-compute[73917]:     </disk>
Aug 26 19:17:42 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:17:42 user nova-compute[73917]:       <mac address="fa:16:3e:25:d1:18"/>
Aug 26 19:17:42 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:17:42 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:17:42 user nova-compute[73917]:       <target dev="tapc7ef21a0-d0"/>
Aug 26 19:17:42 user nova-compute[73917]:     </interface>
Aug 26 19:17:42 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:17:42 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/console.log" append="off"/>
Aug 26 19:17:42 user nova-compute[73917]:     </serial>
Aug 26 19:17:42 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:17:42 user nova-compute[73917]:     <video>
Aug 26 19:17:42 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:17:42 user nova-compute[73917]:     </video>
Aug 26 19:17:42 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:17:42 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:17:42 user nova-compute[73917]:     </rng>
Aug 26 19:17:42 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:17:42 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:17:42 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:17:42 user nova-compute[73917]:     </memballoon>
Aug 26 19:17:42 user nova-compute[73917]:   </devices>
Aug 26 19:17:42 user nova-compute[73917]: </domain>
Aug 26 19:17:42 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:17:42 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Instance destroyed successfully.
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:17:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] No VIF found with MAC fa:16:3e:25:d1:18, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:17:43 user nova-compute[73917]: DEBUG nova.compute.manager [req-5a2b58a9-b97d-4a59-829b-e61d846a98a5 req-7d477e50-4975-4688-b377-dcef9ad68e6b service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received event network-vif-unplugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:17:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5a2b58a9-b97d-4a59-829b-e61d846a98a5 req-7d477e50-4975-4688-b377-dcef9ad68e6b service nova] Acquiring lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5a2b58a9-b97d-4a59-829b-e61d846a98a5 req-7d477e50-4975-4688-b377-dcef9ad68e6b service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5a2b58a9-b97d-4a59-829b-e61d846a98a5 req-7d477e50-4975-4688-b377-dcef9ad68e6b service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:43 user nova-compute[73917]: DEBUG nova.compute.manager [req-5a2b58a9-b97d-4a59-829b-e61d846a98a5 req-7d477e50-4975-4688-b377-dcef9ad68e6b service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] No waiting events found dispatching network-vif-unplugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:17:43 user nova-compute[73917]: WARNING nova.compute.manager [req-5a2b58a9-b97d-4a59-829b-e61d846a98a5 req-7d477e50-4975-4688-b377-dcef9ad68e6b service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received unexpected event network-vif-unplugged-c7ef21a0-d036-4b14-8067-594a1f2181ba for instance with vm_state active and task_state rescuing.
Aug 26 19:17:43 user nova-compute[73917]: DEBUG nova.compute.manager [req-5a2b58a9-b97d-4a59-829b-e61d846a98a5 req-7d477e50-4975-4688-b377-dcef9ad68e6b service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received event network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:17:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5a2b58a9-b97d-4a59-829b-e61d846a98a5 req-7d477e50-4975-4688-b377-dcef9ad68e6b service nova] Acquiring lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5a2b58a9-b97d-4a59-829b-e61d846a98a5 req-7d477e50-4975-4688-b377-dcef9ad68e6b service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5a2b58a9-b97d-4a59-829b-e61d846a98a5 req-7d477e50-4975-4688-b377-dcef9ad68e6b service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:43 user nova-compute[73917]: DEBUG nova.compute.manager [req-5a2b58a9-b97d-4a59-829b-e61d846a98a5 req-7d477e50-4975-4688-b377-dcef9ad68e6b service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] No waiting events found dispatching network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:17:43 user nova-compute[73917]: WARNING nova.compute.manager [req-5a2b58a9-b97d-4a59-829b-e61d846a98a5 req-7d477e50-4975-4688-b377-dcef9ad68e6b service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received unexpected event network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba for instance with vm_state active and task_state rescuing.
Aug 26 19:17:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "75aea062-6df8-44a1-9c20-2bdd606748ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:17:45 user nova-compute[73917]: DEBUG nova.compute.manager [req-8cc10e3d-369d-4ecc-a5fc-7a72f084d779 req-19bc57c2-27c1-4902-be38-ae75426a0f76 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received event network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:17:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8cc10e3d-369d-4ecc-a5fc-7a72f084d779 req-19bc57c2-27c1-4902-be38-ae75426a0f76 service nova] Acquiring lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8cc10e3d-369d-4ecc-a5fc-7a72f084d779 req-19bc57c2-27c1-4902-be38-ae75426a0f76 service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8cc10e3d-369d-4ecc-a5fc-7a72f084d779 req-19bc57c2-27c1-4902-be38-ae75426a0f76 service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:45 user nova-compute[73917]: DEBUG nova.compute.manager [req-8cc10e3d-369d-4ecc-a5fc-7a72f084d779 req-19bc57c2-27c1-4902-be38-ae75426a0f76 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] No waiting events found dispatching network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:17:45 user nova-compute[73917]: WARNING nova.compute.manager [req-8cc10e3d-369d-4ecc-a5fc-7a72f084d779 req-19bc57c2-27c1-4902-be38-ae75426a0f76 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received unexpected event network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba for instance with vm_state active and task_state rescuing.
Aug 26 19:17:45 user nova-compute[73917]: DEBUG nova.compute.manager [req-8cc10e3d-369d-4ecc-a5fc-7a72f084d779 req-19bc57c2-27c1-4902-be38-ae75426a0f76 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received event network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:17:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8cc10e3d-369d-4ecc-a5fc-7a72f084d779 req-19bc57c2-27c1-4902-be38-ae75426a0f76 service nova] Acquiring lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8cc10e3d-369d-4ecc-a5fc-7a72f084d779 req-19bc57c2-27c1-4902-be38-ae75426a0f76 service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8cc10e3d-369d-4ecc-a5fc-7a72f084d779 req-19bc57c2-27c1-4902-be38-ae75426a0f76 service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:45 user nova-compute[73917]: DEBUG nova.compute.manager [req-8cc10e3d-369d-4ecc-a5fc-7a72f084d779 req-19bc57c2-27c1-4902-be38-ae75426a0f76 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] No waiting events found dispatching network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:17:45 user nova-compute[73917]: WARNING nova.compute.manager [req-8cc10e3d-369d-4ecc-a5fc-7a72f084d779 req-19bc57c2-27c1-4902-be38-ae75426a0f76 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received unexpected event network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba for instance with vm_state active and task_state rescuing.
Aug 26 19:17:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:45 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:17:45 user nova-compute[73917]: INFO nova.compute.claims [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Claim successful on node user
Aug 26 19:17:45 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:17:45 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:17:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:17:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:17:45 user nova-compute[73917]: DEBUG nova.network.neutron [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:17:45 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:17:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG nova.policy [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a47b6f8fcb8f49dfa2383dfbf37d6c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdcca8609e849618526a8b78385f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:17:46 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Creating image(s)
Aug 26 19:17:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "/opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "/opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "/opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.211s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.190s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk 1073741824" returned: 0 in 0.059s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Removed pending event for f4e84db3-1f3b-471f-9f82-5a692fdb6c06 due to event {{(pid=73917) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077466.6785553, f4e84db3-1f3b-471f-9f82-5a692fdb6c06 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:17:46 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] VM Resumed (Lifecycle Event)
Aug 26 19:17:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-abaf34d8-236a-469e-aeca-ee572b9790f2 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:17:46 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 19:17:46 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077466.6919527, f4e84db3-1f3b-471f-9f82-5a692fdb6c06 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:17:46 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] VM Started (Lifecycle Event)
Aug 26 19:17:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.202s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG nova.network.neutron [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Successfully created port: 79cb97b7-c220-40a7-aece-1ccacda973b6 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:17:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:17:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:47 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Cannot resize image /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:17:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:17:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Ensure instance console log exists: /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:17:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:47 user nova-compute[73917]: DEBUG nova.network.neutron [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Successfully updated port: 79cb97b7-c220-40a7-aece-1ccacda973b6 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:17:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "refresh_cache-75aea062-6df8-44a1-9c20-2bdd606748ab" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:17:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquired lock "refresh_cache-75aea062-6df8-44a1-9c20-2bdd606748ab" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:17:47 user nova-compute[73917]: DEBUG nova.network.neutron [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:17:47 user nova-compute[73917]: DEBUG nova.compute.manager [req-741b44f2-b5e3-40b3-aa5b-cef7395bc9dc req-98fcb873-0292-404e-99d2-eb860af9a4b8 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Received event network-changed-79cb97b7-c220-40a7-aece-1ccacda973b6 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:17:47 user nova-compute[73917]: DEBUG nova.compute.manager [req-741b44f2-b5e3-40b3-aa5b-cef7395bc9dc req-98fcb873-0292-404e-99d2-eb860af9a4b8 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Refreshing instance network info cache due to event network-changed-79cb97b7-c220-40a7-aece-1ccacda973b6. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:17:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-741b44f2-b5e3-40b3-aa5b-cef7395bc9dc req-98fcb873-0292-404e-99d2-eb860af9a4b8 service nova] Acquiring lock "refresh_cache-75aea062-6df8-44a1-9c20-2bdd606748ab" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:17:47 user nova-compute[73917]: DEBUG nova.network.neutron [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.network.neutron [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Updating instance_info_cache with network_info: [{"id": "79cb97b7-c220-40a7-aece-1ccacda973b6", "address": "fa:16:3e:40:11:d1", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb97b7-c2", "ovs_interfaceid": "79cb97b7-c220-40a7-aece-1ccacda973b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Releasing lock "refresh_cache-75aea062-6df8-44a1-9c20-2bdd606748ab" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Instance network_info: |[{"id": "79cb97b7-c220-40a7-aece-1ccacda973b6", "address": "fa:16:3e:40:11:d1", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb97b7-c2", "ovs_interfaceid": "79cb97b7-c220-40a7-aece-1ccacda973b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-741b44f2-b5e3-40b3-aa5b-cef7395bc9dc req-98fcb873-0292-404e-99d2-eb860af9a4b8 service nova] Acquired lock "refresh_cache-75aea062-6df8-44a1-9c20-2bdd606748ab" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.network.neutron [req-741b44f2-b5e3-40b3-aa5b-cef7395bc9dc req-98fcb873-0292-404e-99d2-eb860af9a4b8 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Refreshing network info cache for port 79cb97b7-c220-40a7-aece-1ccacda973b6 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Start _get_guest_xml network_info=[{"id": "79cb97b7-c220-40a7-aece-1ccacda973b6", "address": "fa:16:3e:40:11:d1", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb97b7-c2", "ovs_interfaceid": "79cb97b7-c220-40a7-aece-1ccacda973b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:17:48 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:17:48 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:17:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1912505000',display_name='tempest-AttachVolumeTestJSON-server-1912505000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1912505000',id=27,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChmjquE1k/m4DA2iLFbluvWgO30CBeq1tZgfmsuCu/247vVEaurDg4+OPbo4e/cSuJhGG3d+60MVq/2MoW4YTlB0xeazpe+c4duElh//3sZ9Ss8P60DfkAtF/u8OXE1NQ==',key_name='tempest-keypair-1004094651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abdcca8609e849618526a8b78385f77b',ramdisk_id='',reservation_id='r-cxjtcpn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1084822713',owner_user_name='tempest-AttachVolumeTestJSON-1084822713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:17:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47b6f8fcb8f49dfa2383dfbf37d6c30',uuid=75aea062-6df8-44a1-9c20-2bdd606748ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79cb97b7-c220-40a7-aece-1ccacda973b6", "address": "fa:16:3e:40:11:d1", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb97b7-c2", "ovs_interfaceid": "79cb97b7-c220-40a7-aece-1ccacda973b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converting VIF {"id": "79cb97b7-c220-40a7-aece-1ccacda973b6", "address": "fa:16:3e:40:11:d1", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb97b7-c2", "ovs_interfaceid": "79cb97b7-c220-40a7-aece-1ccacda973b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:11:d1,bridge_name='br-int',has_traffic_filtering=True,id=79cb97b7-c220-40a7-aece-1ccacda973b6,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79cb97b7-c2') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.objects.instance [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'pci_devices' on Instance uuid 75aea062-6df8-44a1-9c20-2bdd606748ab {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:17:48 user nova-compute[73917]:   <uuid>75aea062-6df8-44a1-9c20-2bdd606748ab</uuid>
Aug 26 19:17:48 user nova-compute[73917]:   <name>instance-0000001b</name>
Aug 26 19:17:48 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:17:48 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:17:48 user nova-compute[73917]:   <metadata>
Aug 26 19:17:48 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:17:48 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:17:48 user nova-compute[73917]:       <nova:name>tempest-AttachVolumeTestJSON-server-1912505000</nova:name>
Aug 26 19:17:48 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:17:48</nova:creationTime>
Aug 26 19:17:48 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:17:48 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:17:48 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:17:48 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:17:48 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:17:48 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:17:48 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:17:48 user nova-compute[73917]:       <nova:owner>
Aug 26 19:17:48 user nova-compute[73917]:         <nova:user uuid="a47b6f8fcb8f49dfa2383dfbf37d6c30">tempest-AttachVolumeTestJSON-1084822713-project-member</nova:user>
Aug 26 19:17:48 user nova-compute[73917]:         <nova:project uuid="abdcca8609e849618526a8b78385f77b">tempest-AttachVolumeTestJSON-1084822713</nova:project>
Aug 26 19:17:48 user nova-compute[73917]:       </nova:owner>
Aug 26 19:17:48 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:17:48 user nova-compute[73917]:       <nova:ports>
Aug 26 19:17:48 user nova-compute[73917]:         <nova:port uuid="79cb97b7-c220-40a7-aece-1ccacda973b6">
Aug 26 19:17:48 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 19:17:48 user nova-compute[73917]:         </nova:port>
Aug 26 19:17:48 user nova-compute[73917]:       </nova:ports>
Aug 26 19:17:48 user nova-compute[73917]:     </nova:instance>
Aug 26 19:17:48 user nova-compute[73917]:   </metadata>
Aug 26 19:17:48 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:17:48 user nova-compute[73917]:     <system>
Aug 26 19:17:48 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:17:48 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:17:48 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:17:48 user nova-compute[73917]:       <entry name="serial">75aea062-6df8-44a1-9c20-2bdd606748ab</entry>
Aug 26 19:17:48 user nova-compute[73917]:       <entry name="uuid">75aea062-6df8-44a1-9c20-2bdd606748ab</entry>
Aug 26 19:17:48 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:17:48 user nova-compute[73917]:     </system>
Aug 26 19:17:48 user nova-compute[73917]:   </sysinfo>
Aug 26 19:17:48 user nova-compute[73917]:   <os>
Aug 26 19:17:48 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:17:48 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:17:48 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:17:48 user nova-compute[73917]:   </os>
Aug 26 19:17:48 user nova-compute[73917]:   <features>
Aug 26 19:17:48 user nova-compute[73917]:     <acpi/>
Aug 26 19:17:48 user nova-compute[73917]:     <apic/>
Aug 26 19:17:48 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:17:48 user nova-compute[73917]:   </features>
Aug 26 19:17:48 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:17:48 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:17:48 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:17:48 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:17:48 user nova-compute[73917]:   </clock>
Aug 26 19:17:48 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:17:48 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:17:48 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:17:48 user nova-compute[73917]:   </cpu>
Aug 26 19:17:48 user nova-compute[73917]:   <devices>
Aug 26 19:17:48 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:17:48 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:17:48 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk"/>
Aug 26 19:17:48 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:17:48 user nova-compute[73917]:     </disk>
Aug 26 19:17:48 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:17:48 user nova-compute[73917]:       <mac address="fa:16:3e:40:11:d1"/>
Aug 26 19:17:48 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:17:48 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:17:48 user nova-compute[73917]:       <target dev="tap79cb97b7-c2"/>
Aug 26 19:17:48 user nova-compute[73917]:     </interface>
Aug 26 19:17:48 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:17:48 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/console.log" append="off"/>
Aug 26 19:17:48 user nova-compute[73917]:     </serial>
Aug 26 19:17:48 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:17:48 user nova-compute[73917]:     <video>
Aug 26 19:17:48 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:17:48 user nova-compute[73917]:     </video>
Aug 26 19:17:48 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:17:48 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:17:48 user nova-compute[73917]:     </rng>
Aug 26 19:17:48 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:17:48 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:17:48 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:17:48 user nova-compute[73917]:     </memballoon>
Aug 26 19:17:48 user nova-compute[73917]:   </devices>
Aug 26 19:17:48 user nova-compute[73917]: </domain>
Aug 26 19:17:48 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:17:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1912505000',display_name='tempest-AttachVolumeTestJSON-server-1912505000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1912505000',id=27,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChmjquE1k/m4DA2iLFbluvWgO30CBeq1tZgfmsuCu/247vVEaurDg4+OPbo4e/cSuJhGG3d+60MVq/2MoW4YTlB0xeazpe+c4duElh//3sZ9Ss8P60DfkAtF/u8OXE1NQ==',key_name='tempest-keypair-1004094651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abdcca8609e849618526a8b78385f77b',ramdisk_id='',reservation_id='r-cxjtcpn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1084822713',owner_user_name='tempest-AttachVolumeTestJSON-1084822713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:17:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47b6f8fcb8f49dfa2383dfbf37d6c30',uuid=75aea062-6df8-44a1-9c20-2bdd606748ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79cb97b7-c220-40a7-aece-1ccacda973b6", "address": "fa:16:3e:40:11:d1", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb97b7-c2", "ovs_interfaceid": "79cb97b7-c220-40a7-aece-1ccacda973b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converting VIF {"id": "79cb97b7-c220-40a7-aece-1ccacda973b6", "address": "fa:16:3e:40:11:d1", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb97b7-c2", "ovs_interfaceid": "79cb97b7-c220-40a7-aece-1ccacda973b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:11:d1,bridge_name='br-int',has_traffic_filtering=True,id=79cb97b7-c220-40a7-aece-1ccacda973b6,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79cb97b7-c2') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG os_vif [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:11:d1,bridge_name='br-int',has_traffic_filtering=True,id=79cb97b7-c220-40a7-aece-1ccacda973b6,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79cb97b7-c2') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79cb97b7-c2, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap79cb97b7-c2, col_values=(('external_ids', {'iface-id': '79cb97b7-c220-40a7-aece-1ccacda973b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:11:d1', 'vm-uuid': '75aea062-6df8-44a1-9c20-2bdd606748ab'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:48 user nova-compute[73917]: INFO os_vif [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:11:d1,bridge_name='br-int',has_traffic_filtering=True,id=79cb97b7-c220-40a7-aece-1ccacda973b6,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79cb97b7-c2')
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] No VIF found with MAC fa:16:3e:40:11:d1, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.network.neutron [req-741b44f2-b5e3-40b3-aa5b-cef7395bc9dc req-98fcb873-0292-404e-99d2-eb860af9a4b8 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Updated VIF entry in instance network info cache for port 79cb97b7-c220-40a7-aece-1ccacda973b6. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG nova.network.neutron [req-741b44f2-b5e3-40b3-aa5b-cef7395bc9dc req-98fcb873-0292-404e-99d2-eb860af9a4b8 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Updating instance_info_cache with network_info: [{"id": "79cb97b7-c220-40a7-aece-1ccacda973b6", "address": "fa:16:3e:40:11:d1", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb97b7-c2", "ovs_interfaceid": "79cb97b7-c220-40a7-aece-1ccacda973b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:17:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-741b44f2-b5e3-40b3-aa5b-cef7395bc9dc req-98fcb873-0292-404e-99d2-eb860af9a4b8 service nova] Releasing lock "refresh_cache-75aea062-6df8-44a1-9c20-2bdd606748ab" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:17:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:50 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:17:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 19:17:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] There are 0 instances to clean {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 19:17:50 user nova-compute[73917]: DEBUG nova.compute.manager [req-85c85858-dcdd-4dd1-9549-74bf9e1c3728 req-8d783f89-76ac-43f5-baa2-f3d535e07e25 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Received event network-vif-plugged-79cb97b7-c220-40a7-aece-1ccacda973b6 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:17:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-85c85858-dcdd-4dd1-9549-74bf9e1c3728 req-8d783f89-76ac-43f5-baa2-f3d535e07e25 service nova] Acquiring lock "75aea062-6df8-44a1-9c20-2bdd606748ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-85c85858-dcdd-4dd1-9549-74bf9e1c3728 req-8d783f89-76ac-43f5-baa2-f3d535e07e25 service nova] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-85c85858-dcdd-4dd1-9549-74bf9e1c3728 req-8d783f89-76ac-43f5-baa2-f3d535e07e25 service nova] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:50 user nova-compute[73917]: DEBUG nova.compute.manager [req-85c85858-dcdd-4dd1-9549-74bf9e1c3728 req-8d783f89-76ac-43f5-baa2-f3d535e07e25 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] No waiting events found dispatching network-vif-plugged-79cb97b7-c220-40a7-aece-1ccacda973b6 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:17:50 user nova-compute[73917]: WARNING nova.compute.manager [req-85c85858-dcdd-4dd1-9549-74bf9e1c3728 req-8d783f89-76ac-43f5-baa2-f3d535e07e25 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Received unexpected event network-vif-plugged-79cb97b7-c220-40a7-aece-1ccacda973b6 for instance with vm_state building and task_state spawning.
Aug 26 19:17:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:17:52 user nova-compute[73917]: INFO nova.compute.claims [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Claim successful on node user
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077472.4998865, 75aea062-6df8-44a1-9c20-2bdd606748ab => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:17:52 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] VM Resumed (Lifecycle Event)
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.compute.manager [req-dfbc54df-84f7-4b31-b2fb-acd9fcc2d3fc req-83d1e284-fd97-4576-9c1c-6d30a629d1a6 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Received event network-vif-plugged-79cb97b7-c220-40a7-aece-1ccacda973b6 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-dfbc54df-84f7-4b31-b2fb-acd9fcc2d3fc req-83d1e284-fd97-4576-9c1c-6d30a629d1a6 service nova] Acquiring lock "75aea062-6df8-44a1-9c20-2bdd606748ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-dfbc54df-84f7-4b31-b2fb-acd9fcc2d3fc req-83d1e284-fd97-4576-9c1c-6d30a629d1a6 service nova] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-dfbc54df-84f7-4b31-b2fb-acd9fcc2d3fc req-83d1e284-fd97-4576-9c1c-6d30a629d1a6 service nova] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.compute.manager [req-dfbc54df-84f7-4b31-b2fb-acd9fcc2d3fc req-83d1e284-fd97-4576-9c1c-6d30a629d1a6 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] No waiting events found dispatching network-vif-plugged-79cb97b7-c220-40a7-aece-1ccacda973b6 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:17:52 user nova-compute[73917]: WARNING nova.compute.manager [req-dfbc54df-84f7-4b31-b2fb-acd9fcc2d3fc req-83d1e284-fd97-4576-9c1c-6d30a629d1a6 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Received unexpected event network-vif-plugged-79cb97b7-c220-40a7-aece-1ccacda973b6 for instance with vm_state building and task_state spawning.
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:17:52 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Instance spawned successfully.
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:17:52 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077472.5022788, 75aea062-6df8-44a1-9c20-2bdd606748ab => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:17:52 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] VM Started (Lifecycle Event)
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:17:52 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:17:52 user nova-compute[73917]: INFO nova.compute.manager [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Took 6.59 seconds to spawn the instance on the hypervisor.
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:17:52 user nova-compute[73917]: INFO nova.compute.manager [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Took 7.60 seconds to build instance.
Aug 26 19:17:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f46b4c4-0e86-4579-879c-9b170f519978 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.705s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.692s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG nova.network.neutron [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:17:53 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:17:53 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG nova.policy [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c64a5d226b8b4d60af840d49315bf60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b291bbf9aedc4414a1ab402602849140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:17:53 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Creating image(s)
Aug 26 19:17:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "/opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "/opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "/opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.207s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.210s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk 1073741824" returned: 0 in 0.051s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.230s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:53 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:17:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:54 user nova-compute[73917]: DEBUG nova.network.neutron [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Successfully created port: 3e638e90-1dab-4162-ab6b-6e537238b027 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:17:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:17:54 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Cannot resize image /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:17:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:17:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Ensure instance console log exists: /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:17:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.network.neutron [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Successfully updated port: 3e638e90-1dab-4162-ab6b-6e537238b027 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "refresh_cache-dde8f1cd-d55b-49cf-a775-196cbc059fa9" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquired lock "refresh_cache-dde8f1cd-d55b-49cf-a775-196cbc059fa9" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.network.neutron [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.compute.manager [req-1c4cd075-cb1d-4946-91e0-5177f1084a80 req-470ef73e-6fae-46a9-871b-c5747664f6de service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Received event network-changed-3e638e90-1dab-4162-ab6b-6e537238b027 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.compute.manager [req-1c4cd075-cb1d-4946-91e0-5177f1084a80 req-470ef73e-6fae-46a9-871b-c5747664f6de service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Refreshing instance network info cache due to event network-changed-3e638e90-1dab-4162-ab6b-6e537238b027. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1c4cd075-cb1d-4946-91e0-5177f1084a80 req-470ef73e-6fae-46a9-871b-c5747664f6de service nova] Acquiring lock "refresh_cache-dde8f1cd-d55b-49cf-a775-196cbc059fa9" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.network.neutron [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.network.neutron [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Updating instance_info_cache with network_info: [{"id": "3e638e90-1dab-4162-ab6b-6e537238b027", "address": "fa:16:3e:ec:3c:4a", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e638e90-1d", "ovs_interfaceid": "3e638e90-1dab-4162-ab6b-6e537238b027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Releasing lock "refresh_cache-dde8f1cd-d55b-49cf-a775-196cbc059fa9" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Instance network_info: |[{"id": "3e638e90-1dab-4162-ab6b-6e537238b027", "address": "fa:16:3e:ec:3c:4a", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e638e90-1d", "ovs_interfaceid": "3e638e90-1dab-4162-ab6b-6e537238b027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1c4cd075-cb1d-4946-91e0-5177f1084a80 req-470ef73e-6fae-46a9-871b-c5747664f6de service nova] Acquired lock "refresh_cache-dde8f1cd-d55b-49cf-a775-196cbc059fa9" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.network.neutron [req-1c4cd075-cb1d-4946-91e0-5177f1084a80 req-470ef73e-6fae-46a9-871b-c5747664f6de service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Refreshing network info cache for port 3e638e90-1dab-4162-ab6b-6e537238b027 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Start _get_guest_xml network_info=[{"id": "3e638e90-1dab-4162-ab6b-6e537238b027", "address": "fa:16:3e:ec:3c:4a", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e638e90-1d", "ovs_interfaceid": "3e638e90-1dab-4162-ab6b-6e537238b027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:17:55 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:17:55 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:17:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1904116845',display_name='tempest-AttachVolumeNegativeTest-server-1904116845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1904116845',id=28,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzOVRPJBUo95UBWHjdF4vaeBFe61lGJslNuuDQj5HvwE6SRn2BOdkCmBj62LYnlSoeMf93LDTQGKFQeaieiVgkMVqAwX5/sCTs1aRR5xmgQ761FER2V9IdWx5r97RE5Yw==',key_name='tempest-keypair-1218103215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b291bbf9aedc4414a1ab402602849140',ramdisk_id='',reservation_id='r-jt04o40h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2066333616',owner_user_name='tempest-AttachVolumeNegativeTest-2066333616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:17:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c64a5d226b8b4d60af840d49315bf60f',uuid=dde8f1cd-d55b-49cf-a775-196cbc059fa9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e638e90-1dab-4162-ab6b-6e537238b027", "address": "fa:16:3e:ec:3c:4a", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e638e90-1d", "ovs_interfaceid": "3e638e90-1dab-4162-ab6b-6e537238b027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converting VIF {"id": "3e638e90-1dab-4162-ab6b-6e537238b027", "address": "fa:16:3e:ec:3c:4a", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e638e90-1d", "ovs_interfaceid": "3e638e90-1dab-4162-ab6b-6e537238b027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:3c:4a,bridge_name='br-int',has_traffic_filtering=True,id=3e638e90-1dab-4162-ab6b-6e537238b027,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e638e90-1d') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.objects.instance [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lazy-loading 'pci_devices' on Instance uuid dde8f1cd-d55b-49cf-a775-196cbc059fa9 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:17:55 user nova-compute[73917]:   <uuid>dde8f1cd-d55b-49cf-a775-196cbc059fa9</uuid>
Aug 26 19:17:55 user nova-compute[73917]:   <name>instance-0000001c</name>
Aug 26 19:17:55 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:17:55 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:17:55 user nova-compute[73917]:   <metadata>
Aug 26 19:17:55 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:17:55 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:17:55 user nova-compute[73917]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1904116845</nova:name>
Aug 26 19:17:55 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:17:55</nova:creationTime>
Aug 26 19:17:55 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:17:55 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:17:55 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:17:55 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:17:55 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:17:55 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:17:55 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:17:55 user nova-compute[73917]:       <nova:owner>
Aug 26 19:17:55 user nova-compute[73917]:         <nova:user uuid="c64a5d226b8b4d60af840d49315bf60f">tempest-AttachVolumeNegativeTest-2066333616-project-member</nova:user>
Aug 26 19:17:55 user nova-compute[73917]:         <nova:project uuid="b291bbf9aedc4414a1ab402602849140">tempest-AttachVolumeNegativeTest-2066333616</nova:project>
Aug 26 19:17:55 user nova-compute[73917]:       </nova:owner>
Aug 26 19:17:55 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:17:55 user nova-compute[73917]:       <nova:ports>
Aug 26 19:17:55 user nova-compute[73917]:         <nova:port uuid="3e638e90-1dab-4162-ab6b-6e537238b027">
Aug 26 19:17:55 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 19:17:55 user nova-compute[73917]:         </nova:port>
Aug 26 19:17:55 user nova-compute[73917]:       </nova:ports>
Aug 26 19:17:55 user nova-compute[73917]:     </nova:instance>
Aug 26 19:17:55 user nova-compute[73917]:   </metadata>
Aug 26 19:17:55 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:17:55 user nova-compute[73917]:     <system>
Aug 26 19:17:55 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:17:55 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:17:55 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:17:55 user nova-compute[73917]:       <entry name="serial">dde8f1cd-d55b-49cf-a775-196cbc059fa9</entry>
Aug 26 19:17:55 user nova-compute[73917]:       <entry name="uuid">dde8f1cd-d55b-49cf-a775-196cbc059fa9</entry>
Aug 26 19:17:55 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:17:55 user nova-compute[73917]:     </system>
Aug 26 19:17:55 user nova-compute[73917]:   </sysinfo>
Aug 26 19:17:55 user nova-compute[73917]:   <os>
Aug 26 19:17:55 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:17:55 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:17:55 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:17:55 user nova-compute[73917]:   </os>
Aug 26 19:17:55 user nova-compute[73917]:   <features>
Aug 26 19:17:55 user nova-compute[73917]:     <acpi/>
Aug 26 19:17:55 user nova-compute[73917]:     <apic/>
Aug 26 19:17:55 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:17:55 user nova-compute[73917]:   </features>
Aug 26 19:17:55 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:17:55 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:17:55 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:17:55 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:17:55 user nova-compute[73917]:   </clock>
Aug 26 19:17:55 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:17:55 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:17:55 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:17:55 user nova-compute[73917]:   </cpu>
Aug 26 19:17:55 user nova-compute[73917]:   <devices>
Aug 26 19:17:55 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:17:55 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:17:55 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk"/>
Aug 26 19:17:55 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:17:55 user nova-compute[73917]:     </disk>
Aug 26 19:17:55 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:17:55 user nova-compute[73917]:       <mac address="fa:16:3e:ec:3c:4a"/>
Aug 26 19:17:55 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:17:55 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:17:55 user nova-compute[73917]:       <target dev="tap3e638e90-1d"/>
Aug 26 19:17:55 user nova-compute[73917]:     </interface>
Aug 26 19:17:55 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:17:55 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/console.log" append="off"/>
Aug 26 19:17:55 user nova-compute[73917]:     </serial>
Aug 26 19:17:55 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:17:55 user nova-compute[73917]:     <video>
Aug 26 19:17:55 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:17:55 user nova-compute[73917]:     </video>
Aug 26 19:17:55 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:17:55 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:17:55 user nova-compute[73917]:     </rng>
Aug 26 19:17:55 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:17:55 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:17:55 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:17:55 user nova-compute[73917]:     </memballoon>
Aug 26 19:17:55 user nova-compute[73917]:   </devices>
Aug 26 19:17:55 user nova-compute[73917]: </domain>
Aug 26 19:17:55 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:17:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1904116845',display_name='tempest-AttachVolumeNegativeTest-server-1904116845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1904116845',id=28,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzOVRPJBUo95UBWHjdF4vaeBFe61lGJslNuuDQj5HvwE6SRn2BOdkCmBj62LYnlSoeMf93LDTQGKFQeaieiVgkMVqAwX5/sCTs1aRR5xmgQ761FER2V9IdWx5r97RE5Yw==',key_name='tempest-keypair-1218103215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b291bbf9aedc4414a1ab402602849140',ramdisk_id='',reservation_id='r-jt04o40h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2066333616',owner_user_name='tempest-AttachVolumeNegativeTest-2066333616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:17:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c64a5d226b8b4d60af840d49315bf60f',uuid=dde8f1cd-d55b-49cf-a775-196cbc059fa9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e638e90-1dab-4162-ab6b-6e537238b027", "address": "fa:16:3e:ec:3c:4a", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e638e90-1d", "ovs_interfaceid": "3e638e90-1dab-4162-ab6b-6e537238b027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converting VIF {"id": "3e638e90-1dab-4162-ab6b-6e537238b027", "address": "fa:16:3e:ec:3c:4a", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e638e90-1d", "ovs_interfaceid": "3e638e90-1dab-4162-ab6b-6e537238b027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:3c:4a,bridge_name='br-int',has_traffic_filtering=True,id=3e638e90-1dab-4162-ab6b-6e537238b027,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e638e90-1d') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG os_vif [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:3c:4a,bridge_name='br-int',has_traffic_filtering=True,id=3e638e90-1dab-4162-ab6b-6e537238b027,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e638e90-1d') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e638e90-1d, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e638e90-1d, col_values=(('external_ids', {'iface-id': '3e638e90-1dab-4162-ab6b-6e537238b027', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:3c:4a', 'vm-uuid': 'dde8f1cd-d55b-49cf-a775-196cbc059fa9'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:55 user nova-compute[73917]: INFO os_vif [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:3c:4a,bridge_name='br-int',has_traffic_filtering=True,id=3e638e90-1dab-4162-ab6b-6e537238b027,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e638e90-1d')
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:17:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] No VIF found with MAC fa:16:3e:ec:3c:4a, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:17:56 user nova-compute[73917]: DEBUG nova.network.neutron [req-1c4cd075-cb1d-4946-91e0-5177f1084a80 req-470ef73e-6fae-46a9-871b-c5747664f6de service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Updated VIF entry in instance network info cache for port 3e638e90-1dab-4162-ab6b-6e537238b027. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:17:56 user nova-compute[73917]: DEBUG nova.network.neutron [req-1c4cd075-cb1d-4946-91e0-5177f1084a80 req-470ef73e-6fae-46a9-871b-c5747664f6de service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Updating instance_info_cache with network_info: [{"id": "3e638e90-1dab-4162-ab6b-6e537238b027", "address": "fa:16:3e:ec:3c:4a", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e638e90-1d", "ovs_interfaceid": "3e638e90-1dab-4162-ab6b-6e537238b027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:17:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1c4cd075-cb1d-4946-91e0-5177f1084a80 req-470ef73e-6fae-46a9-871b-c5747664f6de service nova] Releasing lock "refresh_cache-dde8f1cd-d55b-49cf-a775-196cbc059fa9" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:17:56 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:17:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:17:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:17:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:17:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:17:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:57 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:17:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:58 user nova-compute[73917]: DEBUG nova.compute.manager [req-9d87901e-6606-486c-8e7d-76dd42ef5f0d req-1c6ce560-63b4-4a6d-bb42-07de37b42812 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Received event network-vif-plugged-3e638e90-1dab-4162-ab6b-6e537238b027 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:17:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9d87901e-6606-486c-8e7d-76dd42ef5f0d req-1c6ce560-63b4-4a6d-bb42-07de37b42812 service nova] Acquiring lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:17:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9d87901e-6606-486c-8e7d-76dd42ef5f0d req-1c6ce560-63b4-4a6d-bb42-07de37b42812 service nova] Lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:17:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9d87901e-6606-486c-8e7d-76dd42ef5f0d req-1c6ce560-63b4-4a6d-bb42-07de37b42812 service nova] Lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:17:58 user nova-compute[73917]: DEBUG nova.compute.manager [req-9d87901e-6606-486c-8e7d-76dd42ef5f0d req-1c6ce560-63b4-4a6d-bb42-07de37b42812 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] No waiting events found dispatching network-vif-plugged-3e638e90-1dab-4162-ab6b-6e537238b027 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:17:58 user nova-compute[73917]: WARNING nova.compute.manager [req-9d87901e-6606-486c-8e7d-76dd42ef5f0d req-1c6ce560-63b4-4a6d-bb42-07de37b42812 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Received unexpected event network-vif-plugged-3e638e90-1dab-4162-ab6b-6e537238b027 for instance with vm_state building and task_state spawning.
Aug 26 19:17:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:17:59 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077479.6686282, dde8f1cd-d55b-49cf-a775-196cbc059fa9 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:17:59 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] VM Resumed (Lifecycle Event)
Aug 26 19:17:59 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:17:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:17:59 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Instance spawned successfully.
Aug 26 19:17:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:17:59 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:17:59 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:17:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:17:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:17:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:17:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:17:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:17:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:17:59 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:17:59 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077479.6698263, dde8f1cd-d55b-49cf-a775-196cbc059fa9 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:17:59 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] VM Started (Lifecycle Event)
Aug 26 19:17:59 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:17:59 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:17:59 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:17:59 user nova-compute[73917]: INFO nova.compute.manager [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Took 6.58 seconds to spawn the instance on the hypervisor.
Aug 26 19:17:59 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:17:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:17:59 user nova-compute[73917]: INFO nova.compute.manager [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Took 7.85 seconds to build instance.
Aug 26 19:18:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5805419c-7bc4-4be8-aaae-2c7a63457a70 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.017s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:00 user nova-compute[73917]: DEBUG nova.compute.manager [req-72642ed5-5967-4c8c-9f0a-03734fb40576 req-f965ea41-d4cf-44e3-bd3d-e59a4e4966d3 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Received event network-vif-plugged-3e638e90-1dab-4162-ab6b-6e537238b027 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:18:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-72642ed5-5967-4c8c-9f0a-03734fb40576 req-f965ea41-d4cf-44e3-bd3d-e59a4e4966d3 service nova] Acquiring lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-72642ed5-5967-4c8c-9f0a-03734fb40576 req-f965ea41-d4cf-44e3-bd3d-e59a4e4966d3 service nova] Lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-72642ed5-5967-4c8c-9f0a-03734fb40576 req-f965ea41-d4cf-44e3-bd3d-e59a4e4966d3 service nova] Lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:00 user nova-compute[73917]: DEBUG nova.compute.manager [req-72642ed5-5967-4c8c-9f0a-03734fb40576 req-f965ea41-d4cf-44e3-bd3d-e59a4e4966d3 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] No waiting events found dispatching network-vif-plugged-3e638e90-1dab-4162-ab6b-6e537238b027 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:18:00 user nova-compute[73917]: WARNING nova.compute.manager [req-72642ed5-5967-4c8c-9f0a-03734fb40576 req-f965ea41-d4cf-44e3-bd3d-e59a4e4966d3 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Received unexpected event network-vif-plugged-3e638e90-1dab-4162-ab6b-6e537238b027 for instance with vm_state active and task_state None.
Aug 26 19:18:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:18:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df5c717a-62d8-444d-9968-ad682a31733c/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df5c717a-62d8-444d-9968-ad682a31733c/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df5c717a-62d8-444d-9968-ad682a31733c/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df5c717a-62d8-444d-9968-ad682a31733c/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:18:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.247s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:18:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:07 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:18:07 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=6855MB free_disk=25.238357543945312GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Applying migration context for instance dca28d65-37d0-4b60-b8aa-dcca61b6a187 as it has an incoming, in-progress migration 353ee397-ba9d-49a3-b4e1-13dc2a981649. Migration status is finished {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 19:18:07 user nova-compute[73917]: INFO nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Updating resource usage from migration 353ee397-ba9d-49a3-b4e1-13dc2a981649
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance cc0ae046-2a39-4ab6-9327-2d9452c3035d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fd801f18-34b6-4682-8d43-edf82bd216c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 481cc682-2004-434d-b4eb-1688b0b07dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 94f8d4e7-f310-45df-a0ae-82e608ac0119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance df5c717a-62d8-444d-9968-ad682a31733c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f4e84db3-1f3b-471f-9f82-5a692fdb6c06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance e2b9dc2e-7b89-4b47-bacc-2b562649db8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance d61ab2cf-7bfb-4d39-8f6b-db688872c437 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Migration 353ee397-ba9d-49a3-b4e1-13dc2a981649 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance dca28d65-37d0-4b60-b8aa-dcca61b6a187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 75aea062-6df8-44a1-9c20-2bdd606748ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance dde8f1cd-d55b-49cf-a775-196cbc059fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing inventories for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating ProviderTree inventory for provider d90ad23a-e063-4f0d-8341-c34e0141d16a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating inventory in ProviderTree for provider d90ad23a-e063-4f0d-8341-c34e0141d16a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing aggregate associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, aggregates: None {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 19:18:07 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing trait associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 19:18:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:08 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:18:08 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:18:08 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:18:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.111s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:08 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:18:08 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73917) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 19:18:09 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:18:09 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:18:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:18:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-481cc682-2004-434d-b4eb-1688b0b07dd6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:18:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-481cc682-2004-434d-b4eb-1688b0b07dd6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:18:09 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:18:10 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Updating instance_info_cache with network_info: [{"id": "d85d1b22-c0c9-4405-a446-6c6480502b54", "address": "fa:16:3e:4a:44:56", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85d1b22-c0", "ovs_interfaceid": "d85d1b22-c0c9-4405-a446-6c6480502b54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:18:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-481cc682-2004-434d-b4eb-1688b0b07dd6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:18:10 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:18:10 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:18:10 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:18:10 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:18:10 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:18:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "c78c30ea-1190-44bc-bd78-b3655e251a35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:12 user nova-compute[73917]: DEBUG nova.compute.manager [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:18:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:13 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:18:13 user nova-compute[73917]: INFO nova.compute.claims [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Claim successful on node user
Aug 26 19:18:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:13 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:18:13 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:18:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.590s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:18:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:18:13 user nova-compute[73917]: DEBUG nova.network.neutron [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:18:13 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:18:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:18:13 user nova-compute[73917]: DEBUG nova.policy [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d72f2f6c9e04d938fc4272283d4e45a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e26e61119446978d7bef2800e511f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:18:14 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Creating image(s)
Aug 26 19:18:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "/opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "/opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "/opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.187s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk 1073741824" returned: 0 in 0.053s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG nova.network.neutron [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Successfully created port: d17ecc7e-21af-4f6a-a251-4a865473e86b {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.185s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Cannot resize image /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Ensure instance console log exists: /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.network.neutron [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Successfully updated port: d17ecc7e-21af-4f6a-a251-4a865473e86b {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "refresh_cache-c78c30ea-1190-44bc-bd78-b3655e251a35" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquired lock "refresh_cache-c78c30ea-1190-44bc-bd78-b3655e251a35" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.network.neutron [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-e536737e-3107-407c-ad83-9a69d074147b req-ed8d5e31-3513-4361-aa48-461f19335f52 service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Received event network-changed-d17ecc7e-21af-4f6a-a251-4a865473e86b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-e536737e-3107-407c-ad83-9a69d074147b req-ed8d5e31-3513-4361-aa48-461f19335f52 service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Refreshing instance network info cache due to event network-changed-d17ecc7e-21af-4f6a-a251-4a865473e86b. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e536737e-3107-407c-ad83-9a69d074147b req-ed8d5e31-3513-4361-aa48-461f19335f52 service nova] Acquiring lock "refresh_cache-c78c30ea-1190-44bc-bd78-b3655e251a35" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.network.neutron [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.network.neutron [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Updating instance_info_cache with network_info: [{"id": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "address": "fa:16:3e:97:c2:28", "network": {"id": "4e5dd15a-9c1d-489e-b732-db3ac6496ecf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885174960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e26e61119446978d7bef2800e511f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17ecc7e-21", "ovs_interfaceid": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Releasing lock "refresh_cache-c78c30ea-1190-44bc-bd78-b3655e251a35" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.compute.manager [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Instance network_info: |[{"id": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "address": "fa:16:3e:97:c2:28", "network": {"id": "4e5dd15a-9c1d-489e-b732-db3ac6496ecf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885174960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e26e61119446978d7bef2800e511f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17ecc7e-21", "ovs_interfaceid": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e536737e-3107-407c-ad83-9a69d074147b req-ed8d5e31-3513-4361-aa48-461f19335f52 service nova] Acquired lock "refresh_cache-c78c30ea-1190-44bc-bd78-b3655e251a35" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.network.neutron [req-e536737e-3107-407c-ad83-9a69d074147b req-ed8d5e31-3513-4361-aa48-461f19335f52 service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Refreshing network info cache for port d17ecc7e-21af-4f6a-a251-4a865473e86b {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Start _get_guest_xml network_info=[{"id": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "address": "fa:16:3e:97:c2:28", "network": {"id": "4e5dd15a-9c1d-489e-b732-db3ac6496ecf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885174960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e26e61119446978d7bef2800e511f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17ecc7e-21", "ovs_interfaceid": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:18:15 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:18:15 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:18:15 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-383778297',display_name='tempest-SnapshotDataIntegrityTests-server-383778297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-383778297',id=29,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuv1mU9NVoBpVxj5EiVjaYvC4NCO9YI10DSjepFVEIfQvlDcx/upl6wK2Fesp6NWlaDAAKyhvMqPoqyYfBDr3Q9il34yGb738txzIzIVrkKd4WemX+502JyqPZaqQ/yYQ==',key_name='tempest-keypair-798292815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29e26e61119446978d7bef2800e511f9',ramdisk_id='',reservation_id='r-gve30q4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1939202203',owner_user_name='tempest-SnapshotDataIntegrityTests-1939202203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:18:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d72f2f6c9e04d938fc4272283d4e45a',uuid=c78c30ea-1190-44bc-bd78-b3655e251a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "address": "fa:16:3e:97:c2:28", "network": {"id": "4e5dd15a-9c1d-489e-b732-db3ac6496ecf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885174960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e26e61119446978d7bef2800e511f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17ecc7e-21", "ovs_interfaceid": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Converting VIF {"id": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "address": "fa:16:3e:97:c2:28", "network": {"id": "4e5dd15a-9c1d-489e-b732-db3ac6496ecf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885174960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e26e61119446978d7bef2800e511f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17ecc7e-21", "ovs_interfaceid": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:c2:28,bridge_name='br-int',has_traffic_filtering=True,id=d17ecc7e-21af-4f6a-a251-4a865473e86b,network=Network(4e5dd15a-9c1d-489e-b732-db3ac6496ecf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd17ecc7e-21') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG nova.objects.instance [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lazy-loading 'pci_devices' on Instance uuid c78c30ea-1190-44bc-bd78-b3655e251a35 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:18:16 user nova-compute[73917]:   <uuid>c78c30ea-1190-44bc-bd78-b3655e251a35</uuid>
Aug 26 19:18:16 user nova-compute[73917]:   <name>instance-0000001d</name>
Aug 26 19:18:16 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:18:16 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:18:16 user nova-compute[73917]:   <metadata>
Aug 26 19:18:16 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:18:16 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:18:16 user nova-compute[73917]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-383778297</nova:name>
Aug 26 19:18:16 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:18:15</nova:creationTime>
Aug 26 19:18:16 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:18:16 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:18:16 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:18:16 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:18:16 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:18:16 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:18:16 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:18:16 user nova-compute[73917]:       <nova:owner>
Aug 26 19:18:16 user nova-compute[73917]:         <nova:user uuid="8d72f2f6c9e04d938fc4272283d4e45a">tempest-SnapshotDataIntegrityTests-1939202203-project-member</nova:user>
Aug 26 19:18:16 user nova-compute[73917]:         <nova:project uuid="29e26e61119446978d7bef2800e511f9">tempest-SnapshotDataIntegrityTests-1939202203</nova:project>
Aug 26 19:18:16 user nova-compute[73917]:       </nova:owner>
Aug 26 19:18:16 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:18:16 user nova-compute[73917]:       <nova:ports>
Aug 26 19:18:16 user nova-compute[73917]:         <nova:port uuid="d17ecc7e-21af-4f6a-a251-4a865473e86b">
Aug 26 19:18:16 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 19:18:16 user nova-compute[73917]:         </nova:port>
Aug 26 19:18:16 user nova-compute[73917]:       </nova:ports>
Aug 26 19:18:16 user nova-compute[73917]:     </nova:instance>
Aug 26 19:18:16 user nova-compute[73917]:   </metadata>
Aug 26 19:18:16 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:18:16 user nova-compute[73917]:     <system>
Aug 26 19:18:16 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:18:16 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:18:16 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:18:16 user nova-compute[73917]:       <entry name="serial">c78c30ea-1190-44bc-bd78-b3655e251a35</entry>
Aug 26 19:18:16 user nova-compute[73917]:       <entry name="uuid">c78c30ea-1190-44bc-bd78-b3655e251a35</entry>
Aug 26 19:18:16 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:18:16 user nova-compute[73917]:     </system>
Aug 26 19:18:16 user nova-compute[73917]:   </sysinfo>
Aug 26 19:18:16 user nova-compute[73917]:   <os>
Aug 26 19:18:16 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:18:16 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:18:16 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:18:16 user nova-compute[73917]:   </os>
Aug 26 19:18:16 user nova-compute[73917]:   <features>
Aug 26 19:18:16 user nova-compute[73917]:     <acpi/>
Aug 26 19:18:16 user nova-compute[73917]:     <apic/>
Aug 26 19:18:16 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:18:16 user nova-compute[73917]:   </features>
Aug 26 19:18:16 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:18:16 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:18:16 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:18:16 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:18:16 user nova-compute[73917]:   </clock>
Aug 26 19:18:16 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:18:16 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:18:16 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:18:16 user nova-compute[73917]:   </cpu>
Aug 26 19:18:16 user nova-compute[73917]:   <devices>
Aug 26 19:18:16 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:18:16 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:18:16 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk"/>
Aug 26 19:18:16 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:18:16 user nova-compute[73917]:     </disk>
Aug 26 19:18:16 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:18:16 user nova-compute[73917]:       <mac address="fa:16:3e:97:c2:28"/>
Aug 26 19:18:16 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:18:16 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:18:16 user nova-compute[73917]:       <target dev="tapd17ecc7e-21"/>
Aug 26 19:18:16 user nova-compute[73917]:     </interface>
Aug 26 19:18:16 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:18:16 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/console.log" append="off"/>
Aug 26 19:18:16 user nova-compute[73917]:     </serial>
Aug 26 19:18:16 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:18:16 user nova-compute[73917]:     <video>
Aug 26 19:18:16 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:18:16 user nova-compute[73917]:     </video>
Aug 26 19:18:16 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:18:16 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:18:16 user nova-compute[73917]:     </rng>
Aug 26 19:18:16 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:18:16 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:18:16 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:18:16 user nova-compute[73917]:     </memballoon>
Aug 26 19:18:16 user nova-compute[73917]:   </devices>
Aug 26 19:18:16 user nova-compute[73917]: </domain>
Aug 26 19:18:16 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-383778297',display_name='tempest-SnapshotDataIntegrityTests-server-383778297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-383778297',id=29,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuv1mU9NVoBpVxj5EiVjaYvC4NCO9YI10DSjepFVEIfQvlDcx/upl6wK2Fesp6NWlaDAAKyhvMqPoqyYfBDr3Q9il34yGb738txzIzIVrkKd4WemX+502JyqPZaqQ/yYQ==',key_name='tempest-keypair-798292815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29e26e61119446978d7bef2800e511f9',ramdisk_id='',reservation_id='r-gve30q4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1939202203',owner_user_name='tempest-SnapshotDataIntegrityTests-1939202203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:18:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d72f2f6c9e04d938fc4272283d4e45a',uuid=c78c30ea-1190-44bc-bd78-b3655e251a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "address": "fa:16:3e:97:c2:28", "network": {"id": "4e5dd15a-9c1d-489e-b732-db3ac6496ecf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885174960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e26e61119446978d7bef2800e511f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17ecc7e-21", "ovs_interfaceid": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Converting VIF {"id": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "address": "fa:16:3e:97:c2:28", "network": {"id": "4e5dd15a-9c1d-489e-b732-db3ac6496ecf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885174960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e26e61119446978d7bef2800e511f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17ecc7e-21", "ovs_interfaceid": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:c2:28,bridge_name='br-int',has_traffic_filtering=True,id=d17ecc7e-21af-4f6a-a251-4a865473e86b,network=Network(4e5dd15a-9c1d-489e-b732-db3ac6496ecf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd17ecc7e-21') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG os_vif [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:c2:28,bridge_name='br-int',has_traffic_filtering=True,id=d17ecc7e-21af-4f6a-a251-4a865473e86b,network=Network(4e5dd15a-9c1d-489e-b732-db3ac6496ecf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd17ecc7e-21') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd17ecc7e-21, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd17ecc7e-21, col_values=(('external_ids', {'iface-id': 'd17ecc7e-21af-4f6a-a251-4a865473e86b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:c2:28', 'vm-uuid': 'c78c30ea-1190-44bc-bd78-b3655e251a35'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:16 user nova-compute[73917]: INFO os_vif [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:c2:28,bridge_name='br-int',has_traffic_filtering=True,id=d17ecc7e-21af-4f6a-a251-4a865473e86b,network=Network(4e5dd15a-9c1d-489e-b732-db3ac6496ecf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd17ecc7e-21')
Aug 26 19:18:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] No VIF found with MAC fa:16:3e:97:c2:28, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG nova.network.neutron [req-e536737e-3107-407c-ad83-9a69d074147b req-ed8d5e31-3513-4361-aa48-461f19335f52 service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Updated VIF entry in instance network info cache for port d17ecc7e-21af-4f6a-a251-4a865473e86b. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG nova.network.neutron [req-e536737e-3107-407c-ad83-9a69d074147b req-ed8d5e31-3513-4361-aa48-461f19335f52 service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Updating instance_info_cache with network_info: [{"id": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "address": "fa:16:3e:97:c2:28", "network": {"id": "4e5dd15a-9c1d-489e-b732-db3ac6496ecf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885174960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e26e61119446978d7bef2800e511f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17ecc7e-21", "ovs_interfaceid": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:18:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e536737e-3107-407c-ad83-9a69d074147b req-ed8d5e31-3513-4361-aa48-461f19335f52 service nova] Releasing lock "refresh_cache-c78c30ea-1190-44bc-bd78-b3655e251a35" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:18:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:17 user nova-compute[73917]: DEBUG nova.compute.manager [req-ef67a918-689f-4f9f-99ac-7209bdad0f03 req-154a71ac-e094-4207-b745-96c434c33df3 service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Received event network-vif-plugged-d17ecc7e-21af-4f6a-a251-4a865473e86b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:18:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ef67a918-689f-4f9f-99ac-7209bdad0f03 req-154a71ac-e094-4207-b745-96c434c33df3 service nova] Acquiring lock "c78c30ea-1190-44bc-bd78-b3655e251a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ef67a918-689f-4f9f-99ac-7209bdad0f03 req-154a71ac-e094-4207-b745-96c434c33df3 service nova] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ef67a918-689f-4f9f-99ac-7209bdad0f03 req-154a71ac-e094-4207-b745-96c434c33df3 service nova] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:17 user nova-compute[73917]: DEBUG nova.compute.manager [req-ef67a918-689f-4f9f-99ac-7209bdad0f03 req-154a71ac-e094-4207-b745-96c434c33df3 service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] No waiting events found dispatching network-vif-plugged-d17ecc7e-21af-4f6a-a251-4a865473e86b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:18:17 user nova-compute[73917]: WARNING nova.compute.manager [req-ef67a918-689f-4f9f-99ac-7209bdad0f03 req-154a71ac-e094-4207-b745-96c434c33df3 service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Received unexpected event network-vif-plugged-d17ecc7e-21af-4f6a-a251-4a865473e86b for instance with vm_state building and task_state spawning.
Aug 26 19:18:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:19 user nova-compute[73917]: DEBUG nova.compute.manager [req-398a96d0-485e-491f-8607-5ba2250fa640 req-750d3ae7-ce7c-4aba-92bd-11b6f9db0f77 service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Received event network-vif-plugged-d17ecc7e-21af-4f6a-a251-4a865473e86b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:18:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-398a96d0-485e-491f-8607-5ba2250fa640 req-750d3ae7-ce7c-4aba-92bd-11b6f9db0f77 service nova] Acquiring lock "c78c30ea-1190-44bc-bd78-b3655e251a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-398a96d0-485e-491f-8607-5ba2250fa640 req-750d3ae7-ce7c-4aba-92bd-11b6f9db0f77 service nova] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-398a96d0-485e-491f-8607-5ba2250fa640 req-750d3ae7-ce7c-4aba-92bd-11b6f9db0f77 service nova] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:19 user nova-compute[73917]: DEBUG nova.compute.manager [req-398a96d0-485e-491f-8607-5ba2250fa640 req-750d3ae7-ce7c-4aba-92bd-11b6f9db0f77 service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] No waiting events found dispatching network-vif-plugged-d17ecc7e-21af-4f6a-a251-4a865473e86b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:18:19 user nova-compute[73917]: WARNING nova.compute.manager [req-398a96d0-485e-491f-8607-5ba2250fa640 req-750d3ae7-ce7c-4aba-92bd-11b6f9db0f77 service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Received unexpected event network-vif-plugged-d17ecc7e-21af-4f6a-a251-4a865473e86b for instance with vm_state building and task_state spawning.
Aug 26 19:18:19 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077499.8378267, c78c30ea-1190-44bc-bd78-b3655e251a35 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:18:19 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] VM Resumed (Lifecycle Event)
Aug 26 19:18:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:18:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:18:19 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Instance spawned successfully.
Aug 26 19:18:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:18:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:18:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:18:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:18:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:18:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:18:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:18:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:18:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:18:19 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:18:19 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077499.840877, c78c30ea-1190-44bc-bd78-b3655e251a35 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:18:19 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] VM Started (Lifecycle Event)
Aug 26 19:18:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:18:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:18:19 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:18:19 user nova-compute[73917]: INFO nova.compute.manager [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Took 5.80 seconds to spawn the instance on the hypervisor.
Aug 26 19:18:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:18:20 user nova-compute[73917]: INFO nova.compute.manager [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Took 6.95 seconds to build instance.
Aug 26 19:18:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-82280089-78a8-4feb-a698-04c8b37221a2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.140s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:26 user nova-compute[73917]: INFO nova.compute.manager [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Terminating instance
Aug 26 19:18:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-b8ef457a-bae1-417f-b8ce-21838c1f3c01 req-dcf46921-52bb-45fe-97e2-165c5ab9506d service nova] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Received event network-vif-unplugged-bdb9253b-4cd9-4b30-95c4-1ae4416064a4 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b8ef457a-bae1-417f-b8ce-21838c1f3c01 req-dcf46921-52bb-45fe-97e2-165c5ab9506d service nova] Acquiring lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b8ef457a-bae1-417f-b8ce-21838c1f3c01 req-dcf46921-52bb-45fe-97e2-165c5ab9506d service nova] Lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b8ef457a-bae1-417f-b8ce-21838c1f3c01 req-dcf46921-52bb-45fe-97e2-165c5ab9506d service nova] Lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-b8ef457a-bae1-417f-b8ce-21838c1f3c01 req-dcf46921-52bb-45fe-97e2-165c5ab9506d service nova] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] No waiting events found dispatching network-vif-unplugged-bdb9253b-4cd9-4b30-95c4-1ae4416064a4 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-b8ef457a-bae1-417f-b8ce-21838c1f3c01 req-dcf46921-52bb-45fe-97e2-165c5ab9506d service nova] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Received event network-vif-unplugged-bdb9253b-4cd9-4b30-95c4-1ae4416064a4 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:18:26 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Instance destroyed successfully.
Aug 26 19:18:26 user nova-compute[73917]: DEBUG nova.objects.instance [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lazy-loading 'resources' on Instance uuid e2b9dc2e-7b89-4b47-bacc-2b562649db8c {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:16:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-797864761',display_name='tempest-VolumesAdminNegativeTest-server-797864761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-797864761',id=25,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:16:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5f7803cd6f44ed19fe59bd7286b6498',ramdisk_id='',reservation_id='r-eaxm570y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-13801866',owner_user_name='tempest-VolumesAdminNegativeTest-13801866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:16:30Z,user_data=None,user_id='4db077369ef04a9eb5c0654b96550468',uuid=e2b9dc2e-7b89-4b47-bacc-2b562649db8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdb9253b-4cd9-4b30-95c4-1ae4416064a4", "address": "fa:16:3e:3a:25:d4", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdb9253b-4c", "ovs_interfaceid": "bdb9253b-4cd9-4b30-95c4-1ae4416064a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Converting VIF {"id": "bdb9253b-4cd9-4b30-95c4-1ae4416064a4", "address": "fa:16:3e:3a:25:d4", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdb9253b-4c", "ovs_interfaceid": "bdb9253b-4cd9-4b30-95c4-1ae4416064a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:25:d4,bridge_name='br-int',has_traffic_filtering=True,id=bdb9253b-4cd9-4b30-95c4-1ae4416064a4,network=Network(7da3a70d-3593-4f44-8572-3ae03e3cf9c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdb9253b-4c') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG os_vif [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:25:d4,bridge_name='br-int',has_traffic_filtering=True,id=bdb9253b-4cd9-4b30-95c4-1ae4416064a4,network=Network(7da3a70d-3593-4f44-8572-3ae03e3cf9c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdb9253b-4c') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdb9253b-4c, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:18:26 user nova-compute[73917]: INFO os_vif [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:25:d4,bridge_name='br-int',has_traffic_filtering=True,id=bdb9253b-4cd9-4b30-95c4-1ae4416064a4,network=Network(7da3a70d-3593-4f44-8572-3ae03e3cf9c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdb9253b-4c')
Aug 26 19:18:26 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Deleting instance files /opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c_del
Aug 26 19:18:26 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Deletion of /opt/stack/data/nova/instances/e2b9dc2e-7b89-4b47-bacc-2b562649db8c_del complete
Aug 26 19:18:26 user nova-compute[73917]: INFO nova.compute.manager [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 26 19:18:26 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:18:26 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:18:27 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:18:27 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Took 0.54 seconds to deallocate network for instance.
Aug 26 19:18:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:27 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:18:27 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:18:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:28 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Deleted allocations for instance e2b9dc2e-7b89-4b47-bacc-2b562649db8c
Aug 26 19:18:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab0d2993-952f-4a79-b773-c4a2f9f166b1 tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.964s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:28 user nova-compute[73917]: DEBUG nova.compute.manager [req-3b3e3281-3d0f-4852-8e87-47d1f6aecb70 req-b02c2cd4-81b9-4199-a467-6ecc2b43c4ad service nova] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Received event network-vif-plugged-bdb9253b-4cd9-4b30-95c4-1ae4416064a4 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:18:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3b3e3281-3d0f-4852-8e87-47d1f6aecb70 req-b02c2cd4-81b9-4199-a467-6ecc2b43c4ad service nova] Acquiring lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3b3e3281-3d0f-4852-8e87-47d1f6aecb70 req-b02c2cd4-81b9-4199-a467-6ecc2b43c4ad service nova] Lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3b3e3281-3d0f-4852-8e87-47d1f6aecb70 req-b02c2cd4-81b9-4199-a467-6ecc2b43c4ad service nova] Lock "e2b9dc2e-7b89-4b47-bacc-2b562649db8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:28 user nova-compute[73917]: DEBUG nova.compute.manager [req-3b3e3281-3d0f-4852-8e87-47d1f6aecb70 req-b02c2cd4-81b9-4199-a467-6ecc2b43c4ad service nova] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] No waiting events found dispatching network-vif-plugged-bdb9253b-4cd9-4b30-95c4-1ae4416064a4 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:18:28 user nova-compute[73917]: WARNING nova.compute.manager [req-3b3e3281-3d0f-4852-8e87-47d1f6aecb70 req-b02c2cd4-81b9-4199-a467-6ecc2b43c4ad service nova] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Received unexpected event network-vif-plugged-bdb9253b-4cd9-4b30-95c4-1ae4416064a4 for instance with vm_state deleted and task_state None.
Aug 26 19:18:28 user nova-compute[73917]: DEBUG nova.compute.manager [req-3b3e3281-3d0f-4852-8e87-47d1f6aecb70 req-b02c2cd4-81b9-4199-a467-6ecc2b43c4ad service nova] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Received event network-vif-deleted-bdb9253b-4cd9-4b30-95c4-1ae4416064a4 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:18:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Acquiring lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Acquiring lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:32 user nova-compute[73917]: INFO nova.compute.manager [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Terminating instance
Aug 26 19:18:32 user nova-compute[73917]: DEBUG nova.compute.manager [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:18:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-83d3d80b-a01f-4919-b400-5fc92a0201ca req-bb07db0c-916b-43ef-befb-3f36acb310ad service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Received event network-vif-unplugged-93e113c1-23f5-4f62-81b4-fff7b3dd2099 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:18:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-83d3d80b-a01f-4919-b400-5fc92a0201ca req-bb07db0c-916b-43ef-befb-3f36acb310ad service nova] Acquiring lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-83d3d80b-a01f-4919-b400-5fc92a0201ca req-bb07db0c-916b-43ef-befb-3f36acb310ad service nova] Lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-83d3d80b-a01f-4919-b400-5fc92a0201ca req-bb07db0c-916b-43ef-befb-3f36acb310ad service nova] Lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-83d3d80b-a01f-4919-b400-5fc92a0201ca req-bb07db0c-916b-43ef-befb-3f36acb310ad service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] No waiting events found dispatching network-vif-unplugged-93e113c1-23f5-4f62-81b4-fff7b3dd2099 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:18:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-83d3d80b-a01f-4919-b400-5fc92a0201ca req-bb07db0c-916b-43ef-befb-3f36acb310ad service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Received event network-vif-unplugged-93e113c1-23f5-4f62-81b4-fff7b3dd2099 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:18:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:33 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Instance destroyed successfully.
Aug 26 19:18:33 user nova-compute[73917]: DEBUG nova.objects.instance [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Lazy-loading 'resources' on Instance uuid d61ab2cf-7bfb-4d39-8f6b-db688872c437 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:18:33 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2056762851',display_name='tempest-VolumesNegativeTest-instance-2056762851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2056762851',id=26,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:16:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fc299008d98463697ee227ba83a931c',ramdisk_id='',reservation_id='r-db0at2po',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-867248285',owner_user_name='tempest-VolumesNegativeTest-867248285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:16:50Z,user_data=None,user_id='65a8225c5a6c46e8a7c106fab238aa32',uuid=d61ab2cf-7bfb-4d39-8f6b-db688872c437,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93e113c1-23f5-4f62-81b4-fff7b3dd2099", "address": "fa:16:3e:ac:25:6a", "network": {"id": "81d8e758-90e4-4c8f-8afc-082eaf39d764", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4f48ef7195434beeafa4341e0e7018ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93e113c1-23", "ovs_interfaceid": "93e113c1-23f5-4f62-81b4-fff7b3dd2099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:18:33 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Converting VIF {"id": "93e113c1-23f5-4f62-81b4-fff7b3dd2099", "address": "fa:16:3e:ac:25:6a", "network": {"id": "81d8e758-90e4-4c8f-8afc-082eaf39d764", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4f48ef7195434beeafa4341e0e7018ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93e113c1-23", "ovs_interfaceid": "93e113c1-23f5-4f62-81b4-fff7b3dd2099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:18:33 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:25:6a,bridge_name='br-int',has_traffic_filtering=True,id=93e113c1-23f5-4f62-81b4-fff7b3dd2099,network=Network(81d8e758-90e4-4c8f-8afc-082eaf39d764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93e113c1-23') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:18:33 user nova-compute[73917]: DEBUG os_vif [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:25:6a,bridge_name='br-int',has_traffic_filtering=True,id=93e113c1-23f5-4f62-81b4-fff7b3dd2099,network=Network(81d8e758-90e4-4c8f-8afc-082eaf39d764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93e113c1-23') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:18:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93e113c1-23, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:18:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:18:33 user nova-compute[73917]: INFO os_vif [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:25:6a,bridge_name='br-int',has_traffic_filtering=True,id=93e113c1-23f5-4f62-81b4-fff7b3dd2099,network=Network(81d8e758-90e4-4c8f-8afc-082eaf39d764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93e113c1-23')
Aug 26 19:18:33 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Deleting instance files /opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437_del
Aug 26 19:18:33 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Deletion of /opt/stack/data/nova/instances/d61ab2cf-7bfb-4d39-8f6b-db688872c437_del complete
Aug 26 19:18:33 user nova-compute[73917]: INFO nova.compute.manager [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 26 19:18:33 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:18:33 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:18:33 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:18:34 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:18:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-afbf9365-781f-42af-9108-7eb79b7ad5b9 req-72c14ec0-4d7c-4b9b-b585-8f017cb92e23 service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Received event network-vif-deleted-93e113c1-23f5-4f62-81b4-fff7b3dd2099 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:18:34 user nova-compute[73917]: INFO nova.compute.manager [req-afbf9365-781f-42af-9108-7eb79b7ad5b9 req-72c14ec0-4d7c-4b9b-b585-8f017cb92e23 service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Neutron deleted interface 93e113c1-23f5-4f62-81b4-fff7b3dd2099; detaching it from the instance and deleting it from the info cache
Aug 26 19:18:34 user nova-compute[73917]: DEBUG nova.network.neutron [req-afbf9365-781f-42af-9108-7eb79b7ad5b9 req-72c14ec0-4d7c-4b9b-b585-8f017cb92e23 service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:18:34 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Took 0.74 seconds to deallocate network for instance.
Aug 26 19:18:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-afbf9365-781f-42af-9108-7eb79b7ad5b9 req-72c14ec0-4d7c-4b9b-b585-8f017cb92e23 service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Detach interface failed, port_id=93e113c1-23f5-4f62-81b4-fff7b3dd2099, reason: Instance d61ab2cf-7bfb-4d39-8f6b-db688872c437 could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:18:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:34 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:18:34 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:18:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:34 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Deleted allocations for instance d61ab2cf-7bfb-4d39-8f6b-db688872c437
Aug 26 19:18:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a2bb7800-4cf4-4f5f-92f0-c0d2eac6cea4 tempest-VolumesNegativeTest-867248285 tempest-VolumesNegativeTest-867248285-project-member] Lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.053s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-b5fd7515-4963-42ca-8337-000a5a651be7 req-c2286a1b-df2b-4c07-a7fa-64251c6d3003 service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Received event network-vif-plugged-93e113c1-23f5-4f62-81b4-fff7b3dd2099 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:18:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b5fd7515-4963-42ca-8337-000a5a651be7 req-c2286a1b-df2b-4c07-a7fa-64251c6d3003 service nova] Acquiring lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b5fd7515-4963-42ca-8337-000a5a651be7 req-c2286a1b-df2b-4c07-a7fa-64251c6d3003 service nova] Lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b5fd7515-4963-42ca-8337-000a5a651be7 req-c2286a1b-df2b-4c07-a7fa-64251c6d3003 service nova] Lock "d61ab2cf-7bfb-4d39-8f6b-db688872c437-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-b5fd7515-4963-42ca-8337-000a5a651be7 req-c2286a1b-df2b-4c07-a7fa-64251c6d3003 service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] No waiting events found dispatching network-vif-plugged-93e113c1-23f5-4f62-81b4-fff7b3dd2099 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:18:35 user nova-compute[73917]: WARNING nova.compute.manager [req-b5fd7515-4963-42ca-8337-000a5a651be7 req-c2286a1b-df2b-4c07-a7fa-64251c6d3003 service nova] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Received unexpected event network-vif-plugged-93e113c1-23f5-4f62-81b4-fff7b3dd2099 for instance with vm_state deleted and task_state None.
Aug 26 19:18:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:41 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077506.785377, e2b9dc2e-7b89-4b47-bacc-2b562649db8c => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:18:41 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] VM Stopped (Lifecycle Event)
Aug 26 19:18:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-aacad5a4-7adb-4fe5-bc27-a3df3f15f923 None None] [instance: e2b9dc2e-7b89-4b47-bacc-2b562649db8c] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:18:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Acquiring lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:43 user nova-compute[73917]: DEBUG nova.compute.manager [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:18:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:43 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:18:43 user nova-compute[73917]: INFO nova.compute.claims [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Claim successful on node user
Aug 26 19:18:44 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:18:44 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:18:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.628s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:44 user nova-compute[73917]: DEBUG nova.compute.manager [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:18:44 user nova-compute[73917]: DEBUG nova.compute.manager [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:18:44 user nova-compute[73917]: DEBUG nova.network.neutron [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:18:44 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:18:44 user nova-compute[73917]: DEBUG nova.compute.manager [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:18:44 user nova-compute[73917]: DEBUG nova.policy [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00b79af99f494c20a044c86f209cf2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf98c332d484d18848fa1d5094c4b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:18:44 user nova-compute[73917]: DEBUG nova.compute.manager [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:18:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:18:44 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Creating image(s)
Aug 26 19:18:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Acquiring lock "/opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Lock "/opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Lock "/opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.180s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.189s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8/disk 1073741824" returned: 0 in 0.056s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:45 user nova-compute[73917]: DEBUG nova.network.neutron [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Successfully created port: 9e8197b5-9996-4851-922d-33a27c7bb496 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:18:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.176s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:45 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:18:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:45 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Cannot resize image /opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:18:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:18:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Ensure instance console log exists: /opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:18:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.network.neutron [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Successfully updated port: 9e8197b5-9996-4851-922d-33a27c7bb496 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Acquiring lock "refresh_cache-f486f10e-1cb0-47f6-b8f5-9cafe1c231f8" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Acquired lock "refresh_cache-f486f10e-1cb0-47f6-b8f5-9cafe1c231f8" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.network.neutron [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.compute.manager [req-468fb75c-d4d6-47b7-9fa0-c498307f7dda req-f10ba642-791c-4a48-bb6e-e337632d62cb service nova] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Received event network-changed-9e8197b5-9996-4851-922d-33a27c7bb496 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.compute.manager [req-468fb75c-d4d6-47b7-9fa0-c498307f7dda req-f10ba642-791c-4a48-bb6e-e337632d62cb service nova] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Refreshing instance network info cache due to event network-changed-9e8197b5-9996-4851-922d-33a27c7bb496. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-468fb75c-d4d6-47b7-9fa0-c498307f7dda req-f10ba642-791c-4a48-bb6e-e337632d62cb service nova] Acquiring lock "refresh_cache-f486f10e-1cb0-47f6-b8f5-9cafe1c231f8" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.network.neutron [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.network.neutron [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Updating instance_info_cache with network_info: [{"id": "9e8197b5-9996-4851-922d-33a27c7bb496", "address": "fa:16:3e:54:e5:3b", "network": {"id": "7c8df350-d18b-46dc-8571-1c8ccbf3448e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1828019014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf98c332d484d18848fa1d5094c4b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e8197b5-99", "ovs_interfaceid": "9e8197b5-9996-4851-922d-33a27c7bb496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Releasing lock "refresh_cache-f486f10e-1cb0-47f6-b8f5-9cafe1c231f8" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Instance network_info: |[{"id": "9e8197b5-9996-4851-922d-33a27c7bb496", "address": "fa:16:3e:54:e5:3b", "network": {"id": "7c8df350-d18b-46dc-8571-1c8ccbf3448e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1828019014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf98c332d484d18848fa1d5094c4b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e8197b5-99", "ovs_interfaceid": "9e8197b5-9996-4851-922d-33a27c7bb496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-468fb75c-d4d6-47b7-9fa0-c498307f7dda req-f10ba642-791c-4a48-bb6e-e337632d62cb service nova] Acquired lock "refresh_cache-f486f10e-1cb0-47f6-b8f5-9cafe1c231f8" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.network.neutron [req-468fb75c-d4d6-47b7-9fa0-c498307f7dda req-f10ba642-791c-4a48-bb6e-e337632d62cb service nova] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Refreshing network info cache for port 9e8197b5-9996-4851-922d-33a27c7bb496 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Start _get_guest_xml network_info=[{"id": "9e8197b5-9996-4851-922d-33a27c7bb496", "address": "fa:16:3e:54:e5:3b", "network": {"id": "7c8df350-d18b-46dc-8571-1c8ccbf3448e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1828019014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf98c332d484d18848fa1d5094c4b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e8197b5-99", "ovs_interfaceid": "9e8197b5-9996-4851-922d-33a27c7bb496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:18:46 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:18:46 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:18:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1804325487',display_name='tempest-VolumesActionsTest-instance-1804325487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1804325487',id=30,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdf98c332d484d18848fa1d5094c4b92',ramdisk_id='',reservation_id='r-9fdd00cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-144292805',owner_user_name='tempest-VolumesActionsTest-144292805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:18:45Z,user_data=None,user_id='00b79af99f494c20a044c86f209cf2e5',uuid=f486f10e-1cb0-47f6-b8f5-9cafe1c231f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e8197b5-9996-4851-922d-33a27c7bb496", "address": "fa:16:3e:54:e5:3b", "network": {"id": "7c8df350-d18b-46dc-8571-1c8ccbf3448e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1828019014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf98c332d484d18848fa1d5094c4b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e8197b5-99", "ovs_interfaceid": "9e8197b5-9996-4851-922d-33a27c7bb496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Converting VIF {"id": "9e8197b5-9996-4851-922d-33a27c7bb496", "address": "fa:16:3e:54:e5:3b", "network": {"id": "7c8df350-d18b-46dc-8571-1c8ccbf3448e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1828019014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf98c332d484d18848fa1d5094c4b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e8197b5-99", "ovs_interfaceid": "9e8197b5-9996-4851-922d-33a27c7bb496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:e5:3b,bridge_name='br-int',has_traffic_filtering=True,id=9e8197b5-9996-4851-922d-33a27c7bb496,network=Network(7c8df350-d18b-46dc-8571-1c8ccbf3448e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e8197b5-99') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.objects.instance [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Lazy-loading 'pci_devices' on Instance uuid f486f10e-1cb0-47f6-b8f5-9cafe1c231f8 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:18:46 user nova-compute[73917]:   <uuid>f486f10e-1cb0-47f6-b8f5-9cafe1c231f8</uuid>
Aug 26 19:18:46 user nova-compute[73917]:   <name>instance-0000001e</name>
Aug 26 19:18:46 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:18:46 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:18:46 user nova-compute[73917]:   <metadata>
Aug 26 19:18:46 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:18:46 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:18:46 user nova-compute[73917]:       <nova:name>tempest-VolumesActionsTest-instance-1804325487</nova:name>
Aug 26 19:18:46 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:18:46</nova:creationTime>
Aug 26 19:18:46 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:18:46 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:18:46 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:18:46 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:18:46 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:18:46 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:18:46 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:18:46 user nova-compute[73917]:       <nova:owner>
Aug 26 19:18:46 user nova-compute[73917]:         <nova:user uuid="00b79af99f494c20a044c86f209cf2e5">tempest-VolumesActionsTest-144292805-project-member</nova:user>
Aug 26 19:18:46 user nova-compute[73917]:         <nova:project uuid="fdf98c332d484d18848fa1d5094c4b92">tempest-VolumesActionsTest-144292805</nova:project>
Aug 26 19:18:46 user nova-compute[73917]:       </nova:owner>
Aug 26 19:18:46 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:18:46 user nova-compute[73917]:       <nova:ports>
Aug 26 19:18:46 user nova-compute[73917]:         <nova:port uuid="9e8197b5-9996-4851-922d-33a27c7bb496">
Aug 26 19:18:46 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 19:18:46 user nova-compute[73917]:         </nova:port>
Aug 26 19:18:46 user nova-compute[73917]:       </nova:ports>
Aug 26 19:18:46 user nova-compute[73917]:     </nova:instance>
Aug 26 19:18:46 user nova-compute[73917]:   </metadata>
Aug 26 19:18:46 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:18:46 user nova-compute[73917]:     <system>
Aug 26 19:18:46 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:18:46 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:18:46 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:18:46 user nova-compute[73917]:       <entry name="serial">f486f10e-1cb0-47f6-b8f5-9cafe1c231f8</entry>
Aug 26 19:18:46 user nova-compute[73917]:       <entry name="uuid">f486f10e-1cb0-47f6-b8f5-9cafe1c231f8</entry>
Aug 26 19:18:46 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:18:46 user nova-compute[73917]:     </system>
Aug 26 19:18:46 user nova-compute[73917]:   </sysinfo>
Aug 26 19:18:46 user nova-compute[73917]:   <os>
Aug 26 19:18:46 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:18:46 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:18:46 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:18:46 user nova-compute[73917]:   </os>
Aug 26 19:18:46 user nova-compute[73917]:   <features>
Aug 26 19:18:46 user nova-compute[73917]:     <acpi/>
Aug 26 19:18:46 user nova-compute[73917]:     <apic/>
Aug 26 19:18:46 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:18:46 user nova-compute[73917]:   </features>
Aug 26 19:18:46 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:18:46 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:18:46 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:18:46 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:18:46 user nova-compute[73917]:   </clock>
Aug 26 19:18:46 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:18:46 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:18:46 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:18:46 user nova-compute[73917]:   </cpu>
Aug 26 19:18:46 user nova-compute[73917]:   <devices>
Aug 26 19:18:46 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:18:46 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:18:46 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8/disk"/>
Aug 26 19:18:46 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:18:46 user nova-compute[73917]:     </disk>
Aug 26 19:18:46 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:18:46 user nova-compute[73917]:       <mac address="fa:16:3e:54:e5:3b"/>
Aug 26 19:18:46 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:18:46 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:18:46 user nova-compute[73917]:       <target dev="tap9e8197b5-99"/>
Aug 26 19:18:46 user nova-compute[73917]:     </interface>
Aug 26 19:18:46 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:18:46 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8/console.log" append="off"/>
Aug 26 19:18:46 user nova-compute[73917]:     </serial>
Aug 26 19:18:46 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:18:46 user nova-compute[73917]:     <video>
Aug 26 19:18:46 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:18:46 user nova-compute[73917]:     </video>
Aug 26 19:18:46 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:18:46 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:18:46 user nova-compute[73917]:     </rng>
Aug 26 19:18:46 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:18:46 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:18:46 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:18:46 user nova-compute[73917]:     </memballoon>
Aug 26 19:18:46 user nova-compute[73917]:   </devices>
Aug 26 19:18:46 user nova-compute[73917]: </domain>
Aug 26 19:18:46 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:18:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1804325487',display_name='tempest-VolumesActionsTest-instance-1804325487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1804325487',id=30,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdf98c332d484d18848fa1d5094c4b92',ramdisk_id='',reservation_id='r-9fdd00cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-144292805',owner_user_name='tempest-VolumesActionsTest-144292805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:18:45Z,user_data=None,user_id='00b79af99f494c20a044c86f209cf2e5',uuid=f486f10e-1cb0-47f6-b8f5-9cafe1c231f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e8197b5-9996-4851-922d-33a27c7bb496", "address": "fa:16:3e:54:e5:3b", "network": {"id": "7c8df350-d18b-46dc-8571-1c8ccbf3448e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1828019014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf98c332d484d18848fa1d5094c4b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e8197b5-99", "ovs_interfaceid": "9e8197b5-9996-4851-922d-33a27c7bb496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Converting VIF {"id": "9e8197b5-9996-4851-922d-33a27c7bb496", "address": "fa:16:3e:54:e5:3b", "network": {"id": "7c8df350-d18b-46dc-8571-1c8ccbf3448e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1828019014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf98c332d484d18848fa1d5094c4b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e8197b5-99", "ovs_interfaceid": "9e8197b5-9996-4851-922d-33a27c7bb496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:e5:3b,bridge_name='br-int',has_traffic_filtering=True,id=9e8197b5-9996-4851-922d-33a27c7bb496,network=Network(7c8df350-d18b-46dc-8571-1c8ccbf3448e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e8197b5-99') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG os_vif [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:e5:3b,bridge_name='br-int',has_traffic_filtering=True,id=9e8197b5-9996-4851-922d-33a27c7bb496,network=Network(7c8df350-d18b-46dc-8571-1c8ccbf3448e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e8197b5-99') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e8197b5-99, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e8197b5-99, col_values=(('external_ids', {'iface-id': '9e8197b5-9996-4851-922d-33a27c7bb496', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:e5:3b', 'vm-uuid': 'f486f10e-1cb0-47f6-b8f5-9cafe1c231f8'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:46 user nova-compute[73917]: INFO os_vif [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:e5:3b,bridge_name='br-int',has_traffic_filtering=True,id=9e8197b5-9996-4851-922d-33a27c7bb496,network=Network(7c8df350-d18b-46dc-8571-1c8ccbf3448e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e8197b5-99')
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] No VIF found with MAC fa:16:3e:54:e5:3b, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.network.neutron [req-468fb75c-d4d6-47b7-9fa0-c498307f7dda req-f10ba642-791c-4a48-bb6e-e337632d62cb service nova] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Updated VIF entry in instance network info cache for port 9e8197b5-9996-4851-922d-33a27c7bb496. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG nova.network.neutron [req-468fb75c-d4d6-47b7-9fa0-c498307f7dda req-f10ba642-791c-4a48-bb6e-e337632d62cb service nova] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Updating instance_info_cache with network_info: [{"id": "9e8197b5-9996-4851-922d-33a27c7bb496", "address": "fa:16:3e:54:e5:3b", "network": {"id": "7c8df350-d18b-46dc-8571-1c8ccbf3448e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1828019014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf98c332d484d18848fa1d5094c4b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e8197b5-99", "ovs_interfaceid": "9e8197b5-9996-4851-922d-33a27c7bb496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:18:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-468fb75c-d4d6-47b7-9fa0-c498307f7dda req-f10ba642-791c-4a48-bb6e-e337632d62cb service nova] Releasing lock "refresh_cache-f486f10e-1cb0-47f6-b8f5-9cafe1c231f8" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:18:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:48 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077513.3685913, d61ab2cf-7bfb-4d39-8f6b-db688872c437 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:18:48 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] VM Stopped (Lifecycle Event)
Aug 26 19:18:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:48 user nova-compute[73917]: DEBUG nova.compute.manager [None req-bff8408b-d2cd-4187-97cb-52739b2d204d None None] [instance: d61ab2cf-7bfb-4d39-8f6b-db688872c437] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:18:48 user nova-compute[73917]: DEBUG nova.compute.manager [req-d18bf696-dafc-41a9-936f-284363e53d68 req-f5bd7713-987e-4942-ab78-5523b61e334a service nova] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Received event network-vif-plugged-9e8197b5-9996-4851-922d-33a27c7bb496 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:18:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d18bf696-dafc-41a9-936f-284363e53d68 req-f5bd7713-987e-4942-ab78-5523b61e334a service nova] Acquiring lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d18bf696-dafc-41a9-936f-284363e53d68 req-f5bd7713-987e-4942-ab78-5523b61e334a service nova] Lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d18bf696-dafc-41a9-936f-284363e53d68 req-f5bd7713-987e-4942-ab78-5523b61e334a service nova] Lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:48 user nova-compute[73917]: DEBUG nova.compute.manager [req-d18bf696-dafc-41a9-936f-284363e53d68 req-f5bd7713-987e-4942-ab78-5523b61e334a service nova] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] No waiting events found dispatching network-vif-plugged-9e8197b5-9996-4851-922d-33a27c7bb496 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:18:48 user nova-compute[73917]: WARNING nova.compute.manager [req-d18bf696-dafc-41a9-936f-284363e53d68 req-f5bd7713-987e-4942-ab78-5523b61e334a service nova] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Received unexpected event network-vif-plugged-9e8197b5-9996-4851-922d-33a27c7bb496 for instance with vm_state building and task_state spawning.
Aug 26 19:18:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "4a2d91a5-9943-43f6-b919-30510ccba727" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "4a2d91a5-9943-43f6-b919-30510ccba727" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:18:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:49 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:18:49 user nova-compute[73917]: INFO nova.compute.claims [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Claim successful on node user
Aug 26 19:18:49 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:18:49 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:18:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.network.neutron [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:18:50 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:18:50 user nova-compute[73917]: INFO nova.virt.block_device [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Booting with volume 4c062201-81b9-42d1-8ae2-5b6fe648bc2a at /dev/vda
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.policy [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd1b7d3fe22c4b239cf03235866e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e09fe7b38e4bb991bfaaf5b4ad357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077530.1626506, f486f10e-1cb0-47f6-b8f5-9cafe1c231f8 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:18:50 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] VM Resumed (Lifecycle Event)
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:18:50 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Instance spawned successfully.
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG os_brick.utils [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be0c7e6-401e-40ba-b70c-ed1d8580a96a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af2282f-b4bf-4ef7-94d2-2ca82a7c2762]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:18:50 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077530.1639652, f486f10e-1cb0-47f6-b8f5-9cafe1c231f8 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:18:50 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] VM Started (Lifecycle Event)
Aug 26 19:18:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b6e794-337a-46c7-8903-6a95c1b2dbd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[934a2f6e-d293-49bd-a103-e4ae48f2a376]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:18:50 user nova-compute[73917]: INFO nova.compute.manager [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Took 5.59 seconds to spawn the instance on the hypervisor.
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:18:50 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:18:50 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3289898-efcb-48a7-aad5-f9e1c1f7e954]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG os_brick.utils [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Updating existing volume attachment record: 3de8cf16-7024-4ee2-8069-616343da6ec4 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:18:50 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:18:50 user nova-compute[73917]: INFO nova.compute.manager [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Took 6.56 seconds to build instance.
Aug 26 19:18:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a1263ab3-a438-40ba-9102-a707dbc0bb25 tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.660s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.compute.manager [req-a9ea5cf4-f873-4b89-a7b9-33e73a808672 req-35de63db-11e0-4324-9146-b513d6a70bb3 service nova] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Received event network-vif-plugged-9e8197b5-9996-4851-922d-33a27c7bb496 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a9ea5cf4-f873-4b89-a7b9-33e73a808672 req-35de63db-11e0-4324-9146-b513d6a70bb3 service nova] Acquiring lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a9ea5cf4-f873-4b89-a7b9-33e73a808672 req-35de63db-11e0-4324-9146-b513d6a70bb3 service nova] Lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a9ea5cf4-f873-4b89-a7b9-33e73a808672 req-35de63db-11e0-4324-9146-b513d6a70bb3 service nova] Lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.compute.manager [req-a9ea5cf4-f873-4b89-a7b9-33e73a808672 req-35de63db-11e0-4324-9146-b513d6a70bb3 service nova] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] No waiting events found dispatching network-vif-plugged-9e8197b5-9996-4851-922d-33a27c7bb496 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:18:50 user nova-compute[73917]: WARNING nova.compute.manager [req-a9ea5cf4-f873-4b89-a7b9-33e73a808672 req-35de63db-11e0-4324-9146-b513d6a70bb3 service nova] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Received unexpected event network-vif-plugged-9e8197b5-9996-4851-922d-33a27c7bb496 for instance with vm_state active and task_state None.
Aug 26 19:18:50 user nova-compute[73917]: DEBUG nova.network.neutron [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Successfully created port: af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:18:51 user nova-compute[73917]: DEBUG nova.network.neutron [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Successfully updated port: af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:18:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "refresh_cache-4a2d91a5-9943-43f6-b919-30510ccba727" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:18:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquired lock "refresh_cache-4a2d91a5-9943-43f6-b919-30510ccba727" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:18:51 user nova-compute[73917]: DEBUG nova.network.neutron [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:18:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-4fc26b3f-d3c6-42ff-9e81-ca41aafca0cd req-a0a42740-cf47-4fdb-95af-6b542428e759 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Received event network-changed-af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:18:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-4fc26b3f-d3c6-42ff-9e81-ca41aafca0cd req-a0a42740-cf47-4fdb-95af-6b542428e759 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Refreshing instance network info cache due to event network-changed-af8c2f16-54b2-4a39-b893-e95b3794b8b1. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:18:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4fc26b3f-d3c6-42ff-9e81-ca41aafca0cd req-a0a42740-cf47-4fdb-95af-6b542428e759 service nova] Acquiring lock "refresh_cache-4a2d91a5-9943-43f6-b919-30510ccba727" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:18:51 user nova-compute[73917]: DEBUG nova.network.neutron [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:18:51 user nova-compute[73917]: DEBUG nova.network.neutron [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Updating instance_info_cache with network_info: [{"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:18:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Releasing lock "refresh_cache-4a2d91a5-9943-43f6-b919-30510ccba727" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:18:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Instance network_info: |[{"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:18:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4fc26b3f-d3c6-42ff-9e81-ca41aafca0cd req-a0a42740-cf47-4fdb-95af-6b542428e759 service nova] Acquired lock "refresh_cache-4a2d91a5-9943-43f6-b919-30510ccba727" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:18:51 user nova-compute[73917]: DEBUG nova.network.neutron [req-4fc26b3f-d3c6-42ff-9e81-ca41aafca0cd req-a0a42740-cf47-4fdb-95af-6b542428e759 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Refreshing network info cache for port af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:18:52 user nova-compute[73917]: DEBUG nova.network.neutron [req-4fc26b3f-d3c6-42ff-9e81-ca41aafca0cd req-a0a42740-cf47-4fdb-95af-6b542428e759 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Updated VIF entry in instance network info cache for port af8c2f16-54b2-4a39-b893-e95b3794b8b1. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:18:52 user nova-compute[73917]: DEBUG nova.network.neutron [req-4fc26b3f-d3c6-42ff-9e81-ca41aafca0cd req-a0a42740-cf47-4fdb-95af-6b542428e759 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Updating instance_info_cache with network_info: [{"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:18:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4fc26b3f-d3c6-42ff-9e81-ca41aafca0cd req-a0a42740-cf47-4fdb-95af-6b542428e759 service nova] Releasing lock "refresh_cache-4a2d91a5-9943-43f6-b919-30510ccba727" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:18:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:18:58 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:18:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:18:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-94f8d4e7-f310-45df-a0ae-82e608ac0119" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:18:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-94f8d4e7-f310-45df-a0ae-82e608ac0119" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:18:58 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:18:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:18:58 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Updating instance_info_cache with network_info: [{"id": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "address": "fa:16:3e:45:49:40", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea31a0cf-61", "ovs_interfaceid": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:18:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-94f8d4e7-f310-45df-a0ae-82e608ac0119" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:18:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:18:58 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:18:59 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:18:59 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:18:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:18:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:18:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:18:59 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:18:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:18:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:18:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:19:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:19:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df5c717a-62d8-444d-9968-ad682a31733c/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df5c717a-62d8-444d-9968-ad682a31733c/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df5c717a-62d8-444d-9968-ad682a31733c/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df5c717a-62d8-444d-9968-ad682a31733c/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:19:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:19:02 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Creating image(s)
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Did not create local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Ensure instance console log exists: /opt/stack/data/nova/instances/4a2d91a5-9943-43f6-b919-30510ccba727/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Start _get_guest_xml network_info=[{"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kBypRFGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4a2d91a5-9943-43f6-b919-30510ccba727', 'attached_at': '', 'detached_at': '', 'volume_id': '4c062201-81b9-42d1-8ae2-5b6fe648bc2a', 'serial': '4c062201-81b9-42d1-8ae2-5b6fe648bc2a'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '3de8cf16-7024-4ee2-8069-616343da6ec4', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:19:02 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:19:02 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kBypRFGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:19:02 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:19:02 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:19:02 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8e2c21-e49a-4087-9b95-e2e81a2eaa96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:19:02 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dd0eee-b1da-48d0-8963-813de452505d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a] added
Aug 26 19:19:02 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b8ce67-cca7-4a2e-a1e3-4ec38ab99689]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[502fc036-4215-404d-85ea-a10b090eae82]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kBypRFGs {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kBypRFGs" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b62f4c-db9b-4219-b341-ef0745005178]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kBypRFGs'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6974bff4-c3bc-4bdb-8470-8e25eb21db47]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[784c26aa-a834-44bf-a380-cd0a0644ddd5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:19:02 user nova-compute[73917]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:19:02 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:19:02 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:19:02 user nova-compute[73917]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:19:02 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:19:02 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbf7a89-8897-4d65-adda-4591145798a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a, portal: 172.16.0.220,3260]
Aug 26 19:19:02 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a, portal: 172.16.0.220,3260] successful.
Aug 26 19:19:02 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[30451c70-ba1c-437c-b8a8-acf7a2af8cf4]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[789faf36-ab89-46c0-a2a9-7c5bd2ea7d71]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:19:02 user nova-compute[73917]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:19:02 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:19:02 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:19:02 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:19:02 user nova-compute[73917]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:19:02 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:19:02 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:19:02 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d00a20-5aaf-4a71-a559-fb4dec0947a1]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kBypRFGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23531306438393361', 'path': '/dev/sde'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531306438393361', 'path': '/dev/sde'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1428844380',display_name='tempest-ServerActionsTestOtherA-server-1428844380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1428844380',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoE8tZDc68JWUNde0nWnasqq1vYa5ON2YNQwHw+xO1EiolhKGRVVBiykxwLyvBezUmZpO4CsEARWWqkHIKpn0pTvCPDPPJIP+G7BbRXcHe4wp+29J3exWEnrrk3yPKzjg==',key_name='tempest-keypair-1254307896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2e09fe7b38e4bb991bfaaf5b4ad357a',ramdisk_id='',reservation_id='r-4dv3wxu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2069094918',owner_user_name='tempest-ServerActionsTestOtherA-2069094918-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd1b7d3fe22c4b239cf03235866e17d4',uuid=4a2d91a5-9943-43f6-b919-30510ccba727,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converting VIF {"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=af8c2f16-54b2-4a39-b893-e95b3794b8b1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c2f16-54') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG nova.objects.instance [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a2d91a5-9943-43f6-b919-30510ccba727 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:19:03 user nova-compute[73917]:   <uuid>4a2d91a5-9943-43f6-b919-30510ccba727</uuid>
Aug 26 19:19:03 user nova-compute[73917]:   <name>instance-0000001f</name>
Aug 26 19:19:03 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:19:03 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:19:03 user nova-compute[73917]:   <metadata>
Aug 26 19:19:03 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:19:03 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:19:03 user nova-compute[73917]:       <nova:name>tempest-ServerActionsTestOtherA-server-1428844380</nova:name>
Aug 26 19:19:03 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:19:02</nova:creationTime>
Aug 26 19:19:03 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:19:03 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:19:03 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:19:03 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:19:03 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:19:03 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:19:03 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:19:03 user nova-compute[73917]:       <nova:owner>
Aug 26 19:19:03 user nova-compute[73917]:         <nova:user uuid="cd1b7d3fe22c4b239cf03235866e17d4">tempest-ServerActionsTestOtherA-2069094918-project-member</nova:user>
Aug 26 19:19:03 user nova-compute[73917]:         <nova:project uuid="c2e09fe7b38e4bb991bfaaf5b4ad357a">tempest-ServerActionsTestOtherA-2069094918</nova:project>
Aug 26 19:19:03 user nova-compute[73917]:       </nova:owner>
Aug 26 19:19:03 user nova-compute[73917]:       <nova:ports>
Aug 26 19:19:03 user nova-compute[73917]:         <nova:port uuid="af8c2f16-54b2-4a39-b893-e95b3794b8b1">
Aug 26 19:19:03 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 19:19:03 user nova-compute[73917]:         </nova:port>
Aug 26 19:19:03 user nova-compute[73917]:       </nova:ports>
Aug 26 19:19:03 user nova-compute[73917]:     </nova:instance>
Aug 26 19:19:03 user nova-compute[73917]:   </metadata>
Aug 26 19:19:03 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:19:03 user nova-compute[73917]:     <system>
Aug 26 19:19:03 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:19:03 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:19:03 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:19:03 user nova-compute[73917]:       <entry name="serial">4a2d91a5-9943-43f6-b919-30510ccba727</entry>
Aug 26 19:19:03 user nova-compute[73917]:       <entry name="uuid">4a2d91a5-9943-43f6-b919-30510ccba727</entry>
Aug 26 19:19:03 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:19:03 user nova-compute[73917]:     </system>
Aug 26 19:19:03 user nova-compute[73917]:   </sysinfo>
Aug 26 19:19:03 user nova-compute[73917]:   <os>
Aug 26 19:19:03 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:19:03 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:19:03 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:19:03 user nova-compute[73917]:   </os>
Aug 26 19:19:03 user nova-compute[73917]:   <features>
Aug 26 19:19:03 user nova-compute[73917]:     <acpi/>
Aug 26 19:19:03 user nova-compute[73917]:     <apic/>
Aug 26 19:19:03 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:19:03 user nova-compute[73917]:   </features>
Aug 26 19:19:03 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:19:03 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:19:03 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:19:03 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:19:03 user nova-compute[73917]:   </clock>
Aug 26 19:19:03 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:19:03 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:19:03 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:19:03 user nova-compute[73917]:   </cpu>
Aug 26 19:19:03 user nova-compute[73917]:   <devices>
Aug 26 19:19:03 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:19:03 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:19:03 user nova-compute[73917]:       <source dev="/dev/sde"/>
Aug 26 19:19:03 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:19:03 user nova-compute[73917]:       <serial>4c062201-81b9-42d1-8ae2-5b6fe648bc2a</serial>
Aug 26 19:19:03 user nova-compute[73917]:     </disk>
Aug 26 19:19:03 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:19:03 user nova-compute[73917]:       <mac address="fa:16:3e:d9:5d:6b"/>
Aug 26 19:19:03 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:19:03 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:19:03 user nova-compute[73917]:       <target dev="tapaf8c2f16-54"/>
Aug 26 19:19:03 user nova-compute[73917]:     </interface>
Aug 26 19:19:03 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:19:03 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/4a2d91a5-9943-43f6-b919-30510ccba727/console.log" append="off"/>
Aug 26 19:19:03 user nova-compute[73917]:     </serial>
Aug 26 19:19:03 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:19:03 user nova-compute[73917]:     <video>
Aug 26 19:19:03 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:19:03 user nova-compute[73917]:     </video>
Aug 26 19:19:03 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:19:03 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:19:03 user nova-compute[73917]:     </rng>
Aug 26 19:19:03 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:19:03 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:19:03 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:19:03 user nova-compute[73917]:     </memballoon>
Aug 26 19:19:03 user nova-compute[73917]:   </devices>
Aug 26 19:19:03 user nova-compute[73917]: </domain>
Aug 26 19:19:03 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1428844380',display_name='tempest-ServerActionsTestOtherA-server-1428844380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1428844380',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoE8tZDc68JWUNde0nWnasqq1vYa5ON2YNQwHw+xO1EiolhKGRVVBiykxwLyvBezUmZpO4CsEARWWqkHIKpn0pTvCPDPPJIP+G7BbRXcHe4wp+29J3exWEnrrk3yPKzjg==',key_name='tempest-keypair-1254307896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2e09fe7b38e4bb991bfaaf5b4ad357a',ramdisk_id='',reservation_id='r-4dv3wxu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2069094918',owner_user_name='tempest-ServerActionsTestOtherA-2069094918-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd1b7d3fe22c4b239cf03235866e17d4',uuid=4a2d91a5-9943-43f6-b919-30510ccba727,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converting VIF {"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=af8c2f16-54b2-4a39-b893-e95b3794b8b1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c2f16-54') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG os_vif [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=af8c2f16-54b2-4a39-b893-e95b3794b8b1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c2f16-54') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf8c2f16-54, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf8c2f16-54, col_values=(('external_ids', {'iface-id': 'af8c2f16-54b2-4a39-b893-e95b3794b8b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:5d:6b', 'vm-uuid': '4a2d91a5-9943-43f6-b919-30510ccba727'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:03 user nova-compute[73917]: INFO os_vif [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=af8c2f16-54b2-4a39-b893-e95b3794b8b1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c2f16-54')
Aug 26 19:19:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:19:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] No VIF found with MAC fa:16:3e:d9:5d:6b, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:19:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:05 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:19:05 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=6691MB free_disk=25.19449234008789GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-6dbaa844-9101-4c1f-8374-8dd2b3157c2e req-1fd2edab-43e1-42a3-b3a7-f323c73cbd79 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Received event network-vif-plugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6dbaa844-9101-4c1f-8374-8dd2b3157c2e req-1fd2edab-43e1-42a3-b3a7-f323c73cbd79 service nova] Acquiring lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6dbaa844-9101-4c1f-8374-8dd2b3157c2e req-1fd2edab-43e1-42a3-b3a7-f323c73cbd79 service nova] Lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6dbaa844-9101-4c1f-8374-8dd2b3157c2e req-1fd2edab-43e1-42a3-b3a7-f323c73cbd79 service nova] Lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-6dbaa844-9101-4c1f-8374-8dd2b3157c2e req-1fd2edab-43e1-42a3-b3a7-f323c73cbd79 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] No waiting events found dispatching network-vif-plugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:19:05 user nova-compute[73917]: WARNING nova.compute.manager [req-6dbaa844-9101-4c1f-8374-8dd2b3157c2e req-1fd2edab-43e1-42a3-b3a7-f323c73cbd79 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Received unexpected event network-vif-plugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 for instance with vm_state building and task_state spawning.
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Applying migration context for instance dca28d65-37d0-4b60-b8aa-dcca61b6a187 as it has an incoming, in-progress migration 353ee397-ba9d-49a3-b4e1-13dc2a981649. Migration status is finished {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 19:19:05 user nova-compute[73917]: INFO nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Updating resource usage from migration 353ee397-ba9d-49a3-b4e1-13dc2a981649
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance cc0ae046-2a39-4ab6-9327-2d9452c3035d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fd801f18-34b6-4682-8d43-edf82bd216c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 481cc682-2004-434d-b4eb-1688b0b07dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 94f8d4e7-f310-45df-a0ae-82e608ac0119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance df5c717a-62d8-444d-9968-ad682a31733c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f4e84db3-1f3b-471f-9f82-5a692fdb6c06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Migration 353ee397-ba9d-49a3-b4e1-13dc2a981649 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance dca28d65-37d0-4b60-b8aa-dcca61b6a187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 75aea062-6df8-44a1-9c20-2bdd606748ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance dde8f1cd-d55b-49cf-a775-196cbc059fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c78c30ea-1190-44bc-bd78-b3655e251a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f486f10e-1cb0-47f6-b8f5-9cafe1c231f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 4a2d91a5-9943-43f6-b919-30510ccba727 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:19:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:19:06 user nova-compute[73917]: INFO nova.compute.manager [None req-c7d7139c-af34-4656-bf1f-bb4f35c3a661 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Unrescuing
Aug 26 19:19:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c7d7139c-af34-4656-bf1f-bb4f35c3a661 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "refresh_cache-df5c717a-62d8-444d-9968-ad682a31733c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:19:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c7d7139c-af34-4656-bf1f-bb4f35c3a661 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquired lock "refresh_cache-df5c717a-62d8-444d-9968-ad682a31733c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:19:06 user nova-compute[73917]: DEBUG nova.network.neutron [None req-c7d7139c-af34-4656-bf1f-bb4f35c3a661 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:19:06 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:19:06 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:19:06 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:19:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.669s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:06 user nova-compute[73917]: DEBUG nova.network.neutron [None req-c7d7139c-af34-4656-bf1f-bb4f35c3a661 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Updating instance_info_cache with network_info: [{"id": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "address": "fa:16:3e:ca:39:fd", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79ade91-3e", "ovs_interfaceid": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:19:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c7d7139c-af34-4656-bf1f-bb4f35c3a661 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Releasing lock "refresh_cache-df5c717a-62d8-444d-9968-ad682a31733c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:19:06 user nova-compute[73917]: DEBUG nova.objects.instance [None req-c7d7139c-af34-4656-bf1f-bb4f35c3a661 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'flavor' on Instance uuid df5c717a-62d8-444d-9968-ad682a31733c {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:19:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:06 user nova-compute[73917]: DEBUG nova.compute.manager [req-4d0a1c15-3ec7-4e2d-ad77-926d63a7efab req-a0c03e52-7497-44d9-8a4b-d56146afe3fd service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received event network-vif-unplugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:19:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4d0a1c15-3ec7-4e2d-ad77-926d63a7efab req-a0c03e52-7497-44d9-8a4b-d56146afe3fd service nova] Acquiring lock "df5c717a-62d8-444d-9968-ad682a31733c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4d0a1c15-3ec7-4e2d-ad77-926d63a7efab req-a0c03e52-7497-44d9-8a4b-d56146afe3fd service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4d0a1c15-3ec7-4e2d-ad77-926d63a7efab req-a0c03e52-7497-44d9-8a4b-d56146afe3fd service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:06 user nova-compute[73917]: DEBUG nova.compute.manager [req-4d0a1c15-3ec7-4e2d-ad77-926d63a7efab req-a0c03e52-7497-44d9-8a4b-d56146afe3fd service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] No waiting events found dispatching network-vif-unplugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:19:06 user nova-compute[73917]: WARNING nova.compute.manager [req-4d0a1c15-3ec7-4e2d-ad77-926d63a7efab req-a0c03e52-7497-44d9-8a4b-d56146afe3fd service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received unexpected event network-vif-unplugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:19:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:07 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Instance destroyed successfully.
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.compute.manager [req-be2d9370-47d0-4e7d-a660-c348fef2b0be req-f3df5b19-a408-4954-96d1-66634eabe4de service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Received event network-vif-plugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-be2d9370-47d0-4e7d-a660-c348fef2b0be req-f3df5b19-a408-4954-96d1-66634eabe4de service nova] Acquiring lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-be2d9370-47d0-4e7d-a660-c348fef2b0be req-f3df5b19-a408-4954-96d1-66634eabe4de service nova] Lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-be2d9370-47d0-4e7d-a660-c348fef2b0be req-f3df5b19-a408-4954-96d1-66634eabe4de service nova] Lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.compute.manager [req-be2d9370-47d0-4e7d-a660-c348fef2b0be req-f3df5b19-a408-4954-96d1-66634eabe4de service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] No waiting events found dispatching network-vif-plugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:19:07 user nova-compute[73917]: WARNING nova.compute.manager [req-be2d9370-47d0-4e7d-a660-c348fef2b0be req-f3df5b19-a408-4954-96d1-66634eabe4de service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Received unexpected event network-vif-plugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 for instance with vm_state building and task_state spawning.
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077547.588866, 4a2d91a5-9943-43f6-b919-30510ccba727 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:19:07 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] VM Resumed (Lifecycle Event)
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:19:07 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Instance spawned successfully.
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:19:07 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077547.590965, 4a2d91a5-9943-43f6-b919-30510ccba727 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:19:07 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] VM Started (Lifecycle Event)
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:19:07 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:19:07 user nova-compute[73917]: INFO nova.compute.manager [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Took 5.55 seconds to spawn the instance on the hypervisor.
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.network.neutron [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Port c63a3326-bd42-40f4-8559-b7f08e5f9a98 binding to destination host user is already ACTIVE {{(pid=73917) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquired lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:19:07 user nova-compute[73917]: DEBUG nova.network.neutron [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:19:07 user nova-compute[73917]: INFO nova.compute.manager [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Took 18.38 seconds to build instance.
Aug 26 19:19:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-876a6e3a-991b-4b50-ac71-ac0b82fb8fb1 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "4a2d91a5-9943-43f6-b919-30510ccba727" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.474s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:08 user nova-compute[73917]: DEBUG nova.network.neutron [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Updating instance_info_cache with network_info: [{"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:19:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Releasing lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:19:08 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Creating tmpfile /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/tmpuscsya7i to verify with other compute node that the instance is on the same shared storage. {{(pid=73917) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 26 19:19:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG nova.compute.manager [req-50d62f07-3bc8-4dd5-83be-917270a08c17 req-5cdf50dd-1969-4621-9786-3964deb3726b service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received event network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-50d62f07-3bc8-4dd5-83be-917270a08c17 req-5cdf50dd-1969-4621-9786-3964deb3726b service nova] Acquiring lock "df5c717a-62d8-444d-9968-ad682a31733c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-50d62f07-3bc8-4dd5-83be-917270a08c17 req-5cdf50dd-1969-4621-9786-3964deb3726b service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-50d62f07-3bc8-4dd5-83be-917270a08c17 req-5cdf50dd-1969-4621-9786-3964deb3726b service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG nova.compute.manager [req-50d62f07-3bc8-4dd5-83be-917270a08c17 req-5cdf50dd-1969-4621-9786-3964deb3726b service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] No waiting events found dispatching network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:19:09 user nova-compute[73917]: WARNING nova.compute.manager [req-50d62f07-3bc8-4dd5-83be-917270a08c17 req-5cdf50dd-1969-4621-9786-3964deb3726b service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received unexpected event network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:19:09 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Instance destroyed successfully.
Aug 26 19:19:09 user nova-compute[73917]: DEBUG nova.objects.instance [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lazy-loading 'resources' on Instance uuid dca28d65-37d0-4b60-b8aa-dcca61b6a187 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1165082774',display_name='tempest-ServerActionsTestOtherB-server-1165082774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1165082774',id=19,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf6A+tLmlhXN1ex/7jOISEFChezRDQZ5m7P/4PRHH+2Viff3bm+/OVarrZ0hky07ll3BRX4g048OhpV/rgYZ4nSom5KVv2Uu0RHTe6WT8eoSMJzatFMKJ/1TpRz/DQQnw==',key_name='tempest-keypair-2090853106',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:17:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36d3d1cb213442cc9a672abe4a5c2b61',ramdisk_id='',reservation_id='r-0fa34jg8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-824485866',owner_user_name='tempest-ServerActionsTestOtherB-824485866-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff1648bb2044c0e9fd90ece565c4e8e',uuid=dca28d65-37d0-4b60-b8aa-dcca61b6a187,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Converting VIF {"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG os_vif [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc63a3326-bd, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:19:09 user nova-compute[73917]: INFO os_vif [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd')
Aug 26 19:19:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjNosbWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:19:09 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:19:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ca0161-5643-4d0e-827d-c6bd70897471]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8c62f1-76c5-4ed2-95ea-d341db9f116f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:19:09 user nova-compute[73917]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:19:09 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:19:09 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:19:09 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:19:09 user nova-compute[73917]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:19:09 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:19:09 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:19:09 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b785651b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3'): ({'sdc'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Removing single pathed devices sdc {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[451373f1-e9de-424a-8ad7-9419f9f3b1c8]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9dedcc-9320-4d1f-8492-790168dbbc10]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Flushing IO for device /dev/sdc {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a81670-8bb1-429f-8476-bdbece7ddf31]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0012ead-b5ec-4875-9ec0-99cfaf12ef6d]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG nova.compute.manager [req-c89a63ba-c0b4-4171-aa55-250091ce01cd req-bdc27852-de3e-49d7-ace0-63bdb1afb3b2 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received event network-vif-unplugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c89a63ba-c0b4-4171-aa55-250091ce01cd req-bdc27852-de3e-49d7-ace0-63bdb1afb3b2 service nova] Acquiring lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c89a63ba-c0b4-4171-aa55-250091ce01cd req-bdc27852-de3e-49d7-ace0-63bdb1afb3b2 service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c89a63ba-c0b4-4171-aa55-250091ce01cd req-bdc27852-de3e-49d7-ace0-63bdb1afb3b2 service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG nova.compute.manager [req-c89a63ba-c0b4-4171-aa55-250091ce01cd req-bdc27852-de3e-49d7-ace0-63bdb1afb3b2 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] No waiting events found dispatching network-vif-unplugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:19:09 user nova-compute[73917]: WARNING nova.compute.manager [req-c89a63ba-c0b4-4171-aa55-250091ce01cd req-bdc27852-de3e-49d7-ace0-63bdb1afb3b2 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received unexpected event network-vif-unplugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 for instance with vm_state resized and task_state resize_reverting.
Aug 26 19:19:09 user nova-compute[73917]: DEBUG nova.compute.manager [req-c89a63ba-c0b4-4171-aa55-250091ce01cd req-bdc27852-de3e-49d7-ace0-63bdb1afb3b2 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received event network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c89a63ba-c0b4-4171-aa55-250091ce01cd req-bdc27852-de3e-49d7-ace0-63bdb1afb3b2 service nova] Acquiring lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c89a63ba-c0b4-4171-aa55-250091ce01cd req-bdc27852-de3e-49d7-ace0-63bdb1afb3b2 service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c89a63ba-c0b4-4171-aa55-250091ce01cd req-bdc27852-de3e-49d7-ace0-63bdb1afb3b2 service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG nova.compute.manager [req-c89a63ba-c0b4-4171-aa55-250091ce01cd req-bdc27852-de3e-49d7-ace0-63bdb1afb3b2 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] No waiting events found dispatching network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:19:09 user nova-compute[73917]: WARNING nova.compute.manager [req-c89a63ba-c0b4-4171-aa55-250091ce01cd req-bdc27852-de3e-49d7-ace0-63bdb1afb3b2 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received unexpected event network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 for instance with vm_state resized and task_state resize_reverting.
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d0ca59-3e67-41a0-9f05-d8a136ef2edf]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d43369-b3e2-4c89-b123-d37c41a249df]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260]
Aug 26 19:19:09 user nova-compute[73917]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260] successful.
Aug 26 19:19:09 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac11c5dc-3a8a-485f-8284-3a0e1c585738]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] <== disconnect_volume: return (328ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:19:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:19:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:10 user nova-compute[73917]: DEBUG nova.objects.instance [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lazy-loading 'migration_context' on Instance uuid dca28d65-37d0-4b60-b8aa-dcca61b6a187 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:19:10 user nova-compute[73917]: DEBUG nova.objects.base [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Object Instance<dca28d65-37d0-4b60-b8aa-dcca61b6a187> lazy-loaded attributes: resources,migration_context {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:19:11 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:19:11 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:19:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-b9d8a444-4ca8-419c-ba90-7758ffb34861 req-ef446689-e012-499d-8667-9d6b7453f732 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received event network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:19:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9d8a444-4ca8-419c-ba90-7758ffb34861 req-ef446689-e012-499d-8667-9d6b7453f732 service nova] Acquiring lock "df5c717a-62d8-444d-9968-ad682a31733c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9d8a444-4ca8-419c-ba90-7758ffb34861 req-ef446689-e012-499d-8667-9d6b7453f732 service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9d8a444-4ca8-419c-ba90-7758ffb34861 req-ef446689-e012-499d-8667-9d6b7453f732 service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-b9d8a444-4ca8-419c-ba90-7758ffb34861 req-ef446689-e012-499d-8667-9d6b7453f732 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] No waiting events found dispatching network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:19:11 user nova-compute[73917]: WARNING nova.compute.manager [req-b9d8a444-4ca8-419c-ba90-7758ffb34861 req-ef446689-e012-499d-8667-9d6b7453f732 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received unexpected event network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:19:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-b9d8a444-4ca8-419c-ba90-7758ffb34861 req-ef446689-e012-499d-8667-9d6b7453f732 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received event network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:19:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9d8a444-4ca8-419c-ba90-7758ffb34861 req-ef446689-e012-499d-8667-9d6b7453f732 service nova] Acquiring lock "df5c717a-62d8-444d-9968-ad682a31733c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9d8a444-4ca8-419c-ba90-7758ffb34861 req-ef446689-e012-499d-8667-9d6b7453f732 service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9d8a444-4ca8-419c-ba90-7758ffb34861 req-ef446689-e012-499d-8667-9d6b7453f732 service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-b9d8a444-4ca8-419c-ba90-7758ffb34861 req-ef446689-e012-499d-8667-9d6b7453f732 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] No waiting events found dispatching network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:19:11 user nova-compute[73917]: WARNING nova.compute.manager [req-b9d8a444-4ca8-419c-ba90-7758ffb34861 req-ef446689-e012-499d-8667-9d6b7453f732 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received unexpected event network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:19:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.594s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:11 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Removed pending event for df5c717a-62d8-444d-9968-ad682a31733c due to event {{(pid=73917) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 19:19:11 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077551.3346977, df5c717a-62d8-444d-9968-ad682a31733c => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:19:11 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] VM Resumed (Lifecycle Event)
Aug 26 19:19:11 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c7d7139c-af34-4656-bf1f-bb4f35c3a661 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:19:11 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:19:11 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:19:11 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 19:19:11 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077551.3350124, df5c717a-62d8-444d-9968-ad682a31733c => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:19:11 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] VM Started (Lifecycle Event)
Aug 26 19:19:11 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:19:11 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:19:11 user nova-compute[73917]: INFO nova.compute.manager [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Swapping old allocation on dict_keys(['d90ad23a-e063-4f0d-8341-c34e0141d16a']) held by migration 353ee397-ba9d-49a3-b4e1-13dc2a981649 for instance
Aug 26 19:19:11 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Overwriting current allocation {'allocations': {'d90ad23a-e063-4f0d-8341-c34e0141d16a': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 35}}, 'project_id': '36d3d1cb213442cc9a672abe4a5c2b61', 'user_id': '0ff1648bb2044c0e9fd90ece565c4e8e', 'consumer_generation': 1} on consumer dca28d65-37d0-4b60-b8aa-dcca61b6a187 {{(pid=73917) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 26 19:19:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:19:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquired lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:19:11 user nova-compute[73917]: DEBUG nova.network.neutron [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG nova.network.neutron [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Updating instance_info_cache with network_info: [{"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Releasing lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG os_brick.utils [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d23d4aa-3eaf-4135-b76b-ca8a84bb6b40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca63176-ac29-4509-b611-2901764df511]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb962843-16ee-4c48-95ed-ab40d160a9f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cdfbf4-1247-4f79-bafd-492932d5e046]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:19:12 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:19:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67f21e5-14ff-4af2-adf6-2ec9bc0e4037]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:19:12 user nova-compute[73917]: DEBUG os_brick.utils [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:19:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:24 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077549.3832824, dca28d65-37d0-4b60-b8aa-dcca61b6a187 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:19:24 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] VM Stopped (Lifecycle Event)
Aug 26 19:19:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-16957169-bf6e-4e23-8226-0ad4badacabb None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:19:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Starting finish_revert_migration {{(pid=73917) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Start _get_guest_xml network_info=[{"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjNosbWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'dca28d65-37d0-4b60-b8aa-dcca61b6a187', 'attached_at': '2023-08-26T19:19:30.000000', 'detached_at': '', 'volume_id': '15a7f1e0-2183-4228-bec3-0489f0238cd3', 'serial': '15a7f1e0-2183-4228-bec3-0489f0238cd3'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': 'e798542f-0f57-4822-b371-4626c4c76fa2', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:19:30 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:19:30 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.objects.instance [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lazy-loading 'vcpu_model' on Instance uuid dca28d65-37d0-4b60-b8aa-dcca61b6a187 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjNosbWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:19:30 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:19:30 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:19:30 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acb7312-c316-4923-8f82-39903ca6650c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:19:30 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4e5763-d8fc-41a0-92d1-12bcab06c9a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3] added
Aug 26 19:19:30 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f405986c-8edb-4741-a33a-9c40d523cb73]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe688797-ca5d-4598-9cdd-6f6850c6a601]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LjNosbWr {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LjNosbWr" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2f875d-8402-4a7c-ba35-9e54a39fdcb0]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LjNosbWr'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a574fbb-7b7e-4d77-acdc-73d902a17977]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f533de23-6b7d-4b8a-9f88-f91c92034880]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:19:30 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:19:30 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:19:30 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:19:30 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:19:30 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:19:30 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c566a0f-4a82-404b-99ac-98f607d741aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260]
Aug 26 19:19:30 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260] successful.
Aug 26 19:19:30 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd147d3-8ff1-446a-87d1-25e61d894af5]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3ac31c-ce40-4833-a3ff-74749ff2a1bd]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:19:30 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:19:30 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:19:30 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:19:30 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:19:30 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:19:30 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:19:30 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:19:30 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e532df-1897-4adb-bee4-1612a070f52b]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: None {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:30 user nova-compute[73917]: INFO nova.compute.manager [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Terminating instance
Aug 26 19:19:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-392ab262-fb97-4119-be26-423ad704c9d8 req-d73007a7-ebaf-499b-810f-5b5046ac521e service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Received event network-vif-unplugged-a3c97057-1f39-49d8-9f1b-d0f2deea9357 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-392ab262-fb97-4119-be26-423ad704c9d8 req-d73007a7-ebaf-499b-810f-5b5046ac521e service nova] Acquiring lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-392ab262-fb97-4119-be26-423ad704c9d8 req-d73007a7-ebaf-499b-810f-5b5046ac521e service nova] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-392ab262-fb97-4119-be26-423ad704c9d8 req-d73007a7-ebaf-499b-810f-5b5046ac521e service nova] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-392ab262-fb97-4119-be26-423ad704c9d8 req-d73007a7-ebaf-499b-810f-5b5046ac521e service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] No waiting events found dispatching network-vif-unplugged-a3c97057-1f39-49d8-9f1b-d0f2deea9357 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-392ab262-fb97-4119-be26-423ad704c9d8 req-d73007a7-ebaf-499b-810f-5b5046ac521e service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Received event network-vif-unplugged-a3c97057-1f39-49d8-9f1b-d0f2deea9357 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:19:31 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Instance destroyed successfully.
Aug 26 19:19:31 user nova-compute[73917]: DEBUG nova.objects.instance [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lazy-loading 'resources' on Instance uuid f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1875469590',display_name='tempest-VolumesAdminNegativeTest-server-1875469590',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1875469590',id=20,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbjm7JS4q/8toEgXFvtecKsTaTn6+0tO+zq53jbF0asEVsqn8iNixnaqsykdR3I/9JMwF8lXGApzEWMk97vzNvwu0lksZWsZBCC5GLvrZ0yPI8mvhBOD/F9QHvU2MLJCw==',key_name='tempest-keypair-741700897',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:13:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5f7803cd6f44ed19fe59bd7286b6498',ramdisk_id='',reservation_id='r-unwj6nst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-13801866',owner_user_name='tempest-VolumesAdminNegativeTest-13801866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:13:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4db077369ef04a9eb5c0654b96550468',uuid=f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "address": "fa:16:3e:dd:b4:69", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c97057-1f", "ovs_interfaceid": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Converting VIF {"id": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "address": "fa:16:3e:dd:b4:69", "network": {"id": "7da3a70d-3593-4f44-8572-3ae03e3cf9c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-77144322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5f7803cd6f44ed19fe59bd7286b6498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c97057-1f", "ovs_interfaceid": "a3c97057-1f39-49d8-9f1b-d0f2deea9357", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:b4:69,bridge_name='br-int',has_traffic_filtering=True,id=a3c97057-1f39-49d8-9f1b-d0f2deea9357,network=Network(7da3a70d-3593-4f44-8572-3ae03e3cf9c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c97057-1f') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG os_vif [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:b4:69,bridge_name='br-int',has_traffic_filtering=True,id=a3c97057-1f39-49d8-9f1b-d0f2deea9357,network=Network(7da3a70d-3593-4f44-8572-3ae03e3cf9c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c97057-1f') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3c97057-1f, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:31 user nova-compute[73917]: INFO os_vif [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:b4:69,bridge_name='br-int',has_traffic_filtering=True,id=a3c97057-1f39-49d8-9f1b-d0f2deea9357,network=Network(7da3a70d-3593-4f44-8572-3ae03e3cf9c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c97057-1f')
Aug 26 19:19:31 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Deleting instance files /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10_del
Aug 26 19:19:31 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Deletion of /opt/stack/data/nova/instances/f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10_del complete
Aug 26 19:19:31 user nova-compute[73917]: INFO nova.compute.manager [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 19:19:31 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjNosbWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26464326433623030', 'path': '/dev/sdc'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464326433623030', 'path': '/dev/sdc'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1165082774',display_name='tempest-ServerActionsTestOtherB-server-1165082774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1165082774',id=19,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf6A+tLmlhXN1ex/7jOISEFChezRDQZ5m7P/4PRHH+2Viff3bm+/OVarrZ0hky07ll3BRX4g048OhpV/rgYZ4nSom5KVv2Uu0RHTe6WT8eoSMJzatFMKJ/1TpRz/DQQnw==',key_name='tempest-keypair-2090853106',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:17:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='36d3d1cb213442cc9a672abe4a5c2b61',ramdisk_id='',reservation_id='r-0fa34jg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-824485866',owner_user_name='tempest-ServerActionsTestOtherB-824485866-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff1648bb2044c0e9fd90ece565c4e8e',uuid=dca28d65-37d0-4b60-b8aa-dcca61b6a187,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Converting VIF {"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:19:31 user nova-compute[73917]:   <uuid>dca28d65-37d0-4b60-b8aa-dcca61b6a187</uuid>
Aug 26 19:19:31 user nova-compute[73917]:   <name>instance-00000013</name>
Aug 26 19:19:31 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:19:31 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:19:31 user nova-compute[73917]:   <metadata>
Aug 26 19:19:31 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:19:31 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:19:31 user nova-compute[73917]:       <nova:name>tempest-ServerActionsTestOtherB-server-1165082774</nova:name>
Aug 26 19:19:31 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:19:30</nova:creationTime>
Aug 26 19:19:31 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:19:31 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:19:31 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:19:31 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:19:31 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:19:31 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:19:31 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:19:31 user nova-compute[73917]:       <nova:owner>
Aug 26 19:19:31 user nova-compute[73917]:         <nova:user uuid="0ff1648bb2044c0e9fd90ece565c4e8e">tempest-ServerActionsTestOtherB-824485866-project-member</nova:user>
Aug 26 19:19:31 user nova-compute[73917]:         <nova:project uuid="36d3d1cb213442cc9a672abe4a5c2b61">tempest-ServerActionsTestOtherB-824485866</nova:project>
Aug 26 19:19:31 user nova-compute[73917]:       </nova:owner>
Aug 26 19:19:31 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:19:31 user nova-compute[73917]:       <nova:ports>
Aug 26 19:19:31 user nova-compute[73917]:         <nova:port uuid="c63a3326-bd42-40f4-8559-b7f08e5f9a98">
Aug 26 19:19:31 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 19:19:31 user nova-compute[73917]:         </nova:port>
Aug 26 19:19:31 user nova-compute[73917]:       </nova:ports>
Aug 26 19:19:31 user nova-compute[73917]:     </nova:instance>
Aug 26 19:19:31 user nova-compute[73917]:   </metadata>
Aug 26 19:19:31 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:19:31 user nova-compute[73917]:     <system>
Aug 26 19:19:31 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:19:31 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:19:31 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:19:31 user nova-compute[73917]:       <entry name="serial">dca28d65-37d0-4b60-b8aa-dcca61b6a187</entry>
Aug 26 19:19:31 user nova-compute[73917]:       <entry name="uuid">dca28d65-37d0-4b60-b8aa-dcca61b6a187</entry>
Aug 26 19:19:31 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:19:31 user nova-compute[73917]:     </system>
Aug 26 19:19:31 user nova-compute[73917]:   </sysinfo>
Aug 26 19:19:31 user nova-compute[73917]:   <os>
Aug 26 19:19:31 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:19:31 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:19:31 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:19:31 user nova-compute[73917]:   </os>
Aug 26 19:19:31 user nova-compute[73917]:   <features>
Aug 26 19:19:31 user nova-compute[73917]:     <acpi/>
Aug 26 19:19:31 user nova-compute[73917]:     <apic/>
Aug 26 19:19:31 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:19:31 user nova-compute[73917]:   </features>
Aug 26 19:19:31 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:19:31 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:19:31 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:19:31 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:19:31 user nova-compute[73917]:   </clock>
Aug 26 19:19:31 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:19:31 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:19:31 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:19:31 user nova-compute[73917]:   </cpu>
Aug 26 19:19:31 user nova-compute[73917]:   <devices>
Aug 26 19:19:31 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:19:31 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:19:31 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk"/>
Aug 26 19:19:31 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:19:31 user nova-compute[73917]:     </disk>
Aug 26 19:19:31 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:19:31 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:19:31 user nova-compute[73917]:       <source dev="/dev/sdc"/>
Aug 26 19:19:31 user nova-compute[73917]:       <target dev="vdb" bus="virtio"/>
Aug 26 19:19:31 user nova-compute[73917]:       <serial>15a7f1e0-2183-4228-bec3-0489f0238cd3</serial>
Aug 26 19:19:31 user nova-compute[73917]:     </disk>
Aug 26 19:19:31 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:19:31 user nova-compute[73917]:       <mac address="fa:16:3e:14:4e:59"/>
Aug 26 19:19:31 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:19:31 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:19:31 user nova-compute[73917]:       <target dev="tapc63a3326-bd"/>
Aug 26 19:19:31 user nova-compute[73917]:     </interface>
Aug 26 19:19:31 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:19:31 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/console.log" append="off"/>
Aug 26 19:19:31 user nova-compute[73917]:     </serial>
Aug 26 19:19:31 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:19:31 user nova-compute[73917]:     <video>
Aug 26 19:19:31 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:19:31 user nova-compute[73917]:     </video>
Aug 26 19:19:31 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:19:31 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:19:31 user nova-compute[73917]:     </rng>
Aug 26 19:19:31 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:19:31 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:19:31 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:19:31 user nova-compute[73917]:     </memballoon>
Aug 26 19:19:31 user nova-compute[73917]:   </devices>
Aug 26 19:19:31 user nova-compute[73917]: </domain>
Aug 26 19:19:31 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1165082774',display_name='tempest-ServerActionsTestOtherB-server-1165082774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1165082774',id=19,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf6A+tLmlhXN1ex/7jOISEFChezRDQZ5m7P/4PRHH+2Viff3bm+/OVarrZ0hky07ll3BRX4g048OhpV/rgYZ4nSom5KVv2Uu0RHTe6WT8eoSMJzatFMKJ/1TpRz/DQQnw==',key_name='tempest-keypair-2090853106',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:17:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='36d3d1cb213442cc9a672abe4a5c2b61',ramdisk_id='',reservation_id='r-0fa34jg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-824485866',owner_user_name='tempest-ServerActionsTestOtherB-824485866-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff1648bb2044c0e9fd90ece565c4e8e',uuid=dca28d65-37d0-4b60-b8aa-dcca61b6a187,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Converting VIF {"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG os_vif [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc63a3326-bd, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc63a3326-bd, col_values=(('external_ids', {'iface-id': 'c63a3326-bd42-40f4-8559-b7f08e5f9a98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:4e:59', 'vm-uuid': 'dca28d65-37d0-4b60-b8aa-dcca61b6a187'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:31 user nova-compute[73917]: INFO os_vif [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd')
Aug 26 19:19:31 user nova-compute[73917]: INFO nova.compute.manager [None req-0b46e27a-3e35-4497-8c29-3c94e321f527 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Unrescuing
Aug 26 19:19:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0b46e27a-3e35-4497-8c29-3c94e321f527 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0b46e27a-3e35-4497-8c29-3c94e321f527 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquired lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:19:31 user nova-compute[73917]: DEBUG nova.network.neutron [None req-0b46e27a-3e35-4497-8c29-3c94e321f527 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:19:32 user nova-compute[73917]: DEBUG nova.network.neutron [None req-0b46e27a-3e35-4497-8c29-3c94e321f527 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Updating instance_info_cache with network_info: [{"id": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "address": "fa:16:3e:25:d1:18", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ef21a0-d0", "ovs_interfaceid": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:19:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0b46e27a-3e35-4497-8c29-3c94e321f527 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Releasing lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:19:32 user nova-compute[73917]: DEBUG nova.objects.instance [None req-0b46e27a-3e35-4497-8c29-3c94e321f527 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'flavor' on Instance uuid f4e84db3-1f3b-471f-9f82-5a692fdb6c06 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:19:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-27c713e6-409d-484b-9dda-71a646fb35c0 req-769078c5-f6e8-469a-aa5e-ee13bf711f0e service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received event network-vif-unplugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-27c713e6-409d-484b-9dda-71a646fb35c0 req-769078c5-f6e8-469a-aa5e-ee13bf711f0e service nova] Acquiring lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-27c713e6-409d-484b-9dda-71a646fb35c0 req-769078c5-f6e8-469a-aa5e-ee13bf711f0e service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-27c713e6-409d-484b-9dda-71a646fb35c0 req-769078c5-f6e8-469a-aa5e-ee13bf711f0e service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-27c713e6-409d-484b-9dda-71a646fb35c0 req-769078c5-f6e8-469a-aa5e-ee13bf711f0e service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] No waiting events found dispatching network-vif-unplugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:19:33 user nova-compute[73917]: WARNING nova.compute.manager [req-27c713e6-409d-484b-9dda-71a646fb35c0 req-769078c5-f6e8-469a-aa5e-ee13bf711f0e service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received unexpected event network-vif-unplugged-c7ef21a0-d036-4b14-8067-594a1f2181ba for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:19:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-79adfda4-e96b-4b76-9c94-0dc639d43e6c req-300092b3-688a-493a-bd14-d27663fb42d1 service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Received event network-vif-plugged-a3c97057-1f39-49d8-9f1b-d0f2deea9357 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-79adfda4-e96b-4b76-9c94-0dc639d43e6c req-300092b3-688a-493a-bd14-d27663fb42d1 service nova] Acquiring lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-79adfda4-e96b-4b76-9c94-0dc639d43e6c req-300092b3-688a-493a-bd14-d27663fb42d1 service nova] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-79adfda4-e96b-4b76-9c94-0dc639d43e6c req-300092b3-688a-493a-bd14-d27663fb42d1 service nova] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-79adfda4-e96b-4b76-9c94-0dc639d43e6c req-300092b3-688a-493a-bd14-d27663fb42d1 service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] No waiting events found dispatching network-vif-plugged-a3c97057-1f39-49d8-9f1b-d0f2deea9357 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:19:33 user nova-compute[73917]: WARNING nova.compute.manager [req-79adfda4-e96b-4b76-9c94-0dc639d43e6c req-300092b3-688a-493a-bd14-d27663fb42d1 service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Received unexpected event network-vif-plugged-a3c97057-1f39-49d8-9f1b-d0f2deea9357 for instance with vm_state active and task_state deleting.
Aug 26 19:19:33 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:19:33 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Took 1.81 seconds to deallocate network for instance.
Aug 26 19:19:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:33 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Instance destroyed successfully.
Aug 26 19:19:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:19:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:34 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Deleted allocations for instance f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10
Aug 26 19:19:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5649e7b7-05d9-45c1-a120-27e3d711e5fb tempest-VolumesAdminNegativeTest-13801866 tempest-VolumesAdminNegativeTest-13801866-project-member] Lock "f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.408s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-f1472842-a342-497d-8784-f9388d84d06b req-3aff086b-7552-44ed-adad-feeacf904610 service nova] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Received event network-vif-deleted-a3c97057-1f39-49d8-9f1b-d0f2deea9357 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:19:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-f1472842-a342-497d-8784-f9388d84d06b req-3aff086b-7552-44ed-adad-feeacf904610 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received event network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:19:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f1472842-a342-497d-8784-f9388d84d06b req-3aff086b-7552-44ed-adad-feeacf904610 service nova] Acquiring lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f1472842-a342-497d-8784-f9388d84d06b req-3aff086b-7552-44ed-adad-feeacf904610 service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f1472842-a342-497d-8784-f9388d84d06b req-3aff086b-7552-44ed-adad-feeacf904610 service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-f1472842-a342-497d-8784-f9388d84d06b req-3aff086b-7552-44ed-adad-feeacf904610 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] No waiting events found dispatching network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:19:35 user nova-compute[73917]: WARNING nova.compute.manager [req-f1472842-a342-497d-8784-f9388d84d06b req-3aff086b-7552-44ed-adad-feeacf904610 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received unexpected event network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:19:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-f1472842-a342-497d-8784-f9388d84d06b req-3aff086b-7552-44ed-adad-feeacf904610 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received event network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:19:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f1472842-a342-497d-8784-f9388d84d06b req-3aff086b-7552-44ed-adad-feeacf904610 service nova] Acquiring lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f1472842-a342-497d-8784-f9388d84d06b req-3aff086b-7552-44ed-adad-feeacf904610 service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f1472842-a342-497d-8784-f9388d84d06b req-3aff086b-7552-44ed-adad-feeacf904610 service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-f1472842-a342-497d-8784-f9388d84d06b req-3aff086b-7552-44ed-adad-feeacf904610 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] No waiting events found dispatching network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:19:35 user nova-compute[73917]: WARNING nova.compute.manager [req-f1472842-a342-497d-8784-f9388d84d06b req-3aff086b-7552-44ed-adad-feeacf904610 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received unexpected event network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 for instance with vm_state resized and task_state resize_reverting.
Aug 26 19:19:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-f1472842-a342-497d-8784-f9388d84d06b req-3aff086b-7552-44ed-adad-feeacf904610 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received event network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:19:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f1472842-a342-497d-8784-f9388d84d06b req-3aff086b-7552-44ed-adad-feeacf904610 service nova] Acquiring lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f1472842-a342-497d-8784-f9388d84d06b req-3aff086b-7552-44ed-adad-feeacf904610 service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f1472842-a342-497d-8784-f9388d84d06b req-3aff086b-7552-44ed-adad-feeacf904610 service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-f1472842-a342-497d-8784-f9388d84d06b req-3aff086b-7552-44ed-adad-feeacf904610 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] No waiting events found dispatching network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:19:35 user nova-compute[73917]: WARNING nova.compute.manager [req-f1472842-a342-497d-8784-f9388d84d06b req-3aff086b-7552-44ed-adad-feeacf904610 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received unexpected event network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 for instance with vm_state resized and task_state resize_reverting.
Aug 26 19:19:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-80b1186c-6b96-495f-97ff-3de01894557d req-dbd3c972-0010-4f14-987e-4e760d57f919 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Received event network-changed-79cb97b7-c220-40a7-aece-1ccacda973b6 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:19:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-80b1186c-6b96-495f-97ff-3de01894557d req-dbd3c972-0010-4f14-987e-4e760d57f919 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Refreshing instance network info cache due to event network-changed-79cb97b7-c220-40a7-aece-1ccacda973b6. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:19:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-80b1186c-6b96-495f-97ff-3de01894557d req-dbd3c972-0010-4f14-987e-4e760d57f919 service nova] Acquiring lock "refresh_cache-75aea062-6df8-44a1-9c20-2bdd606748ab" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:19:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-80b1186c-6b96-495f-97ff-3de01894557d req-dbd3c972-0010-4f14-987e-4e760d57f919 service nova] Acquired lock "refresh_cache-75aea062-6df8-44a1-9c20-2bdd606748ab" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:19:36 user nova-compute[73917]: DEBUG nova.network.neutron [req-80b1186c-6b96-495f-97ff-3de01894557d req-dbd3c972-0010-4f14-987e-4e760d57f919 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Refreshing network info cache for port 79cb97b7-c220-40a7-aece-1ccacda973b6 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:19:36 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077576.6505141, dca28d65-37d0-4b60-b8aa-dcca61b6a187 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:19:36 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] VM Resumed (Lifecycle Event)
Aug 26 19:19:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:19:36 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Instance running successfully.
Aug 26 19:19:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] finish_revert_migration finished successfully. {{(pid=73917) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 26 19:19:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:19:36 user nova-compute[73917]: DEBUG nova.network.neutron [req-80b1186c-6b96-495f-97ff-3de01894557d req-dbd3c972-0010-4f14-987e-4e760d57f919 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Updated VIF entry in instance network info cache for port 79cb97b7-c220-40a7-aece-1ccacda973b6. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:19:36 user nova-compute[73917]: DEBUG nova.network.neutron [req-80b1186c-6b96-495f-97ff-3de01894557d req-dbd3c972-0010-4f14-987e-4e760d57f919 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Updating instance_info_cache with network_info: [{"id": "79cb97b7-c220-40a7-aece-1ccacda973b6", "address": "fa:16:3e:40:11:d1", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb97b7-c2", "ovs_interfaceid": "79cb97b7-c220-40a7-aece-1ccacda973b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:19:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:19:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-80b1186c-6b96-495f-97ff-3de01894557d req-dbd3c972-0010-4f14-987e-4e760d57f919 service nova] Releasing lock "refresh_cache-75aea062-6df8-44a1-9c20-2bdd606748ab" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:19:36 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 19:19:36 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077576.6561005, dca28d65-37d0-4b60-b8aa-dcca61b6a187 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:19:36 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] VM Started (Lifecycle Event)
Aug 26 19:19:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:19:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:19:36 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 19:19:36 user nova-compute[73917]: INFO nova.compute.manager [None req-3f8ffd5e-cdf1-4a87-b720-544ef30f01ad tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Updating instance to original state: 'active'
Aug 26 19:19:37 user nova-compute[73917]: DEBUG nova.compute.manager [req-79e4d4b4-2fd3-46f1-881b-8c7f7e016e24 req-f1ca00d2-fb17-4be7-b8ae-b407a1d1bce6 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received event network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:19:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-79e4d4b4-2fd3-46f1-881b-8c7f7e016e24 req-f1ca00d2-fb17-4be7-b8ae-b407a1d1bce6 service nova] Acquiring lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-79e4d4b4-2fd3-46f1-881b-8c7f7e016e24 req-f1ca00d2-fb17-4be7-b8ae-b407a1d1bce6 service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-79e4d4b4-2fd3-46f1-881b-8c7f7e016e24 req-f1ca00d2-fb17-4be7-b8ae-b407a1d1bce6 service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:37 user nova-compute[73917]: DEBUG nova.compute.manager [req-79e4d4b4-2fd3-46f1-881b-8c7f7e016e24 req-f1ca00d2-fb17-4be7-b8ae-b407a1d1bce6 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] No waiting events found dispatching network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:19:37 user nova-compute[73917]: WARNING nova.compute.manager [req-79e4d4b4-2fd3-46f1-881b-8c7f7e016e24 req-f1ca00d2-fb17-4be7-b8ae-b407a1d1bce6 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received unexpected event network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:19:37 user nova-compute[73917]: DEBUG nova.compute.manager [req-79e4d4b4-2fd3-46f1-881b-8c7f7e016e24 req-f1ca00d2-fb17-4be7-b8ae-b407a1d1bce6 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received event network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:19:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-79e4d4b4-2fd3-46f1-881b-8c7f7e016e24 req-f1ca00d2-fb17-4be7-b8ae-b407a1d1bce6 service nova] Acquiring lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-79e4d4b4-2fd3-46f1-881b-8c7f7e016e24 req-f1ca00d2-fb17-4be7-b8ae-b407a1d1bce6 service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-79e4d4b4-2fd3-46f1-881b-8c7f7e016e24 req-f1ca00d2-fb17-4be7-b8ae-b407a1d1bce6 service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:37 user nova-compute[73917]: DEBUG nova.compute.manager [req-79e4d4b4-2fd3-46f1-881b-8c7f7e016e24 req-f1ca00d2-fb17-4be7-b8ae-b407a1d1bce6 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] No waiting events found dispatching network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:19:37 user nova-compute[73917]: WARNING nova.compute.manager [req-79e4d4b4-2fd3-46f1-881b-8c7f7e016e24 req-f1ca00d2-fb17-4be7-b8ae-b407a1d1bce6 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received unexpected event network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:19:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Removed pending event for f4e84db3-1f3b-471f-9f82-5a692fdb6c06 due to event {{(pid=73917) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 19:19:37 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077577.5005412, f4e84db3-1f3b-471f-9f82-5a692fdb6c06 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:19:37 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] VM Resumed (Lifecycle Event)
Aug 26 19:19:37 user nova-compute[73917]: DEBUG nova.compute.manager [None req-0b46e27a-3e35-4497-8c29-3c94e321f527 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:19:37 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:19:37 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:19:37 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 19:19:37 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077577.504719, f4e84db3-1f3b-471f-9f82-5a692fdb6c06 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:19:37 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] VM Started (Lifecycle Event)
Aug 26 19:19:37 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:19:37 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:19:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "75aea062-6df8-44a1-9c20-2bdd606748ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG nova.objects.instance [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'flavor' on Instance uuid 75aea062-6df8-44a1-9c20-2bdd606748ab {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "75aea062-6df8-44a1-9c20-2bdd606748ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:41 user nova-compute[73917]: INFO nova.compute.manager [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Attaching volume b60fe9f7-bed7-48c6-91d5-b4af95dfa71f to /dev/vdb
Aug 26 19:19:41 user nova-compute[73917]: DEBUG os_brick.utils [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfa8377-306f-415f-8a2f-2780d401c565]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8390d518-ba84-422b-9700-9a664fe28aae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2beebb-6120-412b-9988-5c8a63a90003]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec79edb-c0da-4a4c-bdb5-6d60a672b52d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:19:41 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:19:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bd0e23-dbce-4fbe-b84a-408d96a187a1]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG os_brick.utils [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Updating existing volume attachment record: 84995ede-7628-41b7-a441-95ae12f8b896 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:19:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:43 user nova-compute[73917]: DEBUG nova.compute.manager [req-fb9729e7-5e80-4102-b4d9-4988e6d690d7 req-8ba00ca9-81b0-47f6-a035-2bd345038829 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Received event network-changed-3e638e90-1dab-4162-ab6b-6e537238b027 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:19:43 user nova-compute[73917]: DEBUG nova.compute.manager [req-fb9729e7-5e80-4102-b4d9-4988e6d690d7 req-8ba00ca9-81b0-47f6-a035-2bd345038829 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Refreshing instance network info cache due to event network-changed-3e638e90-1dab-4162-ab6b-6e537238b027. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:19:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fb9729e7-5e80-4102-b4d9-4988e6d690d7 req-8ba00ca9-81b0-47f6-a035-2bd345038829 service nova] Acquiring lock "refresh_cache-dde8f1cd-d55b-49cf-a775-196cbc059fa9" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:19:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fb9729e7-5e80-4102-b4d9-4988e6d690d7 req-8ba00ca9-81b0-47f6-a035-2bd345038829 service nova] Acquired lock "refresh_cache-dde8f1cd-d55b-49cf-a775-196cbc059fa9" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:19:43 user nova-compute[73917]: DEBUG nova.network.neutron [req-fb9729e7-5e80-4102-b4d9-4988e6d690d7 req-8ba00ca9-81b0-47f6-a035-2bd345038829 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Refreshing network info cache for port 3e638e90-1dab-4162-ab6b-6e537238b027 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:19:44 user nova-compute[73917]: DEBUG nova.network.neutron [req-fb9729e7-5e80-4102-b4d9-4988e6d690d7 req-8ba00ca9-81b0-47f6-a035-2bd345038829 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Updated VIF entry in instance network info cache for port 3e638e90-1dab-4162-ab6b-6e537238b027. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:19:44 user nova-compute[73917]: DEBUG nova.network.neutron [req-fb9729e7-5e80-4102-b4d9-4988e6d690d7 req-8ba00ca9-81b0-47f6-a035-2bd345038829 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Updating instance_info_cache with network_info: [{"id": "3e638e90-1dab-4162-ab6b-6e537238b027", "address": "fa:16:3e:ec:3c:4a", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e638e90-1d", "ovs_interfaceid": "3e638e90-1dab-4162-ab6b-6e537238b027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:19:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fb9729e7-5e80-4102-b4d9-4988e6d690d7 req-8ba00ca9-81b0-47f6-a035-2bd345038829 service nova] Releasing lock "refresh_cache-dde8f1cd-d55b-49cf-a775-196cbc059fa9" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:19:46 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077571.4630535, f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:19:46 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] VM Stopped (Lifecycle Event)
Aug 26 19:19:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-48729be3-a5d8-415e-b950-6389e271a392 None None] [instance: f2d5cf69-b4b7-4064-8ba5-0ee66ba9ca10] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:19:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:48 user nova-compute[73917]: DEBUG nova.objects.instance [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lazy-loading 'flavor' on Instance uuid dde8f1cd-d55b-49cf-a775-196cbc059fa9 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:19:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:19:49 user nova-compute[73917]: INFO nova.compute.manager [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Attaching volume b186a5b3-25ae-4fa0-8c21-2df80757f347 to /dev/vdb
Aug 26 19:19:49 user nova-compute[73917]: DEBUG os_brick.utils [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ff1cc0-3156-4d79-b379-88d12295dd34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e90bdf-0dce-4375-8452-afd98ed71ba3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de0707e-5288-41ca-be97-2695f5e59e6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[db03bd29-77dc-46cd-be42-ce745ec8b4be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:19:49 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:19:49 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[087aaf94-2b95-44c8-b026-8715bd139ba0]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG os_brick.utils [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:19:49 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Updating existing volume attachment record: 7d8b71d4-05e5-442c-89f5-405970b6d578 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:19:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ysSfrMkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:19:54 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:19:54 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:19:54 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad65e2d-439e-4795-8b83-0c3be5b4f84b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:19:54 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6370644f-4e6f-4103-979a-4deb82f42d4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f] added
Aug 26 19:19:54 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[20eea1d6-89c6-4def-bb51-c25bae554ce4]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca0f133-2fab-40b4-813c-9b603ab87d42]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ysSfrMkg {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ysSfrMkg" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[606a7284-17ac-42e4-9a06-67df82872280]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ysSfrMkg'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f699e8-36cf-4b7f-a277-977a973c5edb]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d46c215-ffc4-4eb8-9084-ecab6ed90209]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:19:54 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:19:54 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:19:54 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:19:54 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:19:54 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:19:54 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:19:54 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:19:54 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d79b31-abeb-4844-9060-d6961e2a6727]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f, portal: 172.16.0.220,3260]
Aug 26 19:19:54 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f, portal: 172.16.0.220,3260] successful.
Aug 26 19:19:54 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe46a08-556d-4f01-aacd-67d1002466e2]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6722f1e0-46e4-4d7e-b96d-7d783c5645a6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:19:54 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:19:54 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:19:54 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:19:54 user nova-compute[73917]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)
Aug 26 19:19:54 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:19:54 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:19:54 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:19:54 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:19:54 user nova-compute[73917]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)
Aug 26 19:19:54 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b345fc-5a66-4862-8778-746c32d647c3]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:19:54 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: None {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:19:55 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:19:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ysSfrMkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:19:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:19:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23265326463393132', 'path': '/dev/sdf'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:19:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265326463393132', 'path': '/dev/sdf'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:19:55 user nova-compute[73917]: DEBUG nova.objects.instance [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'flavor' on Instance uuid 75aea062-6df8-44a1-9c20-2bdd606748ab {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:19:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:19:55 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:19:55 user nova-compute[73917]:   <source dev="/dev/sdf"/>
Aug 26 19:19:55 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:19:55 user nova-compute[73917]:   <serial>b60fe9f7-bed7-48c6-91d5-b4af95dfa71f</serial>
Aug 26 19:19:55 user nova-compute[73917]: </disk>
Aug 26 19:19:55 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:19:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:19:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:19:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] No VIF found with MAC fa:16:3e:40:11:d1, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:19:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-69f26f88-d4bd-4c3c-a84a-015c7ecfed03 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.160s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:19:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:57 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:19:58 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:19:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:19:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:19:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:19:58 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:19:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:19:58 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Updating instance_info_cache with network_info: [{"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:19:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-dca28d65-37d0-4b60-b8aa-dcca61b6a187" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:19:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:20:00 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:20:00 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:20:00 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:20:00 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:20:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:00 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:20:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:20:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:20:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "75aea062-6df8-44a1-9c20-2bdd606748ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.005s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG nova.objects.instance [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'flavor' on Instance uuid 75aea062-6df8-44a1-9c20-2bdd606748ab {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "75aea062-6df8-44a1-9c20-2bdd606748ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:02 user nova-compute[73917]: INFO nova.compute.manager [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Attaching volume 1f98b353-daea-42db-a7e3-ea1a17d5d8f2 to /dev/vdc
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG os_brick.utils [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0326fa88-fc9e-4cfc-9571-f532b99f6495]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9138f102-e481-4607-8f5d-3d02605a8710]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b04764-c4ea-407a-9287-aa255be01d7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac19a95-e806-42c3-9178-27f8084f3cde]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:20:02 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe692b34-ea62-4169-8997-d12a5de9a213]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG os_brick.utils [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Updating existing volume attachment record: 490f1190-fd8c-4e7b-86ff-fe74aaf329f8 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:20:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:04 user nova-compute[73917]: DEBUG nova.compute.manager [req-d3291f27-8823-4228-b752-1c8e6d2a61d9 req-26730092-d07a-4298-a903-2d9193df3f6a service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Received event network-changed-d17ecc7e-21af-4f6a-a251-4a865473e86b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:20:04 user nova-compute[73917]: DEBUG nova.compute.manager [req-d3291f27-8823-4228-b752-1c8e6d2a61d9 req-26730092-d07a-4298-a903-2d9193df3f6a service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Refreshing instance network info cache due to event network-changed-d17ecc7e-21af-4f6a-a251-4a865473e86b. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:20:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d3291f27-8823-4228-b752-1c8e6d2a61d9 req-26730092-d07a-4298-a903-2d9193df3f6a service nova] Acquiring lock "refresh_cache-c78c30ea-1190-44bc-bd78-b3655e251a35" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:20:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d3291f27-8823-4228-b752-1c8e6d2a61d9 req-26730092-d07a-4298-a903-2d9193df3f6a service nova] Acquired lock "refresh_cache-c78c30ea-1190-44bc-bd78-b3655e251a35" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:20:04 user nova-compute[73917]: DEBUG nova.network.neutron [req-d3291f27-8823-4228-b752-1c8e6d2a61d9 req-26730092-d07a-4298-a903-2d9193df3f6a service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Refreshing network info cache for port d17ecc7e-21af-4f6a-a251-4a865473e86b {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:20:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG nova.network.neutron [req-d3291f27-8823-4228-b752-1c8e6d2a61d9 req-26730092-d07a-4298-a903-2d9193df3f6a service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Updated VIF entry in instance network info cache for port d17ecc7e-21af-4f6a-a251-4a865473e86b. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG nova.network.neutron [req-d3291f27-8823-4228-b752-1c8e6d2a61d9 req-26730092-d07a-4298-a903-2d9193df3f6a service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Updating instance_info_cache with network_info: [{"id": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "address": "fa:16:3e:97:c2:28", "network": {"id": "4e5dd15a-9c1d-489e-b732-db3ac6496ecf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885174960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e26e61119446978d7bef2800e511f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17ecc7e-21", "ovs_interfaceid": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d3291f27-8823-4228-b752-1c8e6d2a61d9 req-26730092-d07a-4298-a903-2d9193df3f6a service nova] Releasing lock "refresh_cache-c78c30ea-1190-44bc-bd78-b3655e251a35" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:05 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:20:05 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:20:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=6858MB free_disk=25.210933685302734GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance cc0ae046-2a39-4ab6-9327-2d9452c3035d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fd801f18-34b6-4682-8d43-edf82bd216c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 481cc682-2004-434d-b4eb-1688b0b07dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 94f8d4e7-f310-45df-a0ae-82e608ac0119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance df5c717a-62d8-444d-9968-ad682a31733c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f4e84db3-1f3b-471f-9f82-5a692fdb6c06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance dca28d65-37d0-4b60-b8aa-dcca61b6a187 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 75aea062-6df8-44a1-9c20-2bdd606748ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance dde8f1cd-d55b-49cf-a775-196cbc059fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c78c30ea-1190-44bc-bd78-b3655e251a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f486f10e-1cb0-47f6-b8f5-9cafe1c231f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 4a2d91a5-9943-43f6-b919-30510ccba727 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:20:05 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:20:06 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:20:06 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:20:06 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:20:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.643s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:07 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:20:07 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:20:07 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:20:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:20:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "c78c30ea-1190-44bc-bd78-b3655e251a35" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG nova.objects.instance [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lazy-loading 'flavor' on Instance uuid c78c30ea-1190-44bc-bd78-b3655e251a35 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "c78c30ea-1190-44bc-bd78-b3655e251a35" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:11 user nova-compute[73917]: INFO nova.compute.manager [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Attaching volume e939f075-079a-4408-a121-7e1ba6d9d139 to /dev/vdb
Aug 26 19:20:11 user nova-compute[73917]: DEBUG os_brick.utils [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d20adb1-a561-4fa3-a93b-c74b1888041c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b8040d-15d9-41e3-9781-c0d6b7c3243b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1db2fc-1bd9-47f2-98d1-0d255e6ee50b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c2e79d-3130-4026-ba62-5f137cabbe60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:20:11 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:20:11 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d7c192-1499-4566-91a8-e1f3a28044e8]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG os_brick.utils [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:20:11 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Updating existing volume attachment record: 0832aa3a-0a57-499b-8184-0d3a84f1fe7f {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:20:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPnvXSIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:20:14 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:20:14 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:20:14 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda5db66-4101-496d-b7ea-6b2932415cb2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:20:14 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[920f7e00-6942-4a98-a6cc-0b2770476849]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347] added
Aug 26 19:20:14 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c087b14e-a870-42de-8ef4-237e60be82b2]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb19b4f-66b5-4074-895d-cbd17ebf472c]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FPnvXSIH {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FPnvXSIH" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c125e6c-cf5e-43a4-9a53-9ed34bbabce3]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FPnvXSIH'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fd11c1-dd0b-4d7b-9ef6-29edaa4e61bf]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6ab138-b27b-42c3-a880-7ec0e4625308]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:20:14 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:20:14 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:20:14 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:20:14 user nova-compute[73917]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)
Aug 26 19:20:14 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:20:14 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:20:14 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:20:14 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:20:14 user nova-compute[73917]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)
Aug 26 19:20:14 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47acb94-d266-4571-9a59-99e9c6f3a552]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347, portal: 172.16.0.220,3260]
Aug 26 19:20:14 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347, portal: 172.16.0.220,3260] successful.
Aug 26 19:20:14 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0be7f5b-296f-477e-8a81-5b4eb3c3e94e]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbd4010-5ad3-43cc-96c4-de5db99109f0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:20:14 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:20:14 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:20:14 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:20:14 user nova-compute[73917]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)
Aug 26 19:20:14 user nova-compute[73917]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 (non-flash)
Aug 26 19:20:14 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:20:14 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:20:14 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:20:14 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:20:14 user nova-compute[73917]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)
Aug 26 19:20:14 user nova-compute[73917]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 (non-flash)
Aug 26 19:20:14 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] HCTL ('38', '-', '-', 0) found on session 34 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e91793-a4b5-4480-8996-f6f327a5bcb0]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:20:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPnvXSIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oBSUZrTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:20:15 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:20:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26434353165323934', 'path': '/dev/sdg'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434353165323934', 'path': '/dev/sdg'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.651s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:20:15 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:20:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:20:15 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG nova.objects.instance [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lazy-loading 'flavor' on Instance uuid dde8f1cd-d55b-49cf-a775-196cbc059fa9 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3238c61e-396c-44e1-bde3-e5a513ba4feb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:20:15 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b962d6a-8807-4b56-8e7a-090dc406ca3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:20:15 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:20:15 user nova-compute[73917]:   <source dev="/dev/sdg"/>
Aug 26 19:20:15 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:20:15 user nova-compute[73917]:   <serial>b186a5b3-25ae-4fa0-8c21-2df80757f347</serial>
Aug 26 19:20:15 user nova-compute[73917]: </disk>
Aug 26 19:20:15 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2] added
Aug 26 19:20:15 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[96db262d-92d3-434d-86ee-4eeb2f60fd06]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd8c544-4fb1-470c-a00a-9c7a3ac66a14]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oBSUZrTi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oBSUZrTi" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f90a9d3-071d-4a49-9a9d-85c3d4984506]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oBSUZrTi'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[22db6f0d-893e-4302-a9ee-128b41286604]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd743eb7-ffc9-4e8f-941b-26f4fdfef7d9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:20:15 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:20:15 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:20:15 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:20:15 user nova-compute[73917]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)
Aug 26 19:20:15 user nova-compute[73917]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 (non-flash)
Aug 26 19:20:15 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:20:15 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:20:15 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:20:15 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:20:15 user nova-compute[73917]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)
Aug 26 19:20:15 user nova-compute[73917]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 (non-flash)
Aug 26 19:20:15 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:20:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c226fcb1-ae11-46d9-8701-b71636984508]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2, portal: 172.16.0.220,3260]
Aug 26 19:20:16 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2, portal: 172.16.0.220,3260] successful.
Aug 26 19:20:16 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4e658b-1539-4dc1-b0a9-762dab65807d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c597d5-6526-43e6-9123-fa9222c8b8ed]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:20:16 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:20:16 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:20:16 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:20:16 user nova-compute[73917]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)
Aug 26 19:20:16 user nova-compute[73917]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 (non-flash)
Aug 26 19:20:16 user nova-compute[73917]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 (non-flash)
Aug 26 19:20:16 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:20:16 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:20:16 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:20:16 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:20:16 user nova-compute[73917]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)
Aug 26 19:20:16 user nova-compute[73917]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 (non-flash)
Aug 26 19:20:16 user nova-compute[73917]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 (non-flash)
Aug 26 19:20:16 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] HCTL ('39', '-', '-', 0) found on session 35 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6ed389-076e-4140-abd4-bb2833e1b479]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Searching for a device in session 35 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oBSUZrTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] No VIF found with MAC fa:16:3e:ec:3c:4a, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7fa78ab5-de4d-45a1-9658-96978ec767a9 tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.299s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:17 user nova-compute[73917]: INFO nova.compute.manager [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Detaching volume b186a5b3-25ae-4fa0-8c21-2df80757f347
Aug 26 19:20:17 user nova-compute[73917]: INFO nova.virt.block_device [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Attempting to driver detach volume b186a5b3-25ae-4fa0-8c21-2df80757f347 from mountpoint /dev/vdb
Aug 26 19:20:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] <== connect_volume: return (2002ms) {'type': 'block', 'scsi_wwn': '23232613035326161', 'path': '/dev/sdh'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232613035326161', 'path': '/dev/sdh'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Attempting to detach device vdb from instance dde8f1cd-d55b-49cf-a775-196cbc059fa9 from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:20:17 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:20:17 user nova-compute[73917]:   <source dev="/dev/sdg"/>
Aug 26 19:20:17 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:20:17 user nova-compute[73917]:   <serial>b186a5b3-25ae-4fa0-8c21-2df80757f347</serial>
Aug 26 19:20:17 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:20:17 user nova-compute[73917]: </disk>
Aug 26 19:20:17 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG nova.objects.instance [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'flavor' on Instance uuid 75aea062-6df8-44a1-9c20-2bdd606748ab {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:20:17 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Successfully detached device vdb from instance dde8f1cd-d55b-49cf-a775-196cbc059fa9 from the persistent domain config.
Aug 26 19:20:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dde8f1cd-d55b-49cf-a775-196cbc059fa9 from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:20:17 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:20:17 user nova-compute[73917]:   <source dev="/dev/sdg"/>
Aug 26 19:20:17 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:20:17 user nova-compute[73917]:   <serial>b186a5b3-25ae-4fa0-8c21-2df80757f347</serial>
Aug 26 19:20:17 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:20:17 user nova-compute[73917]: </disk>
Aug 26 19:20:17 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:20:17 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:20:17 user nova-compute[73917]:   <source dev="/dev/sdh"/>
Aug 26 19:20:17 user nova-compute[73917]:   <target dev="vdc" bus="virtio"/>
Aug 26 19:20:17 user nova-compute[73917]:   <serial>1f98b353-daea-42db-a7e3-ea1a17d5d8f2</serial>
Aug 26 19:20:17 user nova-compute[73917]: </disk>
Aug 26 19:20:17 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] No VIF found with MAC fa:16:3e:40:11:d1, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3dc6beb7-7e80-41d0-8b83-e9130666bf66 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.200s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693077617.79616, dde8f1cd-d55b-49cf-a775-196cbc059fa9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dde8f1cd-d55b-49cf-a775-196cbc059fa9 {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:20:17 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Successfully detached device vdb from instance dde8f1cd-d55b-49cf-a775-196cbc059fa9 from the live domain config.
Aug 26 19:20:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPnvXSIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:20:17 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:20:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9475a766-f5e9-469d-9161-d78413c80f5e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed478598-a5f3-467d-b61b-344877beee1b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:20:17 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:20:17 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:20:17 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:20:17 user nova-compute[73917]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)
Aug 26 19:20:17 user nova-compute[73917]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 (non-flash)
Aug 26 19:20:17 user nova-compute[73917]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 (non-flash)
Aug 26 19:20:17 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:20:17 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:20:17 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:20:17 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:20:17 user nova-compute[73917]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)
Aug 26 19:20:17 user nova-compute[73917]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 (non-flash)
Aug 26 19:20:17 user nova-compute[73917]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 (non-flash)
Aug 26 19:20:17 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6bb51edbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347'): ({'sdg'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Removing single pathed devices sdg {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7df37c8-7240-4649-b000-dc659f02270d]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5271b869-f87e-407f-93c2-20b405ab11fc]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Flushing IO for device /dev/sdg {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4e5a9e-907a-4521-a285-d86c6a6fff91]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:20:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c404fc06-84de-4ca5-8692-bc3197d37d3b]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] SCSI volumes sdg have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca999bc-fe63-46af-bd55-c0912cda76d9]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5d32a1-b9c7-40b4-a7de-1c2cb9b7c5c5]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347, portal: 172.16.0.220,3260]
Aug 26 19:20:18 user nova-compute[73917]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347, portal: 172.16.0.220,3260] successful.
Aug 26 19:20:18 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b186a5b3-25ae-4fa0-8c21-2df80757f347 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1513b219-71b4-4a1d-b7fd-6232b8e2c976]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] <== disconnect_volume: return (349ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG nova.objects.instance [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lazy-loading 'flavor' on Instance uuid dde8f1cd-d55b-49cf-a775-196cbc059fa9 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:20:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-509f2ce4-5521-48d7-a4e0-1a16f7e89dfe tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.993s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "75aea062-6df8-44a1-9c20-2bdd606748ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:19 user nova-compute[73917]: INFO nova.compute.manager [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Detaching volume b60fe9f7-bed7-48c6-91d5-b4af95dfa71f
Aug 26 19:20:19 user nova-compute[73917]: INFO nova.virt.block_device [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Attempting to driver detach volume b60fe9f7-bed7-48c6-91d5-b4af95dfa71f from mountpoint /dev/vdb
Aug 26 19:20:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Attempting to detach device vdb from instance 75aea062-6df8-44a1-9c20-2bdd606748ab from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:20:19 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:20:19 user nova-compute[73917]:   <source dev="/dev/sdf"/>
Aug 26 19:20:19 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:20:19 user nova-compute[73917]:   <serial>b60fe9f7-bed7-48c6-91d5-b4af95dfa71f</serial>
Aug 26 19:20:19 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:20:19 user nova-compute[73917]: </disk>
Aug 26 19:20:19 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:20:19 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Successfully detached device vdb from instance 75aea062-6df8-44a1-9c20-2bdd606748ab from the persistent domain config.
Aug 26 19:20:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 75aea062-6df8-44a1-9c20-2bdd606748ab from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:20:19 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:20:19 user nova-compute[73917]:   <source dev="/dev/sdf"/>
Aug 26 19:20:19 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:20:19 user nova-compute[73917]:   <serial>b60fe9f7-bed7-48c6-91d5-b4af95dfa71f</serial>
Aug 26 19:20:19 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:20:19 user nova-compute[73917]: </disk>
Aug 26 19:20:19 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693077619.8030996, 75aea062-6df8-44a1-9c20-2bdd606748ab => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 75aea062-6df8-44a1-9c20-2bdd606748ab {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:20:19 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Successfully detached device vdb from instance 75aea062-6df8-44a1-9c20-2bdd606748ab from the live domain config.
Aug 26 19:20:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ysSfrMkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:20:19 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:20:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7195cc4d-0c39-4188-9196-29b641101495]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e817da5-d594-4ce5-94a4-1634bfd8af80]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:20:19 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:20:19 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:20:19 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:20:19 user nova-compute[73917]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)
Aug 26 19:20:19 user nova-compute[73917]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 (non-flash)
Aug 26 19:20:19 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:20:19 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:20:19 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:20:19 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:20:19 user nova-compute[73917]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f (non-flash)
Aug 26 19:20:19 user nova-compute[73917]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 (non-flash)
Aug 26 19:20:19 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b78567ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f'): ({'sdf'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Removing single pathed devices sdf {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d4ba1f-008d-4ed9-8b61-65ab37ce53ac]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d668844c-430d-4959-aa15-515c99ae5629]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Flushing IO for device /dev/sdf {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[249d87ea-b272-4ac0-88bd-10bd906eedc8]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.032s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d85569-f1e6-4a67-8a65-595055b9fb6f]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] SCSI volumes sdf have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:20:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be0117d-8c72-489d-bf48-3bdbd2e41278]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[108f759d-aaec-496d-ad0e-d93910d1eff6]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f, portal: 172.16.0.220,3260]
Aug 26 19:20:20 user nova-compute[73917]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f, portal: 172.16.0.220,3260] successful.
Aug 26 19:20:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60fe9f7-bed7-48c6-91d5-b4af95dfa71f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45514c8-3384-4f58-aa9d-9ea5059cb820]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:20:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] <== disconnect_volume: return (296ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:20:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:20:20 user nova-compute[73917]: DEBUG nova.objects.instance [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'flavor' on Instance uuid 75aea062-6df8-44a1-9c20-2bdd606748ab {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:20:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9376fc2d-4a58-4460-a555-0812bc480d91 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.665s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "75aea062-6df8-44a1-9c20-2bdd606748ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:21 user nova-compute[73917]: INFO nova.compute.manager [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Detaching volume 1f98b353-daea-42db-a7e3-ea1a17d5d8f2
Aug 26 19:20:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:21 user nova-compute[73917]: INFO nova.virt.block_device [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Attempting to driver detach volume 1f98b353-daea-42db-a7e3-ea1a17d5d8f2 from mountpoint /dev/vdc
Aug 26 19:20:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Attempting to detach device vdc from instance 75aea062-6df8-44a1-9c20-2bdd606748ab from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:20:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:20:21 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:20:21 user nova-compute[73917]:   <source dev="/dev/sdh"/>
Aug 26 19:20:21 user nova-compute[73917]:   <target dev="vdc" bus="virtio"/>
Aug 26 19:20:21 user nova-compute[73917]:   <serial>1f98b353-daea-42db-a7e3-ea1a17d5d8f2</serial>
Aug 26 19:20:21 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 19:20:21 user nova-compute[73917]: </disk>
Aug 26 19:20:21 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:20:21 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Successfully detached device vdc from instance 75aea062-6df8-44a1-9c20-2bdd606748ab from the persistent domain config.
Aug 26 19:20:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 75aea062-6df8-44a1-9c20-2bdd606748ab from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:20:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:20:21 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:20:21 user nova-compute[73917]:   <source dev="/dev/sdh"/>
Aug 26 19:20:21 user nova-compute[73917]:   <target dev="vdc" bus="virtio"/>
Aug 26 19:20:21 user nova-compute[73917]:   <serial>1f98b353-daea-42db-a7e3-ea1a17d5d8f2</serial>
Aug 26 19:20:21 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 19:20:21 user nova-compute[73917]: </disk>
Aug 26 19:20:21 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693077622.3143847, 75aea062-6df8-44a1-9c20-2bdd606748ab => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 75aea062-6df8-44a1-9c20-2bdd606748ab {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:20:22 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Successfully detached device vdc from instance 75aea062-6df8-44a1-9c20-2bdd606748ab from the live domain config.
Aug 26 19:20:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oBSUZrTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:20:22 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:20:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[202d7306-e28f-48b7-a2d5-125a2434359d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15b3e0d-582e-42dd-9b76-3e431aea91a4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:20:22 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:20:22 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:20:22 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:20:22 user nova-compute[73917]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 (non-flash)
Aug 26 19:20:22 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:20:22 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:20:22 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:20:22 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:20:22 user nova-compute[73917]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 (non-flash)
Aug 26 19:20:22 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b987da290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2'): ({'sdh'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Removing single pathed devices sdh {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06a48bb-9dc1-4e9e-b2c0-cb136b7187dd]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[33778a1d-7c37-4118-a522-84af7303a34c]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Flushing IO for device /dev/sdh {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b47fd4-761c-41e0-98d5-37180491beee]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.061s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b3a632-fd46-40f6-bf14-252ade00d28d]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] SCSI volumes sdh have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef22995-c085-4ef8-8ef2-06cb8cbc7cbd]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[233b25bf-9b24-4f40-bace-b9fc73411a91]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2, portal: 172.16.0.220,3260]
Aug 26 19:20:22 user nova-compute[73917]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2, portal: 172.16.0.220,3260] successful.
Aug 26 19:20:22 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f98b353-daea-42db-a7e3-ea1a17d5d8f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e52f040-9b0b-4628-8060-be8767fea4c7]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] <== disconnect_volume: return (326ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:20:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:20:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:23 user nova-compute[73917]: DEBUG nova.objects.instance [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'flavor' on Instance uuid 75aea062-6df8-44a1-9c20-2bdd606748ab {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:20:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8cb70693-149b-47b5-a1b3-0df293aa4a24 tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.898s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wybTefQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:20:24 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:20:24 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:20:24 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[32519628-8bd7-4f7a-a611-d6df8ad7cb83]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:20:24 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b1d5eb-2778-4824-9a02-32a3a699a1da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139] added
Aug 26 19:20:24 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b12957-ac5a-420c-a68d-2d3490a0fc0e]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb12eb0b-5a6d-49be-805d-59bc9463cff1]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wybTefQv {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wybTefQv" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[857ee58e-3c55-4d8c-b913-e296ccb07445]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wybTefQv'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7807feb5-3718-46e4-aac7-45a05bc05e5d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a6cb58-1307-42af-ada6-1ad4e84875a1]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:20:24 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:20:24 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:20:24 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:20:24 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:20:24 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:20:24 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:20:24 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:20:24 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "75aea062-6df8-44a1-9c20-2bdd606748ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "75aea062-6df8-44a1-9c20-2bdd606748ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:24 user nova-compute[73917]: INFO nova.compute.manager [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Terminating instance
Aug 26 19:20:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5829ba7e-2d06-492f-a850-e74ddb74fb17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139, portal: 172.16.0.220,3260]
Aug 26 19:20:24 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139, portal: 172.16.0.220,3260] successful.
Aug 26 19:20:24 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df003a0-cf3e-46e9-bedf-e9bf6d2ef067]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[840f472d-d350-4bd0-882a-658cea4345a7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:20:24 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:20:24 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:20:24 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:20:24 user nova-compute[73917]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 (non-flash)
Aug 26 19:20:24 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:20:24 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:20:24 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:20:24 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:20:24 user nova-compute[73917]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 (non-flash)
Aug 26 19:20:24 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eded04-58e2-4ef6-b99f-f8e8ccbeda1a]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wybTefQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-349cb7aa-bc28-473c-b5a3-fcb3d577b5bb req-91c117e9-0b4d-41c5-8dc9-cef79cb050c1 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Received event network-vif-unplugged-79cb97b7-c220-40a7-aece-1ccacda973b6 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-349cb7aa-bc28-473c-b5a3-fcb3d577b5bb req-91c117e9-0b4d-41c5-8dc9-cef79cb050c1 service nova] Acquiring lock "75aea062-6df8-44a1-9c20-2bdd606748ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-349cb7aa-bc28-473c-b5a3-fcb3d577b5bb req-91c117e9-0b4d-41c5-8dc9-cef79cb050c1 service nova] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-349cb7aa-bc28-473c-b5a3-fcb3d577b5bb req-91c117e9-0b4d-41c5-8dc9-cef79cb050c1 service nova] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-349cb7aa-bc28-473c-b5a3-fcb3d577b5bb req-91c117e9-0b4d-41c5-8dc9-cef79cb050c1 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] No waiting events found dispatching network-vif-unplugged-79cb97b7-c220-40a7-aece-1ccacda973b6 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:20:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-349cb7aa-bc28-473c-b5a3-fcb3d577b5bb req-91c117e9-0b4d-41c5-8dc9-cef79cb050c1 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Received event network-vif-unplugged-79cb97b7-c220-40a7-aece-1ccacda973b6 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:20:25 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Instance destroyed successfully.
Aug 26 19:20:25 user nova-compute[73917]: DEBUG nova.objects.instance [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lazy-loading 'resources' on Instance uuid 75aea062-6df8-44a1-9c20-2bdd606748ab {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:20:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:17:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1912505000',display_name='tempest-AttachVolumeTestJSON-server-1912505000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1912505000',id=27,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChmjquE1k/m4DA2iLFbluvWgO30CBeq1tZgfmsuCu/247vVEaurDg4+OPbo4e/cSuJhGG3d+60MVq/2MoW4YTlB0xeazpe+c4duElh//3sZ9Ss8P60DfkAtF/u8OXE1NQ==',key_name='tempest-keypair-1004094651',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:17:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='abdcca8609e849618526a8b78385f77b',ramdisk_id='',reservation_id='r-cxjtcpn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1084822713',owner_user_name='tempest-AttachVolumeTestJSON-1084822713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:17:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47b6f8fcb8f49dfa2383dfbf37d6c30',uuid=75aea062-6df8-44a1-9c20-2bdd606748ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79cb97b7-c220-40a7-aece-1ccacda973b6", "address": "fa:16:3e:40:11:d1", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb97b7-c2", "ovs_interfaceid": "79cb97b7-c220-40a7-aece-1ccacda973b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:20:25 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converting VIF {"id": "79cb97b7-c220-40a7-aece-1ccacda973b6", "address": "fa:16:3e:40:11:d1", "network": {"id": "54f7509c-6a99-422f-a1cf-b2028a3fa539", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1889113025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abdcca8609e849618526a8b78385f77b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb97b7-c2", "ovs_interfaceid": "79cb97b7-c220-40a7-aece-1ccacda973b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:20:25 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:11:d1,bridge_name='br-int',has_traffic_filtering=True,id=79cb97b7-c220-40a7-aece-1ccacda973b6,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79cb97b7-c2') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:20:25 user nova-compute[73917]: DEBUG os_vif [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:11:d1,bridge_name='br-int',has_traffic_filtering=True,id=79cb97b7-c220-40a7-aece-1ccacda973b6,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79cb97b7-c2') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:20:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79cb97b7-c2, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:20:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:25 user nova-compute[73917]: INFO os_vif [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:11:d1,bridge_name='br-int',has_traffic_filtering=True,id=79cb97b7-c220-40a7-aece-1ccacda973b6,network=Network(54f7509c-6a99-422f-a1cf-b2028a3fa539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79cb97b7-c2')
Aug 26 19:20:25 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Deleting instance files /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab_del
Aug 26 19:20:25 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Deletion of /opt/stack/data/nova/instances/75aea062-6df8-44a1-9c20-2bdd606748ab_del complete
Aug 26 19:20:25 user nova-compute[73917]: INFO nova.compute.manager [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 26 19:20:25 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:20:25 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:20:25 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:20:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:20:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23034343966313765', 'path': '/dev/sdf'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:20:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034343966313765', 'path': '/dev/sdf'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:20:25 user nova-compute[73917]: DEBUG nova.objects.instance [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lazy-loading 'flavor' on Instance uuid c78c30ea-1190-44bc-bd78-b3655e251a35 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:20:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:20:25 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:20:25 user nova-compute[73917]:   <source dev="/dev/sdf"/>
Aug 26 19:20:25 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:20:25 user nova-compute[73917]:   <serial>e939f075-079a-4408-a121-7e1ba6d9d139</serial>
Aug 26 19:20:25 user nova-compute[73917]: </disk>
Aug 26 19:20:25 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:20:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:20:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:20:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] No VIF found with MAC fa:16:3e:97:c2:28, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:20:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5820f3c8-a134-43e8-8d00-dd211b83cc7a tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.646s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:26 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:20:26 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Took 0.92 seconds to deallocate network for instance.
Aug 26 19:20:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-a4287f2f-215a-4e4e-a2e5-f476e7d8066e req-b0dcfc47-c02c-454c-9991-5ea804fcf6e4 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Received event network-vif-deleted-79cb97b7-c220-40a7-aece-1ccacda973b6 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:20:26 user nova-compute[73917]: INFO nova.compute.manager [req-a4287f2f-215a-4e4e-a2e5-f476e7d8066e req-b0dcfc47-c02c-454c-9991-5ea804fcf6e4 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Neutron deleted interface 79cb97b7-c220-40a7-aece-1ccacda973b6; detaching it from the instance and deleting it from the info cache
Aug 26 19:20:26 user nova-compute[73917]: DEBUG nova.network.neutron [req-a4287f2f-215a-4e4e-a2e5-f476e7d8066e req-b0dcfc47-c02c-454c-9991-5ea804fcf6e4 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:20:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-a4287f2f-215a-4e4e-a2e5-f476e7d8066e req-b0dcfc47-c02c-454c-9991-5ea804fcf6e4 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Detach interface failed, port_id=79cb97b7-c220-40a7-aece-1ccacda973b6, reason: Instance 75aea062-6df8-44a1-9c20-2bdd606748ab could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:20:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:26 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:20:26 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:20:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:26 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Deleted allocations for instance 75aea062-6df8-44a1-9c20-2bdd606748ab
Aug 26 19:20:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-ab6d714c-eee0-4ac2-9fcd-ca2a345f0a5f req-c3502fdf-41e8-4818-8188-d677dc5ce552 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Received event network-vif-plugged-79cb97b7-c220-40a7-aece-1ccacda973b6 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:20:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ab6d714c-eee0-4ac2-9fcd-ca2a345f0a5f req-c3502fdf-41e8-4818-8188-d677dc5ce552 service nova] Acquiring lock "75aea062-6df8-44a1-9c20-2bdd606748ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ab6d714c-eee0-4ac2-9fcd-ca2a345f0a5f req-c3502fdf-41e8-4818-8188-d677dc5ce552 service nova] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ab6d714c-eee0-4ac2-9fcd-ca2a345f0a5f req-c3502fdf-41e8-4818-8188-d677dc5ce552 service nova] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-ab6d714c-eee0-4ac2-9fcd-ca2a345f0a5f req-c3502fdf-41e8-4818-8188-d677dc5ce552 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] No waiting events found dispatching network-vif-plugged-79cb97b7-c220-40a7-aece-1ccacda973b6 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:20:26 user nova-compute[73917]: WARNING nova.compute.manager [req-ab6d714c-eee0-4ac2-9fcd-ca2a345f0a5f req-c3502fdf-41e8-4818-8188-d677dc5ce552 service nova] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Received unexpected event network-vif-plugged-79cb97b7-c220-40a7-aece-1ccacda973b6 for instance with vm_state deleted and task_state None.
Aug 26 19:20:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-02781d73-f3bf-4986-917b-1954a58729cb tempest-AttachVolumeTestJSON-1084822713 tempest-AttachVolumeTestJSON-1084822713-project-member] Lock "75aea062-6df8-44a1-9c20-2bdd606748ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.526s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:20:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:20:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:20:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:20:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:40 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077625.2568915, 75aea062-6df8-44a1-9c20-2bdd606748ab => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:20:40 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] VM Stopped (Lifecycle Event)
Aug 26 19:20:40 user nova-compute[73917]: DEBUG nova.compute.manager [None req-6ab1929c-7dfb-4591-8e61-db805ebbe22d None None] [instance: 75aea062-6df8-44a1-9c20-2bdd606748ab] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:20:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:41 user nova-compute[73917]: DEBUG nova.compute.manager [req-23b4c946-1f09-40aa-b62d-9f5d131c147f req-83611839-b4f5-47fe-b317-8817be352ea8 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Received event network-changed-2738a59b-9109-4fef-8868-920d458dfaa1 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:20:41 user nova-compute[73917]: DEBUG nova.compute.manager [req-23b4c946-1f09-40aa-b62d-9f5d131c147f req-83611839-b4f5-47fe-b317-8817be352ea8 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Refreshing instance network info cache due to event network-changed-2738a59b-9109-4fef-8868-920d458dfaa1. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:20:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-23b4c946-1f09-40aa-b62d-9f5d131c147f req-83611839-b4f5-47fe-b317-8817be352ea8 service nova] Acquiring lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:20:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-23b4c946-1f09-40aa-b62d-9f5d131c147f req-83611839-b4f5-47fe-b317-8817be352ea8 service nova] Acquired lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:20:41 user nova-compute[73917]: DEBUG nova.network.neutron [req-23b4c946-1f09-40aa-b62d-9f5d131c147f req-83611839-b4f5-47fe-b317-8817be352ea8 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Refreshing network info cache for port 2738a59b-9109-4fef-8868-920d458dfaa1 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:20:42 user nova-compute[73917]: DEBUG nova.network.neutron [req-23b4c946-1f09-40aa-b62d-9f5d131c147f req-83611839-b4f5-47fe-b317-8817be352ea8 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Updated VIF entry in instance network info cache for port 2738a59b-9109-4fef-8868-920d458dfaa1. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:20:42 user nova-compute[73917]: DEBUG nova.network.neutron [req-23b4c946-1f09-40aa-b62d-9f5d131c147f req-83611839-b4f5-47fe-b317-8817be352ea8 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Updating instance_info_cache with network_info: [{"id": "2738a59b-9109-4fef-8868-920d458dfaa1", "address": "fa:16:3e:e9:a2:a3", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2738a59b-91", "ovs_interfaceid": "2738a59b-9109-4fef-8868-920d458dfaa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:20:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-23b4c946-1f09-40aa-b62d-9f5d131c147f req-83611839-b4f5-47fe-b317-8817be352ea8 service nova] Releasing lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:20:42 user nova-compute[73917]: DEBUG nova.compute.manager [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Stashing vm_state: active {{(pid=73917) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 19:20:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:42 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:20:42 user nova-compute[73917]: INFO nova.compute.claims [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Claim successful on node user
Aug 26 19:20:42 user nova-compute[73917]: INFO nova.compute.resource_tracker [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Updating resource usage from migration 2bd04bdf-4db4-4b04-afb6-e24d63bef27e
Aug 26 19:20:43 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:20:43 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:20:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.522s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:43 user nova-compute[73917]: INFO nova.compute.manager [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Migrating
Aug 26 19:20:43 user nova-compute[73917]: DEBUG nova.compute.manager [req-107b6521-8c00-4789-a76b-cd001020fe73 req-87a29f61-8c97-4545-9ce2-01017af23706 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Received event network-changed-af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:20:43 user nova-compute[73917]: DEBUG nova.compute.manager [req-107b6521-8c00-4789-a76b-cd001020fe73 req-87a29f61-8c97-4545-9ce2-01017af23706 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Refreshing instance network info cache due to event network-changed-af8c2f16-54b2-4a39-b893-e95b3794b8b1. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:20:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-107b6521-8c00-4789-a76b-cd001020fe73 req-87a29f61-8c97-4545-9ce2-01017af23706 service nova] Acquiring lock "refresh_cache-4a2d91a5-9943-43f6-b919-30510ccba727" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:20:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-107b6521-8c00-4789-a76b-cd001020fe73 req-87a29f61-8c97-4545-9ce2-01017af23706 service nova] Acquired lock "refresh_cache-4a2d91a5-9943-43f6-b919-30510ccba727" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:20:43 user nova-compute[73917]: DEBUG nova.network.neutron [req-107b6521-8c00-4789-a76b-cd001020fe73 req-87a29f61-8c97-4545-9ce2-01017af23706 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Refreshing network info cache for port af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:20:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "refresh_cache-4a2d91a5-9943-43f6-b919-30510ccba727" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:20:44 user nova-compute[73917]: DEBUG nova.network.neutron [req-107b6521-8c00-4789-a76b-cd001020fe73 req-87a29f61-8c97-4545-9ce2-01017af23706 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Updated VIF entry in instance network info cache for port af8c2f16-54b2-4a39-b893-e95b3794b8b1. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:20:44 user nova-compute[73917]: DEBUG nova.network.neutron [req-107b6521-8c00-4789-a76b-cd001020fe73 req-87a29f61-8c97-4545-9ce2-01017af23706 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Updating instance_info_cache with network_info: [{"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:20:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-107b6521-8c00-4789-a76b-cd001020fe73 req-87a29f61-8c97-4545-9ce2-01017af23706 service nova] Releasing lock "refresh_cache-4a2d91a5-9943-43f6-b919-30510ccba727" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:20:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquired lock "refresh_cache-4a2d91a5-9943-43f6-b919-30510ccba727" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:20:44 user nova-compute[73917]: DEBUG nova.network.neutron [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:20:44 user nova-compute[73917]: DEBUG nova.network.neutron [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Updating instance_info_cache with network_info: [{"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:20:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Releasing lock "refresh_cache-4a2d91a5-9943-43f6-b919-30510ccba727" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:20:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Starting migrate_disk_and_power_off {{(pid=73917) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG nova.compute.manager [req-0c0f00d1-073b-4ea2-812e-7f4ed07daf65 req-44b5db36-384f-457f-97be-194b6be4dbe1 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Received event network-vif-unplugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0c0f00d1-073b-4ea2-812e-7f4ed07daf65 req-44b5db36-384f-457f-97be-194b6be4dbe1 service nova] Acquiring lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0c0f00d1-073b-4ea2-812e-7f4ed07daf65 req-44b5db36-384f-457f-97be-194b6be4dbe1 service nova] Lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0c0f00d1-073b-4ea2-812e-7f4ed07daf65 req-44b5db36-384f-457f-97be-194b6be4dbe1 service nova] Lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG nova.compute.manager [req-0c0f00d1-073b-4ea2-812e-7f4ed07daf65 req-44b5db36-384f-457f-97be-194b6be4dbe1 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] No waiting events found dispatching network-vif-unplugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:20:45 user nova-compute[73917]: WARNING nova.compute.manager [req-0c0f00d1-073b-4ea2-812e-7f4ed07daf65 req-44b5db36-384f-457f-97be-194b6be4dbe1 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Received unexpected event network-vif-unplugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 for instance with vm_state active and task_state resize_migrating.
Aug 26 19:20:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:45 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Instance destroyed successfully.
Aug 26 19:20:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1428844380',display_name='tempest-ServerActionsTestOtherA-server-1428844380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1428844380',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoE8tZDc68JWUNde0nWnasqq1vYa5ON2YNQwHw+xO1EiolhKGRVVBiykxwLyvBezUmZpO4CsEARWWqkHIKpn0pTvCPDPPJIP+G7BbRXcHe4wp+29J3exWEnrrk3yPKzjg==',key_name='tempest-keypair-1254307896',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:19:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2e09fe7b38e4bb991bfaaf5b4ad357a',ramdisk_id='',reservation_id='r-4dv3wxu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2069094918',owner_user_name='tempest-ServerActionsTestOtherA-2069094918-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd1b7d3fe22c4b239cf03235866e17d4',uuid=4a2d91a5-9943-43f6-b919-30510ccba727,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-292934733-network", "vif_mac": "fa:16:3e:d9:5d:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converting VIF {"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-292934733-network", "vif_mac": "fa:16:3e:d9:5d:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=af8c2f16-54b2-4a39-b893-e95b3794b8b1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c2f16-54') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG os_vif [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=af8c2f16-54b2-4a39-b893-e95b3794b8b1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c2f16-54') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf8c2f16-54, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:45 user nova-compute[73917]: INFO os_vif [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=af8c2f16-54b2-4a39-b893-e95b3794b8b1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c2f16-54')
Aug 26 19:20:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kBypRFGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:20:45 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:20:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[37de7f60-199d-4c47-8143-f9dc291008ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd120d2-99aa-4159-bca3-d38680022cfd]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:20:45 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:20:45 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:20:45 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:20:45 user nova-compute[73917]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 (non-flash)
Aug 26 19:20:45 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:20:45 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:20:45 user nova-compute[73917]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:20:45 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:20:45 user nova-compute[73917]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 (non-flash)
Aug 26 19:20:45 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b78567ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a'): ({'sde'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Removing single pathed devices sde {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d6afe7-1e03-4119-a28d-28462480b1cb]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30b9c79-4b2f-477e-8697-bd46936b0957]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Flushing IO for device /dev/sde {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7002133-b5ad-4021-85bf-02eb637245b1]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:20:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dcf442-eb0e-4744-a77a-9b294188f832]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] SCSI volumes sde have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d77ca2-ce3f-46f2-ba50-99d2a46f9f04]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ff6285-a5b8-4fea-a167-3b8425d8cdc4]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a, portal: 172.16.0.220,3260]
Aug 26 19:20:46 user nova-compute[73917]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a, portal: 172.16.0.220,3260] successful.
Aug 26 19:20:46 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a24177-cc11-427d-91ec-5221785e3373]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] <== disconnect_volume: return (371ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:20:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:20:47 user nova-compute[73917]: DEBUG nova.network.neutron [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Port af8c2f16-54b2-4a39-b893-e95b3794b8b1 binding to destination host user is already ACTIVE {{(pid=73917) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 19:20:47 user nova-compute[73917]: DEBUG nova.compute.manager [req-f805b2d5-38ae-479f-9403-08529bfd19af req-71e0ae6f-f676-44e4-905d-208bf77af7f4 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Received event network-vif-plugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:20:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f805b2d5-38ae-479f-9403-08529bfd19af req-71e0ae6f-f676-44e4-905d-208bf77af7f4 service nova] Acquiring lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f805b2d5-38ae-479f-9403-08529bfd19af req-71e0ae6f-f676-44e4-905d-208bf77af7f4 service nova] Lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f805b2d5-38ae-479f-9403-08529bfd19af req-71e0ae6f-f676-44e4-905d-208bf77af7f4 service nova] Lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:47 user nova-compute[73917]: DEBUG nova.compute.manager [req-f805b2d5-38ae-479f-9403-08529bfd19af req-71e0ae6f-f676-44e4-905d-208bf77af7f4 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] No waiting events found dispatching network-vif-plugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:20:47 user nova-compute[73917]: WARNING nova.compute.manager [req-f805b2d5-38ae-479f-9403-08529bfd19af req-71e0ae6f-f676-44e4-905d-208bf77af7f4 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Received unexpected event network-vif-plugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 for instance with vm_state active and task_state resize_migrating.
Aug 26 19:20:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "refresh_cache-4a2d91a5-9943-43f6-b919-30510ccba727" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:20:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquired lock "refresh_cache-4a2d91a5-9943-43f6-b919-30510ccba727" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:20:47 user nova-compute[73917]: DEBUG nova.network.neutron [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG nova.network.neutron [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Updating instance_info_cache with network_info: [{"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Releasing lock "refresh_cache-4a2d91a5-9943-43f6-b919-30510ccba727" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG os_brick.utils [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa52097-9207-4a98-8079-e31809fd77b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f165d1-687d-48be-8f62-dcfed46e8aa8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b838981-8573-4447-b52d-0d013a62f032]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[20501214-bca3-485f-a06f-2500cce90e7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:20:48 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2741fc5-f052-4b21-9399-32dd43261553]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG os_brick.utils [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Acquiring lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Acquiring lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:48 user nova-compute[73917]: INFO nova.compute.manager [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Terminating instance
Aug 26 19:20:48 user nova-compute[73917]: DEBUG nova.compute.manager [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG nova.compute.manager [req-8d040809-0ee7-4ab8-9c7d-21c90f79a08b req-18595a13-c82e-4221-9b07-bc20723daa5b service nova] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Received event network-vif-unplugged-9e8197b5-9996-4851-922d-33a27c7bb496 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8d040809-0ee7-4ab8-9c7d-21c90f79a08b req-18595a13-c82e-4221-9b07-bc20723daa5b service nova] Acquiring lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8d040809-0ee7-4ab8-9c7d-21c90f79a08b req-18595a13-c82e-4221-9b07-bc20723daa5b service nova] Lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8d040809-0ee7-4ab8-9c7d-21c90f79a08b req-18595a13-c82e-4221-9b07-bc20723daa5b service nova] Lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG nova.compute.manager [req-8d040809-0ee7-4ab8-9c7d-21c90f79a08b req-18595a13-c82e-4221-9b07-bc20723daa5b service nova] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] No waiting events found dispatching network-vif-unplugged-9e8197b5-9996-4851-922d-33a27c7bb496 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:20:48 user nova-compute[73917]: DEBUG nova.compute.manager [req-8d040809-0ee7-4ab8-9c7d-21c90f79a08b req-18595a13-c82e-4221-9b07-bc20723daa5b service nova] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Received event network-vif-unplugged-9e8197b5-9996-4851-922d-33a27c7bb496 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:20:49 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Instance destroyed successfully.
Aug 26 19:20:49 user nova-compute[73917]: DEBUG nova.objects.instance [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Lazy-loading 'resources' on Instance uuid f486f10e-1cb0-47f6-b8f5-9cafe1c231f8 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:20:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:18:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1804325487',display_name='tempest-VolumesActionsTest-instance-1804325487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1804325487',id=30,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:18:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdf98c332d484d18848fa1d5094c4b92',ramdisk_id='',reservation_id='r-9fdd00cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-144292805',owner_user_name='tempest-VolumesActionsTest-144292805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:18:50Z,user_data=None,user_id='00b79af99f494c20a044c86f209cf2e5',uuid=f486f10e-1cb0-47f6-b8f5-9cafe1c231f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e8197b5-9996-4851-922d-33a27c7bb496", "address": "fa:16:3e:54:e5:3b", "network": {"id": "7c8df350-d18b-46dc-8571-1c8ccbf3448e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1828019014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf98c332d484d18848fa1d5094c4b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e8197b5-99", "ovs_interfaceid": "9e8197b5-9996-4851-922d-33a27c7bb496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:20:49 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Converting VIF {"id": "9e8197b5-9996-4851-922d-33a27c7bb496", "address": "fa:16:3e:54:e5:3b", "network": {"id": "7c8df350-d18b-46dc-8571-1c8ccbf3448e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1828019014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf98c332d484d18848fa1d5094c4b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e8197b5-99", "ovs_interfaceid": "9e8197b5-9996-4851-922d-33a27c7bb496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:20:49 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:e5:3b,bridge_name='br-int',has_traffic_filtering=True,id=9e8197b5-9996-4851-922d-33a27c7bb496,network=Network(7c8df350-d18b-46dc-8571-1c8ccbf3448e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e8197b5-99') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:20:49 user nova-compute[73917]: DEBUG os_vif [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:e5:3b,bridge_name='br-int',has_traffic_filtering=True,id=9e8197b5-9996-4851-922d-33a27c7bb496,network=Network(7c8df350-d18b-46dc-8571-1c8ccbf3448e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e8197b5-99') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:20:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e8197b5-99, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:20:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:49 user nova-compute[73917]: INFO os_vif [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:e5:3b,bridge_name='br-int',has_traffic_filtering=True,id=9e8197b5-9996-4851-922d-33a27c7bb496,network=Network(7c8df350-d18b-46dc-8571-1c8ccbf3448e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e8197b5-99')
Aug 26 19:20:49 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Deleting instance files /opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8_del
Aug 26 19:20:49 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Deletion of /opt/stack/data/nova/instances/f486f10e-1cb0-47f6-b8f5-9cafe1c231f8_del complete
Aug 26 19:20:49 user nova-compute[73917]: INFO nova.compute.manager [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 26 19:20:49 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:20:49 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:20:49 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:20:49 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:20:49 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Took 0.63 seconds to deallocate network for instance.
Aug 26 19:20:49 user nova-compute[73917]: DEBUG nova.compute.manager [req-005db8dd-43c9-40df-a6d9-1c8cee0c8c9a req-d85b29f6-9fbe-49fd-b6e9-7eb817f7e3d8 service nova] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Received event network-vif-deleted-9e8197b5-9996-4851-922d-33a27c7bb496 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:20:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:50 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:20:50 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:20:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.486s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:50 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Deleted allocations for instance f486f10e-1cb0-47f6-b8f5-9cafe1c231f8
Aug 26 19:20:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-18a329bc-3ddc-4bc1-8fc5-b215d36b797a tempest-VolumesActionsTest-144292805 tempest-VolumesActionsTest-144292805-project-member] Lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.055s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:50 user nova-compute[73917]: DEBUG nova.compute.manager [req-cb3f051a-3c8c-4c8d-91c2-990822de68f0 req-9b039325-fff4-408f-88c1-533510a77d8d service nova] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Received event network-vif-plugged-9e8197b5-9996-4851-922d-33a27c7bb496 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:20:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cb3f051a-3c8c-4c8d-91c2-990822de68f0 req-9b039325-fff4-408f-88c1-533510a77d8d service nova] Acquiring lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cb3f051a-3c8c-4c8d-91c2-990822de68f0 req-9b039325-fff4-408f-88c1-533510a77d8d service nova] Lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cb3f051a-3c8c-4c8d-91c2-990822de68f0 req-9b039325-fff4-408f-88c1-533510a77d8d service nova] Lock "f486f10e-1cb0-47f6-b8f5-9cafe1c231f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:50 user nova-compute[73917]: DEBUG nova.compute.manager [req-cb3f051a-3c8c-4c8d-91c2-990822de68f0 req-9b039325-fff4-408f-88c1-533510a77d8d service nova] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] No waiting events found dispatching network-vif-plugged-9e8197b5-9996-4851-922d-33a27c7bb496 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:20:50 user nova-compute[73917]: WARNING nova.compute.manager [req-cb3f051a-3c8c-4c8d-91c2-990822de68f0 req-9b039325-fff4-408f-88c1-533510a77d8d service nova] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Received unexpected event network-vif-plugged-9e8197b5-9996-4851-922d-33a27c7bb496 for instance with vm_state deleted and task_state None.
Aug 26 19:20:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "a4487be3-7267-4ae1-8731-a6bdf49a6070" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "a4487be3-7267-4ae1-8731-a6bdf49a6070" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:20:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:58 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:20:58 user nova-compute[73917]: INFO nova.compute.claims [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Claim successful on node user
Aug 26 19:20:58 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:20:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:20:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Didn't find any instances for network info cache update. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 19:20:58 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:20:58 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:20:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:20:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:20:58 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:20:58 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:20:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:20:58 user nova-compute[73917]: DEBUG nova.policy [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e056c4ed5a18427a8fd1eaa6a3a795c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68229e3ed72a45fa8c2c9a33780479ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:20:59 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Creating image(s)
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "/opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "/opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.196s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.203s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk 1073741824" returned: 0 in 0.067s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "c78c30ea-1190-44bc-bd78-b3655e251a35" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:59 user nova-compute[73917]: INFO nova.compute.manager [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Detaching volume e939f075-079a-4408-a121-7e1ba6d9d139
Aug 26 19:20:59 user nova-compute[73917]: INFO nova.virt.block_device [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Attempting to driver detach volume e939f075-079a-4408-a121-7e1ba6d9d139 from mountpoint /dev/vdb
Aug 26 19:20:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Attempting to detach device vdb from instance c78c30ea-1190-44bc-bd78-b3655e251a35 from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:20:59 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:20:59 user nova-compute[73917]:   <source dev="/dev/sdf"/>
Aug 26 19:20:59 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:20:59 user nova-compute[73917]:   <serial>e939f075-079a-4408-a121-7e1ba6d9d139</serial>
Aug 26 19:20:59 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:20:59 user nova-compute[73917]: </disk>
Aug 26 19:20:59 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:20:59 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Successfully detached device vdb from instance c78c30ea-1190-44bc-bd78-b3655e251a35 from the persistent domain config.
Aug 26 19:20:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c78c30ea-1190-44bc-bd78-b3655e251a35 from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:20:59 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:20:59 user nova-compute[73917]:   <source dev="/dev/sdf"/>
Aug 26 19:20:59 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:20:59 user nova-compute[73917]:   <serial>e939f075-079a-4408-a121-7e1ba6d9d139</serial>
Aug 26 19:20:59 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:20:59 user nova-compute[73917]: </disk>
Aug 26 19:20:59 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.225s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Successfully created port: 15e5e2fc-f53b-4490-8446-cdcdd5491a10 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Cannot resize image /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Ensure instance console log exists: /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:20:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693077660.1619108, c78c30ea-1190-44bc-bd78-b3655e251a35 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c78c30ea-1190-44bc-bd78-b3655e251a35 {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:21:00 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Successfully detached device vdb from instance c78c30ea-1190-44bc-bd78-b3655e251a35 from the live domain config.
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wybTefQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:21:00 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[54824123-2b26-4514-a695-63c4c81446ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79686bb-480f-4e2f-8aed-2ae3cabe0c36]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:21:00 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:21:00 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:21:00 user nova-compute[73917]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 (non-flash)
Aug 26 19:21:00 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:21:00 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:21:00 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:21:00 user nova-compute[73917]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 (non-flash)
Aug 26 19:21:00 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b784ed630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139'): ({'sdf'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Removing single pathed devices sdf {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[324590d6-112a-4cd5-a2b2-2cdd683c0cad]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da5e2e4-c7f9-4973-a939-82c268de0500]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Flushing IO for device /dev/sdf {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8920134-dbb3-407c-a2c0-db37129ae6e9]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef0a2cf-879e-4fd0-bb7e-c126d028e491]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] SCSI volumes sdf have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1706690-474d-4ed5-a44c-512c323d78f4]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[303b257b-c3d7-4911-a0f7-97c870fea411]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139, portal: 172.16.0.220,3260]
Aug 26 19:21:00 user nova-compute[73917]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139, portal: 172.16.0.220,3260] successful.
Aug 26 19:21:00 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e939f075-079a-4408-a121-7e1ba6d9d139 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d4f84b-dfd2-4a1e-ac0c-12b27ebb5707]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] <== disconnect_volume: return (327ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077645.7728322, 4a2d91a5-9943-43f6-b919-30510ccba727 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:21:00 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] VM Stopped (Lifecycle Event)
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Starting finish_migration {{(pid=73917) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Instance directory exists: not creating {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 19:21:00 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Creating image(s)
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Did not create local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Ensure instance console log exists: /opt/stack/data/nova/instances/4a2d91a5-9943-43f6-b919-30510ccba727/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Start _get_guest_xml network_info=[{"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-292934733-network", "vif_mac": "fa:16:3e:d9:5d:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kBypRFGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4a2d91a5-9943-43f6-b919-30510ccba727', 'attached_at': '2023-08-26T19:21:01.000000', 'detached_at': '', 'volume_id': '4c062201-81b9-42d1-8ae2-5b6fe648bc2a', 'serial': '4c062201-81b9-42d1-8ae2-5b6fe648bc2a'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '669e0059-1ed0-439e-93c6-7c16189ae74e', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.compute.manager [None req-155eb320-d901-4a0b-9e2e-a1895be0d217 None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.compute.manager [None req-155eb320-d901-4a0b-9e2e-a1895be0d217 None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:21:00 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:21:00 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kBypRFGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:21:00 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:21:00 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:21:00 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:21:00 user nova-compute[73917]: INFO nova.compute.manager [None req-155eb320-d901-4a0b-9e2e-a1895be0d217 None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d079b7d-5941-45d3-b6f0-f99e343c48bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:21:00 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a369451f-05d4-4151-b69d-01e8f82738d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a] added
Aug 26 19:21:00 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1c2332-b222-4d05-a739-778c1b9799dc]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Successfully updated port: 15e5e2fc-f53b-4490-8446-cdcdd5491a10 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8b9212-0960-4e9d-804a-040656825d3a]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kBypRFGs {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "refresh_cache-a4487be3-7267-4ae1-8731-a6bdf49a6070" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquired lock "refresh_cache-a4487be3-7267-4ae1-8731-a6bdf49a6070" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:21:00 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kBypRFGs" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e37055-5590-4b7d-ba00-467b6f7aad8e]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kBypRFGs'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.compute.manager [req-96d382e1-9c36-49b7-b7b0-b477275c8abe req-e4927aa1-37c6-4f3c-b598-5aaf24364b33 service nova] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Received event network-changed-15e5e2fc-f53b-4490-8446-cdcdd5491a10 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.compute.manager [req-96d382e1-9c36-49b7-b7b0-b477275c8abe req-e4927aa1-37c6-4f3c-b598-5aaf24364b33 service nova] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Refreshing instance network info cache due to event network-changed-15e5e2fc-f53b-4490-8446-cdcdd5491a10. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-96d382e1-9c36-49b7-b7b0-b477275c8abe req-e4927aa1-37c6-4f3c-b598-5aaf24364b33 service nova] Acquiring lock "refresh_cache-a4487be3-7267-4ae1-8731-a6bdf49a6070" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f89ca9c-226c-4a67-ab9a-fc1ba164fcce]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cc07e0-e42a-491d-865e-029cb8aef07a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:21:01 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:21:01 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:21:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:21:01 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:21:01 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:21:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[73224ed8-e802-4f54-ab7b-39081920ae09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a, portal: 172.16.0.220,3260]
Aug 26 19:21:01 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a, portal: 172.16.0.220,3260] successful.
Aug 26 19:21:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[013cb63f-edef-4b48-abb3-043e8b918ea5]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c015c4-20d0-49a9-a92d-68be918f49b3]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:21:01 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:21:01 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:21:01 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:21:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:21:01 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:21:01 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:21:01 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:21:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f532af-cea8-47e9-ae32-2a370a10dde8]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: None {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.objects.instance [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lazy-loading 'flavor' on Instance uuid c78c30ea-1190-44bc-bd78-b3655e251a35 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fec50cd5-2ab7-4128-bcf5-c8b5679f38fd tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.891s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Updating instance_info_cache with network_info: [{"id": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "address": "fa:16:3e:47:7a:17", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e5e2fc-f5", "ovs_interfaceid": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Releasing lock "refresh_cache-a4487be3-7267-4ae1-8731-a6bdf49a6070" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Instance network_info: |[{"id": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "address": "fa:16:3e:47:7a:17", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e5e2fc-f5", "ovs_interfaceid": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-96d382e1-9c36-49b7-b7b0-b477275c8abe req-e4927aa1-37c6-4f3c-b598-5aaf24364b33 service nova] Acquired lock "refresh_cache-a4487be3-7267-4ae1-8731-a6bdf49a6070" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.network.neutron [req-96d382e1-9c36-49b7-b7b0-b477275c8abe req-e4927aa1-37c6-4f3c-b598-5aaf24364b33 service nova] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Refreshing network info cache for port 15e5e2fc-f53b-4490-8446-cdcdd5491a10 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Start _get_guest_xml network_info=[{"id": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "address": "fa:16:3e:47:7a:17", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e5e2fc-f5", "ovs_interfaceid": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:21:01 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:21:01 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-278722069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-278722069',id=32,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68229e3ed72a45fa8c2c9a33780479ce',ramdisk_id='',reservation_id='r-smsvfonw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:20:59Z,user_data=None,user_id='e056c4ed5a18427a8fd1eaa6a3a795c0',uuid=a4487be3-7267-4ae1-8731-a6bdf49a6070,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "address": "fa:16:3e:47:7a:17", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e5e2fc-f5", "ovs_interfaceid": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converting VIF {"id": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "address": "fa:16:3e:47:7a:17", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e5e2fc-f5", "ovs_interfaceid": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:7a:17,bridge_name='br-int',has_traffic_filtering=True,id=15e5e2fc-f53b-4490-8446-cdcdd5491a10,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e5e2fc-f5') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.objects.instance [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'pci_devices' on Instance uuid a4487be3-7267-4ae1-8731-a6bdf49a6070 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:21:01 user nova-compute[73917]:   <uuid>a4487be3-7267-4ae1-8731-a6bdf49a6070</uuid>
Aug 26 19:21:01 user nova-compute[73917]:   <name>instance-00000020</name>
Aug 26 19:21:01 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:21:01 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:21:01 user nova-compute[73917]:   <metadata>
Aug 26 19:21:01 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:21:01 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:21:01 user nova-compute[73917]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-278722069</nova:name>
Aug 26 19:21:01 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:21:01</nova:creationTime>
Aug 26 19:21:01 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:21:01 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:21:01 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:21:01 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:21:01 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:21:01 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:21:01 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:21:01 user nova-compute[73917]:       <nova:owner>
Aug 26 19:21:01 user nova-compute[73917]:         <nova:user uuid="e056c4ed5a18427a8fd1eaa6a3a795c0">tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member</nova:user>
Aug 26 19:21:01 user nova-compute[73917]:         <nova:project uuid="68229e3ed72a45fa8c2c9a33780479ce">tempest-ServerBootFromVolumeStableRescueTest-1067875450</nova:project>
Aug 26 19:21:01 user nova-compute[73917]:       </nova:owner>
Aug 26 19:21:01 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:21:01 user nova-compute[73917]:       <nova:ports>
Aug 26 19:21:01 user nova-compute[73917]:         <nova:port uuid="15e5e2fc-f53b-4490-8446-cdcdd5491a10">
Aug 26 19:21:01 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 19:21:01 user nova-compute[73917]:         </nova:port>
Aug 26 19:21:01 user nova-compute[73917]:       </nova:ports>
Aug 26 19:21:01 user nova-compute[73917]:     </nova:instance>
Aug 26 19:21:01 user nova-compute[73917]:   </metadata>
Aug 26 19:21:01 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:21:01 user nova-compute[73917]:     <system>
Aug 26 19:21:01 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:21:01 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:21:01 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:21:01 user nova-compute[73917]:       <entry name="serial">a4487be3-7267-4ae1-8731-a6bdf49a6070</entry>
Aug 26 19:21:01 user nova-compute[73917]:       <entry name="uuid">a4487be3-7267-4ae1-8731-a6bdf49a6070</entry>
Aug 26 19:21:01 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:21:01 user nova-compute[73917]:     </system>
Aug 26 19:21:01 user nova-compute[73917]:   </sysinfo>
Aug 26 19:21:01 user nova-compute[73917]:   <os>
Aug 26 19:21:01 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:21:01 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:21:01 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:21:01 user nova-compute[73917]:   </os>
Aug 26 19:21:01 user nova-compute[73917]:   <features>
Aug 26 19:21:01 user nova-compute[73917]:     <acpi/>
Aug 26 19:21:01 user nova-compute[73917]:     <apic/>
Aug 26 19:21:01 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:21:01 user nova-compute[73917]:   </features>
Aug 26 19:21:01 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:21:01 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:21:01 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:21:01 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:21:01 user nova-compute[73917]:   </clock>
Aug 26 19:21:01 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:21:01 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:21:01 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:21:01 user nova-compute[73917]:   </cpu>
Aug 26 19:21:01 user nova-compute[73917]:   <devices>
Aug 26 19:21:01 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:21:01 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:21:01 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk"/>
Aug 26 19:21:01 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:21:01 user nova-compute[73917]:     </disk>
Aug 26 19:21:01 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:21:01 user nova-compute[73917]:       <mac address="fa:16:3e:47:7a:17"/>
Aug 26 19:21:01 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:21:01 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:21:01 user nova-compute[73917]:       <target dev="tap15e5e2fc-f5"/>
Aug 26 19:21:01 user nova-compute[73917]:     </interface>
Aug 26 19:21:01 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:21:01 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/console.log" append="off"/>
Aug 26 19:21:01 user nova-compute[73917]:     </serial>
Aug 26 19:21:01 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:21:01 user nova-compute[73917]:     <video>
Aug 26 19:21:01 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:21:01 user nova-compute[73917]:     </video>
Aug 26 19:21:01 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:21:01 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:21:01 user nova-compute[73917]:     </rng>
Aug 26 19:21:01 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:21:01 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:21:01 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:21:01 user nova-compute[73917]:     </memballoon>
Aug 26 19:21:01 user nova-compute[73917]:   </devices>
Aug 26 19:21:01 user nova-compute[73917]: </domain>
Aug 26 19:21:01 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-278722069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-278722069',id=32,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68229e3ed72a45fa8c2c9a33780479ce',ramdisk_id='',reservation_id='r-smsvfonw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:20:59Z,user_data=None,user_id='e056c4ed5a18427a8fd1eaa6a3a795c0',uuid=a4487be3-7267-4ae1-8731-a6bdf49a6070,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "address": "fa:16:3e:47:7a:17", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e5e2fc-f5", "ovs_interfaceid": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converting VIF {"id": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "address": "fa:16:3e:47:7a:17", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e5e2fc-f5", "ovs_interfaceid": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:7a:17,bridge_name='br-int',has_traffic_filtering=True,id=15e5e2fc-f53b-4490-8446-cdcdd5491a10,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e5e2fc-f5') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG os_vif [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:7a:17,bridge_name='br-int',has_traffic_filtering=True,id=15e5e2fc-f53b-4490-8446-cdcdd5491a10,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e5e2fc-f5') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15e5e2fc-f5, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15e5e2fc-f5, col_values=(('external_ids', {'iface-id': '15e5e2fc-f53b-4490-8446-cdcdd5491a10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:7a:17', 'vm-uuid': 'a4487be3-7267-4ae1-8731-a6bdf49a6070'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:01 user nova-compute[73917]: INFO os_vif [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:7a:17,bridge_name='br-int',has_traffic_filtering=True,id=15e5e2fc-f53b-4490-8446-cdcdd5491a10,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e5e2fc-f5')
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] No VIF found with MAC fa:16:3e:47:7a:17, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.network.neutron [req-96d382e1-9c36-49b7-b7b0-b477275c8abe req-e4927aa1-37c6-4f3c-b598-5aaf24364b33 service nova] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Updated VIF entry in instance network info cache for port 15e5e2fc-f53b-4490-8446-cdcdd5491a10. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG nova.network.neutron [req-96d382e1-9c36-49b7-b7b0-b477275c8abe req-e4927aa1-37c6-4f3c-b598-5aaf24364b33 service nova] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Updating instance_info_cache with network_info: [{"id": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "address": "fa:16:3e:47:7a:17", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e5e2fc-f5", "ovs_interfaceid": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:21:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-96d382e1-9c36-49b7-b7b0-b477275c8abe req-e4927aa1-37c6-4f3c-b598-5aaf24364b33 service nova] Releasing lock "refresh_cache-a4487be3-7267-4ae1-8731-a6bdf49a6070" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kBypRFGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23531306438393361', 'path': '/dev/sde'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531306438393361', 'path': '/dev/sde'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1428844380',display_name='tempest-ServerActionsTestOtherA-server-1428844380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1428844380',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoE8tZDc68JWUNde0nWnasqq1vYa5ON2YNQwHw+xO1EiolhKGRVVBiykxwLyvBezUmZpO4CsEARWWqkHIKpn0pTvCPDPPJIP+G7BbRXcHe4wp+29J3exWEnrrk3yPKzjg==',key_name='tempest-keypair-1254307896',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:19:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2e09fe7b38e4bb991bfaaf5b4ad357a',ramdisk_id='',reservation_id='r-4dv3wxu4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2069094918',owner_user_name='tempest-ServerActionsTestOtherA-2069094918-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:20:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd1b7d3fe22c4b239cf03235866e17d4',uuid=4a2d91a5-9943-43f6-b919-30510ccba727,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-292934733-network", "vif_mac": "fa:16:3e:d9:5d:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converting VIF {"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-292934733-network", "vif_mac": "fa:16:3e:d9:5d:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=af8c2f16-54b2-4a39-b893-e95b3794b8b1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c2f16-54') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:21:02 user nova-compute[73917]:   <uuid>4a2d91a5-9943-43f6-b919-30510ccba727</uuid>
Aug 26 19:21:02 user nova-compute[73917]:   <name>instance-0000001f</name>
Aug 26 19:21:02 user nova-compute[73917]:   <memory>2097152</memory>
Aug 26 19:21:02 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:21:02 user nova-compute[73917]:   <metadata>
Aug 26 19:21:02 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:21:02 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:21:02 user nova-compute[73917]:       <nova:name>tempest-ServerActionsTestOtherA-server-1428844380</nova:name>
Aug 26 19:21:02 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:21:00</nova:creationTime>
Aug 26 19:21:02 user nova-compute[73917]:       <nova:flavor name="m1.small">
Aug 26 19:21:02 user nova-compute[73917]:         <nova:memory>2048</nova:memory>
Aug 26 19:21:02 user nova-compute[73917]:         <nova:disk>20</nova:disk>
Aug 26 19:21:02 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:21:02 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:21:02 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:21:02 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:21:02 user nova-compute[73917]:       <nova:owner>
Aug 26 19:21:02 user nova-compute[73917]:         <nova:user uuid="cd1b7d3fe22c4b239cf03235866e17d4">tempest-ServerActionsTestOtherA-2069094918-project-member</nova:user>
Aug 26 19:21:02 user nova-compute[73917]:         <nova:project uuid="c2e09fe7b38e4bb991bfaaf5b4ad357a">tempest-ServerActionsTestOtherA-2069094918</nova:project>
Aug 26 19:21:02 user nova-compute[73917]:       </nova:owner>
Aug 26 19:21:02 user nova-compute[73917]:       <nova:ports>
Aug 26 19:21:02 user nova-compute[73917]:         <nova:port uuid="af8c2f16-54b2-4a39-b893-e95b3794b8b1">
Aug 26 19:21:02 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 19:21:02 user nova-compute[73917]:         </nova:port>
Aug 26 19:21:02 user nova-compute[73917]:       </nova:ports>
Aug 26 19:21:02 user nova-compute[73917]:     </nova:instance>
Aug 26 19:21:02 user nova-compute[73917]:   </metadata>
Aug 26 19:21:02 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:21:02 user nova-compute[73917]:     <system>
Aug 26 19:21:02 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:21:02 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:21:02 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:21:02 user nova-compute[73917]:       <entry name="serial">4a2d91a5-9943-43f6-b919-30510ccba727</entry>
Aug 26 19:21:02 user nova-compute[73917]:       <entry name="uuid">4a2d91a5-9943-43f6-b919-30510ccba727</entry>
Aug 26 19:21:02 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:21:02 user nova-compute[73917]:     </system>
Aug 26 19:21:02 user nova-compute[73917]:   </sysinfo>
Aug 26 19:21:02 user nova-compute[73917]:   <os>
Aug 26 19:21:02 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:21:02 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:21:02 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:21:02 user nova-compute[73917]:   </os>
Aug 26 19:21:02 user nova-compute[73917]:   <features>
Aug 26 19:21:02 user nova-compute[73917]:     <acpi/>
Aug 26 19:21:02 user nova-compute[73917]:     <apic/>
Aug 26 19:21:02 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:21:02 user nova-compute[73917]:   </features>
Aug 26 19:21:02 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:21:02 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:21:02 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:21:02 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:21:02 user nova-compute[73917]:   </clock>
Aug 26 19:21:02 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:21:02 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:21:02 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:21:02 user nova-compute[73917]:   </cpu>
Aug 26 19:21:02 user nova-compute[73917]:   <devices>
Aug 26 19:21:02 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:21:02 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:21:02 user nova-compute[73917]:       <source dev="/dev/sde"/>
Aug 26 19:21:02 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:21:02 user nova-compute[73917]:       <serial>4c062201-81b9-42d1-8ae2-5b6fe648bc2a</serial>
Aug 26 19:21:02 user nova-compute[73917]:     </disk>
Aug 26 19:21:02 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:21:02 user nova-compute[73917]:       <mac address="fa:16:3e:d9:5d:6b"/>
Aug 26 19:21:02 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:21:02 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:21:02 user nova-compute[73917]:       <target dev="tapaf8c2f16-54"/>
Aug 26 19:21:02 user nova-compute[73917]:     </interface>
Aug 26 19:21:02 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:21:02 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/4a2d91a5-9943-43f6-b919-30510ccba727/console.log" append="off"/>
Aug 26 19:21:02 user nova-compute[73917]:     </serial>
Aug 26 19:21:02 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:21:02 user nova-compute[73917]:     <video>
Aug 26 19:21:02 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:21:02 user nova-compute[73917]:     </video>
Aug 26 19:21:02 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:21:02 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:21:02 user nova-compute[73917]:     </rng>
Aug 26 19:21:02 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:21:02 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:21:02 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:21:02 user nova-compute[73917]:     </memballoon>
Aug 26 19:21:02 user nova-compute[73917]:   </devices>
Aug 26 19:21:02 user nova-compute[73917]: </domain>
Aug 26 19:21:02 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1428844380',display_name='tempest-ServerActionsTestOtherA-server-1428844380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1428844380',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoE8tZDc68JWUNde0nWnasqq1vYa5ON2YNQwHw+xO1EiolhKGRVVBiykxwLyvBezUmZpO4CsEARWWqkHIKpn0pTvCPDPPJIP+G7BbRXcHe4wp+29J3exWEnrrk3yPKzjg==',key_name='tempest-keypair-1254307896',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:19:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2e09fe7b38e4bb991bfaaf5b4ad357a',ramdisk_id='',reservation_id='r-4dv3wxu4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2069094918',owner_user_name='tempest-ServerActionsTestOtherA-2069094918-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:20:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd1b7d3fe22c4b239cf03235866e17d4',uuid=4a2d91a5-9943-43f6-b919-30510ccba727,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-292934733-network", "vif_mac": "fa:16:3e:d9:5d:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converting VIF {"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-292934733-network", "vif_mac": "fa:16:3e:d9:5d:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=af8c2f16-54b2-4a39-b893-e95b3794b8b1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c2f16-54') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG os_vif [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=af8c2f16-54b2-4a39-b893-e95b3794b8b1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c2f16-54') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf8c2f16-54, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf8c2f16-54, col_values=(('external_ids', {'iface-id': 'af8c2f16-54b2-4a39-b893-e95b3794b8b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:5d:6b', 'vm-uuid': '4a2d91a5-9943-43f6-b919-30510ccba727'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:02 user nova-compute[73917]: INFO os_vif [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=af8c2f16-54b2-4a39-b893-e95b3794b8b1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c2f16-54')
Aug 26 19:21:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:21:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] No VIF found with MAC fa:16:3e:d9:5d:6b, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:21:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:03 user nova-compute[73917]: DEBUG nova.compute.manager [req-afacbc55-a940-4477-8920-516adca1c9ab req-3d66b4b3-a152-4282-9376-d57d1cca7062 service nova] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Received event network-vif-plugged-15e5e2fc-f53b-4490-8446-cdcdd5491a10 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:21:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-afacbc55-a940-4477-8920-516adca1c9ab req-3d66b4b3-a152-4282-9376-d57d1cca7062 service nova] Acquiring lock "a4487be3-7267-4ae1-8731-a6bdf49a6070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-afacbc55-a940-4477-8920-516adca1c9ab req-3d66b4b3-a152-4282-9376-d57d1cca7062 service nova] Lock "a4487be3-7267-4ae1-8731-a6bdf49a6070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-afacbc55-a940-4477-8920-516adca1c9ab req-3d66b4b3-a152-4282-9376-d57d1cca7062 service nova] Lock "a4487be3-7267-4ae1-8731-a6bdf49a6070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:03 user nova-compute[73917]: DEBUG nova.compute.manager [req-afacbc55-a940-4477-8920-516adca1c9ab req-3d66b4b3-a152-4282-9376-d57d1cca7062 service nova] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] No waiting events found dispatching network-vif-plugged-15e5e2fc-f53b-4490-8446-cdcdd5491a10 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:21:03 user nova-compute[73917]: WARNING nova.compute.manager [req-afacbc55-a940-4477-8920-516adca1c9ab req-3d66b4b3-a152-4282-9376-d57d1cca7062 service nova] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Received unexpected event network-vif-plugged-15e5e2fc-f53b-4490-8446-cdcdd5491a10 for instance with vm_state building and task_state spawning.
Aug 26 19:21:04 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077649.121317, f486f10e-1cb0-47f6-b8f5-9cafe1c231f8 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:21:04 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] VM Stopped (Lifecycle Event)
Aug 26 19:21:04 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dd754024-c9ae-48e4-b5e1-af795f85d01b None None] [instance: f486f10e-1cb0-47f6-b8f5-9cafe1c231f8] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:21:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:06 user nova-compute[73917]: DEBUG nova.compute.manager [req-aede4ccf-df8f-4861-b1cd-aa8b9ba01936 req-2e4a633b-5b34-4da1-8c86-318088efb223 service nova] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Received event network-vif-plugged-15e5e2fc-f53b-4490-8446-cdcdd5491a10 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:21:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-aede4ccf-df8f-4861-b1cd-aa8b9ba01936 req-2e4a633b-5b34-4da1-8c86-318088efb223 service nova] Acquiring lock "a4487be3-7267-4ae1-8731-a6bdf49a6070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-aede4ccf-df8f-4861-b1cd-aa8b9ba01936 req-2e4a633b-5b34-4da1-8c86-318088efb223 service nova] Lock "a4487be3-7267-4ae1-8731-a6bdf49a6070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-aede4ccf-df8f-4861-b1cd-aa8b9ba01936 req-2e4a633b-5b34-4da1-8c86-318088efb223 service nova] Lock "a4487be3-7267-4ae1-8731-a6bdf49a6070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:06 user nova-compute[73917]: DEBUG nova.compute.manager [req-aede4ccf-df8f-4861-b1cd-aa8b9ba01936 req-2e4a633b-5b34-4da1-8c86-318088efb223 service nova] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] No waiting events found dispatching network-vif-plugged-15e5e2fc-f53b-4490-8446-cdcdd5491a10 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:21:06 user nova-compute[73917]: WARNING nova.compute.manager [req-aede4ccf-df8f-4861-b1cd-aa8b9ba01936 req-2e4a633b-5b34-4da1-8c86-318088efb223 service nova] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Received unexpected event network-vif-plugged-15e5e2fc-f53b-4490-8446-cdcdd5491a10 for instance with vm_state building and task_state spawning.
Aug 26 19:21:06 user nova-compute[73917]: DEBUG nova.compute.manager [req-aede4ccf-df8f-4861-b1cd-aa8b9ba01936 req-2e4a633b-5b34-4da1-8c86-318088efb223 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Received event network-vif-plugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:21:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-aede4ccf-df8f-4861-b1cd-aa8b9ba01936 req-2e4a633b-5b34-4da1-8c86-318088efb223 service nova] Acquiring lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-aede4ccf-df8f-4861-b1cd-aa8b9ba01936 req-2e4a633b-5b34-4da1-8c86-318088efb223 service nova] Lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-aede4ccf-df8f-4861-b1cd-aa8b9ba01936 req-2e4a633b-5b34-4da1-8c86-318088efb223 service nova] Lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:06 user nova-compute[73917]: DEBUG nova.compute.manager [req-aede4ccf-df8f-4861-b1cd-aa8b9ba01936 req-2e4a633b-5b34-4da1-8c86-318088efb223 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] No waiting events found dispatching network-vif-plugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:21:06 user nova-compute[73917]: WARNING nova.compute.manager [req-aede4ccf-df8f-4861-b1cd-aa8b9ba01936 req-2e4a633b-5b34-4da1-8c86-318088efb223 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Received unexpected event network-vif-plugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 for instance with vm_state active and task_state resize_finish.
Aug 26 19:21:06 user nova-compute[73917]: DEBUG nova.compute.manager [req-aede4ccf-df8f-4861-b1cd-aa8b9ba01936 req-2e4a633b-5b34-4da1-8c86-318088efb223 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Received event network-vif-plugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:21:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-aede4ccf-df8f-4861-b1cd-aa8b9ba01936 req-2e4a633b-5b34-4da1-8c86-318088efb223 service nova] Acquiring lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-aede4ccf-df8f-4861-b1cd-aa8b9ba01936 req-2e4a633b-5b34-4da1-8c86-318088efb223 service nova] Lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-aede4ccf-df8f-4861-b1cd-aa8b9ba01936 req-2e4a633b-5b34-4da1-8c86-318088efb223 service nova] Lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:06 user nova-compute[73917]: DEBUG nova.compute.manager [req-aede4ccf-df8f-4861-b1cd-aa8b9ba01936 req-2e4a633b-5b34-4da1-8c86-318088efb223 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] No waiting events found dispatching network-vif-plugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:21:06 user nova-compute[73917]: WARNING nova.compute.manager [req-aede4ccf-df8f-4861-b1cd-aa8b9ba01936 req-2e4a633b-5b34-4da1-8c86-318088efb223 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Received unexpected event network-vif-plugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 for instance with vm_state active and task_state resize_finish.
Aug 26 19:21:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077667.4173756, 4a2d91a5-9943-43f6-b919-30510ccba727 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:21:07 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] VM Resumed (Lifecycle Event)
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:21:07 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Instance running successfully.
Aug 26 19:21:07 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Instance spawned successfully.
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Failed to set time: agent not configured {{(pid=73917) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a8ecddc4-df74-4daf-b21b-2a47c5c6645b tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] finish_migration finished successfully. {{(pid=73917) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:07 user nova-compute[73917]: INFO nova.compute.manager [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Terminating instance
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:21:07 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077667.4218194, 4a2d91a5-9943-43f6-b919-30510ccba727 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:21:07 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] VM Started (Lifecycle Event)
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:21:07 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077667.429308, a4487be3-7267-4ae1-8731-a6bdf49a6070 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:21:07 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] VM Resumed (Lifecycle Event)
Aug 26 19:21:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:07 user nova-compute[73917]: INFO nova.compute.manager [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Took 8.73 seconds to spawn the instance on the hypervisor.
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:21:07 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077667.429571, a4487be3-7267-4ae1-8731-a6bdf49a6070 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:21:07 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] VM Started (Lifecycle Event)
Aug 26 19:21:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:21:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:21:07 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:21:07 user nova-compute[73917]: INFO nova.compute.manager [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Took 9.76 seconds to build instance.
Aug 26 19:21:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ac6429d7-bcf4-49f5-9088-691d00adf713 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "a4487be3-7267-4ae1-8731-a6bdf49a6070" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.890s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG nova.compute.manager [req-e21e263d-e197-4c80-b8b6-f2c7ab06c5ef req-1e4f56b9-337c-4483-95ba-3009efeec614 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Received event network-vif-unplugged-3e638e90-1dab-4162-ab6b-6e537238b027 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e21e263d-e197-4c80-b8b6-f2c7ab06c5ef req-1e4f56b9-337c-4483-95ba-3009efeec614 service nova] Acquiring lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e21e263d-e197-4c80-b8b6-f2c7ab06c5ef req-1e4f56b9-337c-4483-95ba-3009efeec614 service nova] Lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e21e263d-e197-4c80-b8b6-f2c7ab06c5ef req-1e4f56b9-337c-4483-95ba-3009efeec614 service nova] Lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG nova.compute.manager [req-e21e263d-e197-4c80-b8b6-f2c7ab06c5ef req-1e4f56b9-337c-4483-95ba-3009efeec614 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] No waiting events found dispatching network-vif-unplugged-3e638e90-1dab-4162-ab6b-6e537238b027 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG nova.compute.manager [req-e21e263d-e197-4c80-b8b6-f2c7ab06c5ef req-1e4f56b9-337c-4483-95ba-3009efeec614 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Received event network-vif-unplugged-3e638e90-1dab-4162-ab6b-6e537238b027 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:08 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Instance destroyed successfully.
Aug 26 19:21:08 user nova-compute[73917]: DEBUG nova.objects.instance [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lazy-loading 'resources' on Instance uuid dde8f1cd-d55b-49cf-a775-196cbc059fa9 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:17:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1904116845',display_name='tempest-AttachVolumeNegativeTest-server-1904116845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1904116845',id=28,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzOVRPJBUo95UBWHjdF4vaeBFe61lGJslNuuDQj5HvwE6SRn2BOdkCmBj62LYnlSoeMf93LDTQGKFQeaieiVgkMVqAwX5/sCTs1aRR5xmgQ761FER2V9IdWx5r97RE5Yw==',key_name='tempest-keypair-1218103215',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:17:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b291bbf9aedc4414a1ab402602849140',ramdisk_id='',reservation_id='r-jt04o40h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2066333616',owner_user_name='tempest-AttachVolumeNegativeTest-2066333616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:18:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c64a5d226b8b4d60af840d49315bf60f',uuid=dde8f1cd-d55b-49cf-a775-196cbc059fa9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e638e90-1dab-4162-ab6b-6e537238b027", "address": "fa:16:3e:ec:3c:4a", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e638e90-1d", "ovs_interfaceid": "3e638e90-1dab-4162-ab6b-6e537238b027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converting VIF {"id": "3e638e90-1dab-4162-ab6b-6e537238b027", "address": "fa:16:3e:ec:3c:4a", "network": {"id": "ac028b98-ca02-4339-bd0d-e854d3b85e42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1264921240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b291bbf9aedc4414a1ab402602849140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e638e90-1d", "ovs_interfaceid": "3e638e90-1dab-4162-ab6b-6e537238b027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:3c:4a,bridge_name='br-int',has_traffic_filtering=True,id=3e638e90-1dab-4162-ab6b-6e537238b027,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e638e90-1d') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG os_vif [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:3c:4a,bridge_name='br-int',has_traffic_filtering=True,id=3e638e90-1dab-4162-ab6b-6e537238b027,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e638e90-1d') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e638e90-1d, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:21:08 user nova-compute[73917]: INFO os_vif [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:3c:4a,bridge_name='br-int',has_traffic_filtering=True,id=3e638e90-1dab-4162-ab6b-6e537238b027,network=Network(ac028b98-ca02-4339-bd0d-e854d3b85e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e638e90-1d')
Aug 26 19:21:08 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Deleting instance files /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9_del
Aug 26 19:21:08 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Deletion of /opt/stack/data/nova/instances/dde8f1cd-d55b-49cf-a775-196cbc059fa9_del complete
Aug 26 19:21:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:08 user nova-compute[73917]: INFO nova.compute.manager [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 26 19:21:08 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:21:09 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Error from libvirt while getting description of instance-0000001c: [Error Code 42] Domain not found: no domain with matching uuid 'dde8f1cd-d55b-49cf-a775-196cbc059fa9' (instance-0000001c): libvirt.libvirtError: Domain not found: no domain with matching uuid 'dde8f1cd-d55b-49cf-a775-196cbc059fa9' (instance-0000001c)
Aug 26 19:21:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:21:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:10 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:21:10 user nova-compute[73917]: DEBUG nova.compute.manager [req-396505f7-7b46-4489-8c5a-49d64c467f0f req-ffb7959f-0fa5-40e3-b26e-7700cb5d0200 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Received event network-vif-deleted-3e638e90-1dab-4162-ab6b-6e537238b027 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:21:10 user nova-compute[73917]: INFO nova.compute.manager [req-396505f7-7b46-4489-8c5a-49d64c467f0f req-ffb7959f-0fa5-40e3-b26e-7700cb5d0200 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Neutron deleted interface 3e638e90-1dab-4162-ab6b-6e537238b027; detaching it from the instance and deleting it from the info cache
Aug 26 19:21:10 user nova-compute[73917]: DEBUG nova.network.neutron [req-396505f7-7b46-4489-8c5a-49d64c467f0f req-ffb7959f-0fa5-40e3-b26e-7700cb5d0200 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:21:10 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Took 1.52 seconds to deallocate network for instance.
Aug 26 19:21:10 user nova-compute[73917]: DEBUG nova.compute.manager [req-274dfac8-acee-4176-bd96-92eb5e2cced4 req-9038f3f8-7169-4070-a5b2-5820e9caf113 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Received event network-vif-plugged-3e638e90-1dab-4162-ab6b-6e537238b027 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:21:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-274dfac8-acee-4176-bd96-92eb5e2cced4 req-9038f3f8-7169-4070-a5b2-5820e9caf113 service nova] Acquiring lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-274dfac8-acee-4176-bd96-92eb5e2cced4 req-9038f3f8-7169-4070-a5b2-5820e9caf113 service nova] Lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-274dfac8-acee-4176-bd96-92eb5e2cced4 req-9038f3f8-7169-4070-a5b2-5820e9caf113 service nova] Lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:10 user nova-compute[73917]: DEBUG nova.compute.manager [req-274dfac8-acee-4176-bd96-92eb5e2cced4 req-9038f3f8-7169-4070-a5b2-5820e9caf113 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] No waiting events found dispatching network-vif-plugged-3e638e90-1dab-4162-ab6b-6e537238b027 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:21:10 user nova-compute[73917]: WARNING nova.compute.manager [req-274dfac8-acee-4176-bd96-92eb5e2cced4 req-9038f3f8-7169-4070-a5b2-5820e9caf113 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Received unexpected event network-vif-plugged-3e638e90-1dab-4162-ab6b-6e537238b027 for instance with vm_state active and task_state deleting.
Aug 26 19:21:10 user nova-compute[73917]: DEBUG nova.compute.manager [req-396505f7-7b46-4489-8c5a-49d64c467f0f req-ffb7959f-0fa5-40e3-b26e-7700cb5d0200 service nova] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Detach interface failed, port_id=3e638e90-1dab-4162-ab6b-6e537238b027, reason: Instance dde8f1cd-d55b-49cf-a775-196cbc059fa9 could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:21:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:10 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:21:10 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:21:10 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:21:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:10 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:21:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.688s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:10 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Deleted allocations for instance dde8f1cd-d55b-49cf-a775-196cbc059fa9
Aug 26 19:21:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6e9dcde3-2bfc-40bc-a6d8-fd62a5d2fc0a tempest-AttachVolumeNegativeTest-2066333616 tempest-AttachVolumeNegativeTest-2066333616-project-member] Lock "dde8f1cd-d55b-49cf-a775-196cbc059fa9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.551s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:13 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:21:13 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:21:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=7258MB free_disk=25.252655029296875GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:21:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Applying migration context for instance 4a2d91a5-9943-43f6-b919-30510ccba727 as it has an incoming, in-progress migration 2bd04bdf-4db4-4b04-afb6-e24d63bef27e. Migration status is finished {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 19:21:13 user nova-compute[73917]: INFO nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Updating resource usage from migration 2bd04bdf-4db4-4b04-afb6-e24d63bef27e
Aug 26 19:21:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance cc0ae046-2a39-4ab6-9327-2d9452c3035d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:21:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fd801f18-34b6-4682-8d43-edf82bd216c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:21:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:21:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 481cc682-2004-434d-b4eb-1688b0b07dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:21:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 94f8d4e7-f310-45df-a0ae-82e608ac0119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:21:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance df5c717a-62d8-444d-9968-ad682a31733c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:21:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f4e84db3-1f3b-471f-9f82-5a692fdb6c06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:21:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance dca28d65-37d0-4b60-b8aa-dcca61b6a187 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:21:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c78c30ea-1190-44bc-bd78-b3655e251a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:21:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Migration 2bd04bdf-4db4-4b04-afb6-e24d63bef27e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 19:21:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 4a2d91a5-9943-43f6-b919-30510ccba727 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:21:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance a4487be3-7267-4ae1-8731-a6bdf49a6070 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:21:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:21:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:21:14 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:21:14 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:21:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:21:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.669s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Acquiring lock "481cc682-2004-434d-b4eb-1688b0b07dd6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "481cc682-2004-434d-b4eb-1688b0b07dd6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Acquiring lock "481cc682-2004-434d-b4eb-1688b0b07dd6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "481cc682-2004-434d-b4eb-1688b0b07dd6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "481cc682-2004-434d-b4eb-1688b0b07dd6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:15 user nova-compute[73917]: INFO nova.compute.manager [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Terminating instance
Aug 26 19:21:15 user nova-compute[73917]: DEBUG nova.compute.manager [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:21:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-b59313e0-6865-41eb-9986-1f468f7e7daf req-9af909df-5367-41d0-9d90-453334f9e213 service nova] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Received event network-vif-unplugged-d85d1b22-c0c9-4405-a446-6c6480502b54 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:21:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b59313e0-6865-41eb-9986-1f468f7e7daf req-9af909df-5367-41d0-9d90-453334f9e213 service nova] Acquiring lock "481cc682-2004-434d-b4eb-1688b0b07dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b59313e0-6865-41eb-9986-1f468f7e7daf req-9af909df-5367-41d0-9d90-453334f9e213 service nova] Lock "481cc682-2004-434d-b4eb-1688b0b07dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b59313e0-6865-41eb-9986-1f468f7e7daf req-9af909df-5367-41d0-9d90-453334f9e213 service nova] Lock "481cc682-2004-434d-b4eb-1688b0b07dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-b59313e0-6865-41eb-9986-1f468f7e7daf req-9af909df-5367-41d0-9d90-453334f9e213 service nova] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] No waiting events found dispatching network-vif-unplugged-d85d1b22-c0c9-4405-a446-6c6480502b54 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:21:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-b59313e0-6865-41eb-9986-1f468f7e7daf req-9af909df-5367-41d0-9d90-453334f9e213 service nova] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Received event network-vif-unplugged-d85d1b22-c0c9-4405-a446-6c6480502b54 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:21:16 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Instance destroyed successfully.
Aug 26 19:21:16 user nova-compute[73917]: DEBUG nova.objects.instance [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lazy-loading 'resources' on Instance uuid 481cc682-2004-434d-b4eb-1688b0b07dd6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:21:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-5119324',display_name='tempest-ServersNegativeTestJSON-server-5119324',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-5119324',id=17,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:12:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae04a1daa9c34775b7edfbce043b47c1',ramdisk_id='',reservation_id='r-4n6w0xta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-252207510',owner_user_name='tempest-ServersNegativeTestJSON-252207510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:12:24Z,user_data=None,user_id='811ce763d55a4aefb116079215d01fdb',uuid=481cc682-2004-434d-b4eb-1688b0b07dd6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d85d1b22-c0c9-4405-a446-6c6480502b54", "address": "fa:16:3e:4a:44:56", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85d1b22-c0", "ovs_interfaceid": "d85d1b22-c0c9-4405-a446-6c6480502b54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:21:16 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Converting VIF {"id": "d85d1b22-c0c9-4405-a446-6c6480502b54", "address": "fa:16:3e:4a:44:56", "network": {"id": "06a65360-57e6-4419-8e18-8cfb937e1704", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-926453843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae04a1daa9c34775b7edfbce043b47c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd85d1b22-c0", "ovs_interfaceid": "d85d1b22-c0c9-4405-a446-6c6480502b54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:21:16 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:44:56,bridge_name='br-int',has_traffic_filtering=True,id=d85d1b22-c0c9-4405-a446-6c6480502b54,network=Network(06a65360-57e6-4419-8e18-8cfb937e1704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd85d1b22-c0') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:21:16 user nova-compute[73917]: DEBUG os_vif [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:44:56,bridge_name='br-int',has_traffic_filtering=True,id=d85d1b22-c0c9-4405-a446-6c6480502b54,network=Network(06a65360-57e6-4419-8e18-8cfb937e1704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd85d1b22-c0') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:21:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd85d1b22-c0, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:21:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:21:16 user nova-compute[73917]: INFO os_vif [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:44:56,bridge_name='br-int',has_traffic_filtering=True,id=d85d1b22-c0c9-4405-a446-6c6480502b54,network=Network(06a65360-57e6-4419-8e18-8cfb937e1704),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd85d1b22-c0')
Aug 26 19:21:16 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Deleting instance files /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6_del
Aug 26 19:21:16 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Deletion of /opt/stack/data/nova/instances/481cc682-2004-434d-b4eb-1688b0b07dd6_del complete
Aug 26 19:21:16 user nova-compute[73917]: INFO nova.compute.manager [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 26 19:21:16 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:21:16 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:21:16 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:21:17 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:21:17 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Took 1.05 seconds to deallocate network for instance.
Aug 26 19:21:17 user nova-compute[73917]: DEBUG nova.compute.manager [req-3efc07ad-506a-43d4-ac22-298b09c905e7 req-e4f86a9b-4f13-477f-ae61-d59d3e6f8804 service nova] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Received event network-vif-deleted-d85d1b22-c0c9-4405-a446-6c6480502b54 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:21:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:17 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:21:17 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:21:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.520s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:18 user nova-compute[73917]: DEBUG nova.compute.manager [req-16524d73-adef-4261-8895-f0d79932a6cb req-3924a24f-7b99-47b4-a083-7a95c58bf137 service nova] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Received event network-vif-plugged-d85d1b22-c0c9-4405-a446-6c6480502b54 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:21:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-16524d73-adef-4261-8895-f0d79932a6cb req-3924a24f-7b99-47b4-a083-7a95c58bf137 service nova] Acquiring lock "481cc682-2004-434d-b4eb-1688b0b07dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-16524d73-adef-4261-8895-f0d79932a6cb req-3924a24f-7b99-47b4-a083-7a95c58bf137 service nova] Lock "481cc682-2004-434d-b4eb-1688b0b07dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-16524d73-adef-4261-8895-f0d79932a6cb req-3924a24f-7b99-47b4-a083-7a95c58bf137 service nova] Lock "481cc682-2004-434d-b4eb-1688b0b07dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:18 user nova-compute[73917]: DEBUG nova.compute.manager [req-16524d73-adef-4261-8895-f0d79932a6cb req-3924a24f-7b99-47b4-a083-7a95c58bf137 service nova] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] No waiting events found dispatching network-vif-plugged-d85d1b22-c0c9-4405-a446-6c6480502b54 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:21:18 user nova-compute[73917]: WARNING nova.compute.manager [req-16524d73-adef-4261-8895-f0d79932a6cb req-3924a24f-7b99-47b4-a083-7a95c58bf137 service nova] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Received unexpected event network-vif-plugged-d85d1b22-c0c9-4405-a446-6c6480502b54 for instance with vm_state deleted and task_state None.
Aug 26 19:21:18 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Deleted allocations for instance 481cc682-2004-434d-b4eb-1688b0b07dd6
Aug 26 19:21:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4c91844a-0553-4e06-a636-c2abe73d35c6 tempest-ServersNegativeTestJSON-252207510 tempest-ServersNegativeTestJSON-252207510-project-member] Lock "481cc682-2004-434d-b4eb-1688b0b07dd6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.639s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:18 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:21:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:23 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077668.3685496, dde8f1cd-d55b-49cf-a775-196cbc059fa9 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:21:23 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] VM Stopped (Lifecycle Event)
Aug 26 19:21:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ea4a7284-138a-4298-ad4f-86bb46abfae2 None None] [instance: dde8f1cd-d55b-49cf-a775-196cbc059fa9] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:21:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-167575d5-c304-4058-8eb4-b367f42ff9d5 req-cbf32c43-7cb0-40f5-bac2-5d0e621b3d55 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received event network-changed-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:21:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-167575d5-c304-4058-8eb4-b367f42ff9d5 req-cbf32c43-7cb0-40f5-bac2-5d0e621b3d55 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Refreshing instance network info cache due to event network-changed-c7ef21a0-d036-4b14-8067-594a1f2181ba. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:21:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-167575d5-c304-4058-8eb4-b367f42ff9d5 req-cbf32c43-7cb0-40f5-bac2-5d0e621b3d55 service nova] Acquiring lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:21:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-167575d5-c304-4058-8eb4-b367f42ff9d5 req-cbf32c43-7cb0-40f5-bac2-5d0e621b3d55 service nova] Acquired lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:21:24 user nova-compute[73917]: DEBUG nova.network.neutron [req-167575d5-c304-4058-8eb4-b367f42ff9d5 req-cbf32c43-7cb0-40f5-bac2-5d0e621b3d55 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Refreshing network info cache for port c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:21:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:24 user nova-compute[73917]: INFO nova.compute.manager [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Detaching volume a464dbc8-9a4b-45d3-abbd-6925b661738c
Aug 26 19:21:24 user nova-compute[73917]: INFO nova.virt.block_device [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Attempting to driver detach volume a464dbc8-9a4b-45d3-abbd-6925b661738c from mountpoint /dev/vdb
Aug 26 19:21:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Attempting to detach device vdb from instance f4e84db3-1f3b-471f-9f82-5a692fdb6c06 from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:21:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:21:24 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:21:24 user nova-compute[73917]:   <source dev="/dev/sdd"/>
Aug 26 19:21:24 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:21:24 user nova-compute[73917]:   <serial>a464dbc8-9a4b-45d3-abbd-6925b661738c</serial>
Aug 26 19:21:24 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:21:24 user nova-compute[73917]: </disk>
Aug 26 19:21:24 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:21:24 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Successfully detached device vdb from instance f4e84db3-1f3b-471f-9f82-5a692fdb6c06 from the persistent domain config.
Aug 26 19:21:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f4e84db3-1f3b-471f-9f82-5a692fdb6c06 from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:21:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:21:24 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:21:24 user nova-compute[73917]:   <source dev="/dev/sdd"/>
Aug 26 19:21:24 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:21:24 user nova-compute[73917]:   <serial>a464dbc8-9a4b-45d3-abbd-6925b661738c</serial>
Aug 26 19:21:24 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:21:24 user nova-compute[73917]: </disk>
Aug 26 19:21:24 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:21:24 user nova-compute[73917]: DEBUG nova.network.neutron [req-167575d5-c304-4058-8eb4-b367f42ff9d5 req-cbf32c43-7cb0-40f5-bac2-5d0e621b3d55 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Updated VIF entry in instance network info cache for port c7ef21a0-d036-4b14-8067-594a1f2181ba. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:21:24 user nova-compute[73917]: DEBUG nova.network.neutron [req-167575d5-c304-4058-8eb4-b367f42ff9d5 req-cbf32c43-7cb0-40f5-bac2-5d0e621b3d55 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Updating instance_info_cache with network_info: [{"id": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "address": "fa:16:3e:25:d1:18", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ef21a0-d0", "ovs_interfaceid": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:21:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-167575d5-c304-4058-8eb4-b367f42ff9d5 req-cbf32c43-7cb0-40f5-bac2-5d0e621b3d55 service nova] Releasing lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693077685.3185422, f4e84db3-1f3b-471f-9f82-5a692fdb6c06 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f4e84db3-1f3b-471f-9f82-5a692fdb6c06 {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:21:25 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Successfully detached device vdb from instance f4e84db3-1f3b-471f-9f82-5a692fdb6c06 from the live domain config.
Aug 26 19:21:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScghMnab', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:21:25 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:21:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e24d0be-786e-4d57-a920-1b813617b679]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7899fe0d-936a-4a76-aeb1-3743ee1c1c20]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:21:25 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:21:25 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:21:25 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:21:25 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:21:25 user nova-compute[73917]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c (non-flash)
Aug 26 19:21:25 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:21:25 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:21:25 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b985dab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c'): ({'sdd'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Removing single pathed devices sdd {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a48753b-2e3c-48d0-a848-49007fa9d8f0]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[de30ad46-386f-4eba-ab1e-cf0910be0d92]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Flushing IO for device /dev/sdd {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82931cb-a36b-480e-9cad-6778647e0be1]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5a70fd-8a54-4fdb-b35d-a168e2dec41f]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] SCSI volumes sdd have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4132a2-3424-46fa-8786-da1836df6766]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e888c1-e979-4123-a9e8-683817b66e7b]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c, portal: 172.16.0.220,3260]
Aug 26 19:21:25 user nova-compute[73917]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c, portal: 172.16.0.220,3260] successful.
Aug 26 19:21:25 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a464dbc8-9a4b-45d3-abbd-6925b661738c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[695ca20a-b4d7-414b-ad56-8d41144157af]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] <== disconnect_volume: return (299ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:21:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:21:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-90bd9e3d-5f39-4798-9373-c8d64d443e3b req-40fc29d0-fb6d-4668-9e59-70f88f61aed8 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received event network-changed-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:21:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-90bd9e3d-5f39-4798-9373-c8d64d443e3b req-40fc29d0-fb6d-4668-9e59-70f88f61aed8 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Refreshing instance network info cache due to event network-changed-c7ef21a0-d036-4b14-8067-594a1f2181ba. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:21:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-90bd9e3d-5f39-4798-9373-c8d64d443e3b req-40fc29d0-fb6d-4668-9e59-70f88f61aed8 service nova] Acquiring lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:21:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-90bd9e3d-5f39-4798-9373-c8d64d443e3b req-40fc29d0-fb6d-4668-9e59-70f88f61aed8 service nova] Acquired lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:21:26 user nova-compute[73917]: DEBUG nova.network.neutron [req-90bd9e3d-5f39-4798-9373-c8d64d443e3b req-40fc29d0-fb6d-4668-9e59-70f88f61aed8 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Refreshing network info cache for port c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:21:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:26 user nova-compute[73917]: DEBUG nova.objects.instance [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'flavor' on Instance uuid f4e84db3-1f3b-471f-9f82-5a692fdb6c06 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:21:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d5b5b6d3-ec7a-428c-ba60-2fce2f0975d3 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.680s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:26 user nova-compute[73917]: DEBUG nova.network.neutron [req-90bd9e3d-5f39-4798-9373-c8d64d443e3b req-40fc29d0-fb6d-4668-9e59-70f88f61aed8 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Updated VIF entry in instance network info cache for port c7ef21a0-d036-4b14-8067-594a1f2181ba. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:21:26 user nova-compute[73917]: DEBUG nova.network.neutron [req-90bd9e3d-5f39-4798-9373-c8d64d443e3b req-40fc29d0-fb6d-4668-9e59-70f88f61aed8 service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Updating instance_info_cache with network_info: [{"id": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "address": "fa:16:3e:25:d1:18", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ef21a0-d0", "ovs_interfaceid": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:21:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-90bd9e3d-5f39-4798-9373-c8d64d443e3b req-40fc29d0-fb6d-4668-9e59-70f88f61aed8 service nova] Releasing lock "refresh_cache-f4e84db3-1f3b-471f-9f82-5a692fdb6c06" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:21:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:31 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077676.225079, 481cc682-2004-434d-b4eb-1688b0b07dd6 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:21:31 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] VM Stopped (Lifecycle Event)
Aug 26 19:21:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-317a9da5-c1f9-47a7-8ce6-8f02f9be31bd None None] [instance: 481cc682-2004-434d-b4eb-1688b0b07dd6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:21:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:58 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:21:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:21:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:21:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:21:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:21:58 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:21:58 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid cc0ae046-2a39-4ab6-9327-2d9452c3035d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:21:58 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Updating instance_info_cache with network_info: [{"id": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "address": "fa:16:3e:89:79:8b", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8ac63b-61", "ovs_interfaceid": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:21:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-cc0ae046-2a39-4ab6-9327-2d9452c3035d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:21:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:21:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:59 user nova-compute[73917]: INFO nova.compute.manager [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Terminating instance
Aug 26 19:21:59 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:21:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:21:59 user nova-compute[73917]: DEBUG nova.compute.manager [req-9c199cb3-d3c0-488b-9869-0c175e4e55cc req-203abffc-72d0-4755-97f7-a7a0e7c29843 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received event network-vif-unplugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:21:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9c199cb3-d3c0-488b-9869-0c175e4e55cc req-203abffc-72d0-4755-97f7-a7a0e7c29843 service nova] Acquiring lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:21:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9c199cb3-d3c0-488b-9869-0c175e4e55cc req-203abffc-72d0-4755-97f7-a7a0e7c29843 service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:21:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9c199cb3-d3c0-488b-9869-0c175e4e55cc req-203abffc-72d0-4755-97f7-a7a0e7c29843 service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:21:59 user nova-compute[73917]: DEBUG nova.compute.manager [req-9c199cb3-d3c0-488b-9869-0c175e4e55cc req-203abffc-72d0-4755-97f7-a7a0e7c29843 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] No waiting events found dispatching network-vif-unplugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:21:59 user nova-compute[73917]: DEBUG nova.compute.manager [req-9c199cb3-d3c0-488b-9869-0c175e4e55cc req-203abffc-72d0-4755-97f7-a7a0e7c29843 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received event network-vif-unplugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:22:00 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Instance destroyed successfully.
Aug 26 19:22:00 user nova-compute[73917]: DEBUG nova.objects.instance [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lazy-loading 'resources' on Instance uuid dca28d65-37d0-4b60-b8aa-dcca61b6a187 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1165082774',display_name='tempest-ServerActionsTestOtherB-server-1165082774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1165082774',id=19,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf6A+tLmlhXN1ex/7jOISEFChezRDQZ5m7P/4PRHH+2Viff3bm+/OVarrZ0hky07ll3BRX4g048OhpV/rgYZ4nSom5KVv2Uu0RHTe6WT8eoSMJzatFMKJ/1TpRz/DQQnw==',key_name='tempest-keypair-2090853106',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:19:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36d3d1cb213442cc9a672abe4a5c2b61',ramdisk_id='',reservation_id='r-0fa34jg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-824485866',owner_user_name='tempest-ServerActionsTestOtherB-824485866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:19:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff1648bb2044c0e9fd90ece565c4e8e',uuid=dca28d65-37d0-4b60-b8aa-dcca61b6a187,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Converting VIF {"id": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "address": "fa:16:3e:14:4e:59", "network": {"id": "9d782ea4-6d2b-4945-9820-956f2d6b08fa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1228910982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d3d1cb213442cc9a672abe4a5c2b61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a3326-bd", "ovs_interfaceid": "c63a3326-bd42-40f4-8559-b7f08e5f9a98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG os_vif [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc63a3326-bd, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:00 user nova-compute[73917]: INFO os_vif [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=c63a3326-bd42-40f4-8559-b7f08e5f9a98,network=Network(9d782ea4-6d2b-4945-9820-956f2d6b08fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a3326-bd')
Aug 26 19:22:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjNosbWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:22:00 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:22:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ad0d35-0919-474b-b274-cb90d7eee792]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0e24b8-e4b1-46c8-9717-d2e5a480f19c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:22:00 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:22:00 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:22:00 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:22:00 user nova-compute[73917]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 (non-flash)
Aug 26 19:22:00 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:22:00 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b98377130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3'): ({'sdc'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Removing single pathed devices sdc {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6848de4c-7343-4a6f-9f69-1c64b5fb90b9]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcd16fd-113b-45f6-9c66-12b0b2b6693f]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Flushing IO for device /dev/sdc {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb8051c-15af-4a4e-bd43-87963825e75d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b283acc8-f3e2-4f27-9762-bae6442f5029]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ec06e5-1584-4b39-a1cf-4dee8c60800c]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3eda208-6658-49fc-8079-ef2cbbf726c7]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260]
Aug 26 19:22:00 user nova-compute[73917]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3, portal: 172.16.0.220,3260] successful.
Aug 26 19:22:00 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a7f1e0-2183-4228-bec3-0489f0238cd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6b2206-3ecf-4546-b311-d9ce48717d2d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] <== disconnect_volume: return (384ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:22:00 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Deleting instance files /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187_del
Aug 26 19:22:00 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Deletion of /opt/stack/data/nova/instances/dca28d65-37d0-4b60-b8aa-dcca61b6a187_del complete
Aug 26 19:22:00 user nova-compute[73917]: INFO nova.compute.manager [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 26 19:22:00 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:22:00 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:22:01 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:22:01 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:22:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:22:01 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:22:01 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Took 0.99 seconds to deallocate network for instance.
Aug 26 19:22:01 user nova-compute[73917]: DEBUG nova.compute.manager [req-5b394af4-4f46-4896-9576-6ad63c4aed66 req-f2a9041e-43f9-4389-9062-3ec810867577 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received event network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:22:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5b394af4-4f46-4896-9576-6ad63c4aed66 req-f2a9041e-43f9-4389-9062-3ec810867577 service nova] Acquiring lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:22:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5b394af4-4f46-4896-9576-6ad63c4aed66 req-f2a9041e-43f9-4389-9062-3ec810867577 service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:22:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5b394af4-4f46-4896-9576-6ad63c4aed66 req-f2a9041e-43f9-4389-9062-3ec810867577 service nova] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:22:01 user nova-compute[73917]: DEBUG nova.compute.manager [req-5b394af4-4f46-4896-9576-6ad63c4aed66 req-f2a9041e-43f9-4389-9062-3ec810867577 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] No waiting events found dispatching network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:22:01 user nova-compute[73917]: WARNING nova.compute.manager [req-5b394af4-4f46-4896-9576-6ad63c4aed66 req-f2a9041e-43f9-4389-9062-3ec810867577 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received unexpected event network-vif-plugged-c63a3326-bd42-40f4-8559-b7f08e5f9a98 for instance with vm_state active and task_state deleting.
Aug 26 19:22:01 user nova-compute[73917]: DEBUG nova.compute.manager [req-5b394af4-4f46-4896-9576-6ad63c4aed66 req-f2a9041e-43f9-4389-9062-3ec810867577 service nova] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Received event network-vif-deleted-c63a3326-bd42-40f4-8559-b7f08e5f9a98 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:22:02 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:22:02 user nova-compute[73917]: INFO nova.compute.manager [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Took 0.79 seconds to detach 1 volumes for instance.
Aug 26 19:22:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:22:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:22:02 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:22:02 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:22:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:22:02 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Deleted allocations for instance dca28d65-37d0-4b60-b8aa-dcca61b6a187
Aug 26 19:22:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9923b867-5619-4a69-8e2d-81a500ce02c9 tempest-ServerActionsTestOtherB-824485866 tempest-ServerActionsTestOtherB-824485866-project-member] Lock "dca28d65-37d0-4b60-b8aa-dcca61b6a187" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.771s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:22:03 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:22:03 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:22:04 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:22:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:22:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:22:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:22:04 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:22:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "c78c30ea-1190-44bc-bd78-b3655e251a35" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:22:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:22:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:04 user nova-compute[73917]: DEBUG nova.objects.instance [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lazy-loading 'flavor' on Instance uuid c78c30ea-1190-44bc-bd78-b3655e251a35 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:22:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.127s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:22:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:04 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "c78c30ea-1190-44bc-bd78-b3655e251a35" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:22:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:22:04 user nova-compute[73917]: INFO nova.compute.manager [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Attaching volume f0e7374f-f1ec-47bc-a41c-40768663b094 to /dev/vdb
Aug 26 19:22:05 user nova-compute[73917]: DEBUG os_brick.utils [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd39fe3-e4e5-485c-9879-f93b8adeee3d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.108s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0e39e1-95bd-4a0c-a831-eba969e57916]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e091bdd0-a5ed-4b57-9185-aec924ca7185]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9087910f-113d-4367-91a7-2734a50c0031]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:22:05 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3590dc-b1d3-4293-a375-6e32b5a6ff0a]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG os_brick.utils [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] <== get_connector_properties: return (279ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Updating existing volume attachment record: fe43db6d-d4e8-4a1f-abe3-bbea28b9806c {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:22:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:08 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:22:08 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:22:08 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=7394MB free_disk=25.294635772705078GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:22:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:22:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:22:09 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Applying migration context for instance 4a2d91a5-9943-43f6-b919-30510ccba727 as it has an incoming, in-progress migration 2bd04bdf-4db4-4b04-afb6-e24d63bef27e. Migration status is finished {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 19:22:09 user nova-compute[73917]: INFO nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Updating resource usage from migration 2bd04bdf-4db4-4b04-afb6-e24d63bef27e
Aug 26 19:22:09 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance cc0ae046-2a39-4ab6-9327-2d9452c3035d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:22:09 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fd801f18-34b6-4682-8d43-edf82bd216c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:22:09 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:22:09 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 94f8d4e7-f310-45df-a0ae-82e608ac0119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:22:09 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance df5c717a-62d8-444d-9968-ad682a31733c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:22:09 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f4e84db3-1f3b-471f-9f82-5a692fdb6c06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:22:09 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c78c30ea-1190-44bc-bd78-b3655e251a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:22:09 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Migration 2bd04bdf-4db4-4b04-afb6-e24d63bef27e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 19:22:09 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 4a2d91a5-9943-43f6-b919-30510ccba727 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:22:09 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance a4487be3-7267-4ae1-8731-a6bdf49a6070 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:22:09 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:22:09 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:22:09 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:22:09 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:22:09 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:22:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.558s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:22:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:11 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:22:14 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077719.9941719, dca28d65-37d0-4b60-b8aa-dcca61b6a187 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:22:14 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] VM Stopped (Lifecycle Event)
Aug 26 19:22:15 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c1ba631a-63f2-4cb3-902b-4eb488f0ed17 None None] [instance: dca28d65-37d0-4b60-b8aa-dcca61b6a187] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:22:15 user nova-compute[73917]: INFO nova.compute.manager [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Terminating instance
Aug 26 19:22:15 user nova-compute[73917]: DEBUG nova.compute.manager [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-272cad14-2980-4ff4-bd83-dadc34376527 req-a98c35c2-6bac-4efd-8336-673f6e95e98a service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received event network-vif-unplugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-272cad14-2980-4ff4-bd83-dadc34376527 req-a98c35c2-6bac-4efd-8336-673f6e95e98a service nova] Acquiring lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-272cad14-2980-4ff4-bd83-dadc34376527 req-a98c35c2-6bac-4efd-8336-673f6e95e98a service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-272cad14-2980-4ff4-bd83-dadc34376527 req-a98c35c2-6bac-4efd-8336-673f6e95e98a service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-272cad14-2980-4ff4-bd83-dadc34376527 req-a98c35c2-6bac-4efd-8336-673f6e95e98a service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] No waiting events found dispatching network-vif-unplugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-272cad14-2980-4ff4-bd83-dadc34376527 req-a98c35c2-6bac-4efd-8336-673f6e95e98a service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received event network-vif-unplugged-c7ef21a0-d036-4b14-8067-594a1f2181ba for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:15 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Instance destroyed successfully.
Aug 26 19:22:15 user nova-compute[73917]: DEBUG nova.objects.instance [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'resources' on Instance uuid f4e84db3-1f3b-471f-9f82-5a692fdb6c06 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1308800063',display_name='tempest-ServerRescueNegativeTestJSON-server-1308800063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1308800063',id=24,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGjEgFmZWCuUIpbfIsdYNVrH57MJGBdjCsYvuXKTDomE8Sf1OwmCLTlNrmFypkCzReg1pf2c663Y/yL4RjOUVd7yq4SqAVhIAw4G8JOI8+uExEk9cM86FgJmqZfxMd1rw==',key_name='tempest-keypair-1145554874',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:17:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1298aa7a6ca478fb973d5a6d7bea7be',ramdisk_id='',reservation_id='r-27guj55y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475026115',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475026115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:19:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='118080e0f2fe4533a25e002e894b99f9',uuid=f4e84db3-1f3b-471f-9f82-5a692fdb6c06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "address": "fa:16:3e:25:d1:18", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ef21a0-d0", "ovs_interfaceid": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converting VIF {"id": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "address": "fa:16:3e:25:d1:18", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ef21a0-d0", "ovs_interfaceid": "c7ef21a0-d036-4b14-8067-594a1f2181ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:d1:18,bridge_name='br-int',has_traffic_filtering=True,id=c7ef21a0-d036-4b14-8067-594a1f2181ba,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ef21a0-d0') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG os_vif [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:d1:18,bridge_name='br-int',has_traffic_filtering=True,id=c7ef21a0-d036-4b14-8067-594a1f2181ba,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ef21a0-d0') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7ef21a0-d0, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:22:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:22:16 user nova-compute[73917]: INFO os_vif [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:d1:18,bridge_name='br-int',has_traffic_filtering=True,id=c7ef21a0-d036-4b14-8067-594a1f2181ba,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ef21a0-d0')
Aug 26 19:22:16 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Deleting instance files /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06_del
Aug 26 19:22:16 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Deletion of /opt/stack/data/nova/instances/f4e84db3-1f3b-471f-9f82-5a692fdb6c06_del complete
Aug 26 19:22:16 user nova-compute[73917]: INFO nova.compute.manager [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 26 19:22:16 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:22:16 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:22:16 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:22:17 user nova-compute[73917]: DEBUG nova.compute.manager [req-d32c1cbc-aea2-48b5-a474-61d08cce85fb req-63561180-fbd3-4f3a-9d87-0152461084cc service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received event network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:22:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d32c1cbc-aea2-48b5-a474-61d08cce85fb req-63561180-fbd3-4f3a-9d87-0152461084cc service nova] Acquiring lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:22:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d32c1cbc-aea2-48b5-a474-61d08cce85fb req-63561180-fbd3-4f3a-9d87-0152461084cc service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:22:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d32c1cbc-aea2-48b5-a474-61d08cce85fb req-63561180-fbd3-4f3a-9d87-0152461084cc service nova] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:22:17 user nova-compute[73917]: DEBUG nova.compute.manager [req-d32c1cbc-aea2-48b5-a474-61d08cce85fb req-63561180-fbd3-4f3a-9d87-0152461084cc service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] No waiting events found dispatching network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:22:17 user nova-compute[73917]: WARNING nova.compute.manager [req-d32c1cbc-aea2-48b5-a474-61d08cce85fb req-63561180-fbd3-4f3a-9d87-0152461084cc service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received unexpected event network-vif-plugged-c7ef21a0-d036-4b14-8067-594a1f2181ba for instance with vm_state active and task_state deleting.
Aug 26 19:22:17 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:22:17 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Took 1.62 seconds to deallocate network for instance.
Aug 26 19:22:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:22:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:22:18 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:22:18 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:22:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.475s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:22:18 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Deleted allocations for instance f4e84db3-1f3b-471f-9f82-5a692fdb6c06
Aug 26 19:22:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-52b6e927-2486-4c04-8faa-0250e3140d48 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "f4e84db3-1f3b-471f-9f82-5a692fdb6c06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.292s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:22:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:22:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yobwWEjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:22:18 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:22:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:22:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:22:18 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:22:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:22:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:22:18 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b78a399-8c55-485b-bd95-9d7ab3cfd5ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:22:19 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b485d5a-1d6e-4ca6-9070-c0b9792bfb0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094] added
Aug 26 19:22:19 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f4fe76-e1db-411c-abee-c0e54e45927a]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d7b230-59dd-4358-83eb-0ac76af0ed16]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yobwWEjx {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yobwWEjx" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[458911fc-3b1d-42af-819e-61db2e754cdc]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yobwWEjx'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.045s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f408f096-6d10-4f54-aa63-f6c4c2c1abc0]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbd84af-cacc-4255-9608-e28e81e4477a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:22:19 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:22:19 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:22:19 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:22:19 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10c4354-619b-49e9-96a9-453803ec794c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094, portal: 172.16.0.220,3260]
Aug 26 19:22:19 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094, portal: 172.16.0.220,3260] successful.
Aug 26 19:22:19 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a515457-c227-4bb5-b235-f692d3b20183]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3cc386-4609-4f4b-aa5e-f897d8875823]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:22:19 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:22:19 user nova-compute[73917]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 (non-flash)
Aug 26 19:22:19 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:22:19 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:22:19 user nova-compute[73917]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 (non-flash)
Aug 26 19:22:19 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5268b18-a661-4fff-8d30-3b707c3a36d1]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yobwWEjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:22:19 user nova-compute[73917]: DEBUG nova.compute.manager [req-66fef54d-efb6-45af-9d94-ceab3b41c2bd req-43635272-86f3-4f8d-b788-9fe572b44f7a service nova] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Received event network-vif-deleted-c7ef21a0-d036-4b14-8067-594a1f2181ba {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:22:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:22:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '23331623731636639', 'path': '/dev/sdc'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:22:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331623731636639', 'path': '/dev/sdc'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:22:20 user nova-compute[73917]: DEBUG nova.objects.instance [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lazy-loading 'flavor' on Instance uuid c78c30ea-1190-44bc-bd78-b3655e251a35 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:22:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:22:20 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:22:20 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:22:20 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:22:20 user nova-compute[73917]:   <serial>f0e7374f-f1ec-47bc-a41c-40768663b094</serial>
Aug 26 19:22:20 user nova-compute[73917]: </disk>
Aug 26 19:22:20 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:22:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:22:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:22:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] No VIF found with MAC fa:16:3e:97:c2:28, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:22:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62f5eb01-54d5-4211-99b8-87ccbefc2eff tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.239s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:22:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "c78c30ea-1190-44bc-bd78-b3655e251a35" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:22:24 user nova-compute[73917]: INFO nova.compute.manager [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Detaching volume f0e7374f-f1ec-47bc-a41c-40768663b094
Aug 26 19:22:24 user nova-compute[73917]: INFO nova.virt.block_device [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Attempting to driver detach volume f0e7374f-f1ec-47bc-a41c-40768663b094 from mountpoint /dev/vdb
Aug 26 19:22:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Attempting to detach device vdb from instance c78c30ea-1190-44bc-bd78-b3655e251a35 from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:22:24 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:22:24 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:22:24 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:22:24 user nova-compute[73917]:   <serial>f0e7374f-f1ec-47bc-a41c-40768663b094</serial>
Aug 26 19:22:24 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:22:24 user nova-compute[73917]: </disk>
Aug 26 19:22:24 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:22:24 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Successfully detached device vdb from instance c78c30ea-1190-44bc-bd78-b3655e251a35 from the persistent domain config.
Aug 26 19:22:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c78c30ea-1190-44bc-bd78-b3655e251a35 from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:22:24 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:22:24 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:22:24 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:22:24 user nova-compute[73917]:   <serial>f0e7374f-f1ec-47bc-a41c-40768663b094</serial>
Aug 26 19:22:24 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:22:24 user nova-compute[73917]: </disk>
Aug 26 19:22:24 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693077744.704883, c78c30ea-1190-44bc-bd78-b3655e251a35 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c78c30ea-1190-44bc-bd78-b3655e251a35 {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:22:24 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Successfully detached device vdb from instance c78c30ea-1190-44bc-bd78-b3655e251a35 from the live domain config.
Aug 26 19:22:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yobwWEjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:22:24 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:22:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad74cf2-3fdf-4965-8361-004e50dade06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8aa755-048b-4e9b-b87f-0370ba7899b4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:22:24 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:22:24 user nova-compute[73917]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 (non-flash)
Aug 26 19:22:24 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:22:24 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:22:24 user nova-compute[73917]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 (non-flash)
Aug 26 19:22:24 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b985db370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094'): ({'sdc'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Removing single pathed devices sdc {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[10629547-b4b6-4faf-be67-bfd85cc93e50]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[079fa094-d3cb-4e04-bc6a-9a1e0827599a]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Flushing IO for device /dev/sdc {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee08ebe-57d0-4e7a-b5e5-3a5c1af3f453]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc87643a-33d1-4578-b3e1-16701bc2bab2]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[282fe670-3e25-4bd5-a567-23eecf282500]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:22:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74b2576-0799-4930-8427-8891434403fc]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094, portal: 172.16.0.220,3260]
Aug 26 19:22:25 user nova-compute[73917]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094, portal: 172.16.0.220,3260] successful.
Aug 26 19:22:25 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:22:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e7374f-f1ec-47bc-a41c-40768663b094 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea52b54-b514-4e4f-a687-4e83cb5fc139]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:22:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:22:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:22:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] <== disconnect_volume: return (323ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:22:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:22:25 user nova-compute[73917]: DEBUG nova.objects.instance [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lazy-loading 'flavor' on Instance uuid c78c30ea-1190-44bc-bd78-b3655e251a35 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:22:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-71323141-e41b-4714-85bb-d97939a4a2b0 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.792s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:22:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:30 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077735.9737117, f4e84db3-1f3b-471f-9f82-5a692fdb6c06 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:22:30 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] VM Stopped (Lifecycle Event)
Aug 26 19:22:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b4adec9b-d7bd-4f02-bc36-be37de330d0b None None] [instance: f4e84db3-1f3b-471f-9f82-5a692fdb6c06] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:22:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e8e264e0-5286-4a1e-b400-5aee06c57d32 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "4a2d91a5-9943-43f6-b919-30510ccba727" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:22:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e8e264e0-5286-4a1e-b400-5aee06c57d32 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "4a2d91a5-9943-43f6-b919-30510ccba727" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:22:32 user nova-compute[73917]: DEBUG nova.compute.manager [None req-e8e264e0-5286-4a1e-b400-5aee06c57d32 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Going to confirm migration 2 {{(pid=73917) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 26 19:22:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e8e264e0-5286-4a1e-b400-5aee06c57d32 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "refresh_cache-4a2d91a5-9943-43f6-b919-30510ccba727" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:22:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e8e264e0-5286-4a1e-b400-5aee06c57d32 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquired lock "refresh_cache-4a2d91a5-9943-43f6-b919-30510ccba727" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:22:32 user nova-compute[73917]: DEBUG nova.network.neutron [None req-e8e264e0-5286-4a1e-b400-5aee06c57d32 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:22:32 user nova-compute[73917]: DEBUG nova.objects.instance [None req-e8e264e0-5286-4a1e-b400-5aee06c57d32 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lazy-loading 'info_cache' on Instance uuid 4a2d91a5-9943-43f6-b919-30510ccba727 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:22:33 user nova-compute[73917]: DEBUG nova.network.neutron [None req-e8e264e0-5286-4a1e-b400-5aee06c57d32 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Updating instance_info_cache with network_info: [{"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:22:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e8e264e0-5286-4a1e-b400-5aee06c57d32 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Releasing lock "refresh_cache-4a2d91a5-9943-43f6-b919-30510ccba727" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:22:33 user nova-compute[73917]: DEBUG nova.objects.instance [None req-e8e264e0-5286-4a1e-b400-5aee06c57d32 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lazy-loading 'migration_context' on Instance uuid 4a2d91a5-9943-43f6-b919-30510ccba727 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:22:33 user nova-compute[73917]: DEBUG nova.objects.base [None req-e8e264e0-5286-4a1e-b400-5aee06c57d32 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Object Instance<4a2d91a5-9943-43f6-b919-30510ccba727> lazy-loaded attributes: info_cache,migration_context {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:22:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e8e264e0-5286-4a1e-b400-5aee06c57d32 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:22:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e8e264e0-5286-4a1e-b400-5aee06c57d32 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:22:33 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-e8e264e0-5286-4a1e-b400-5aee06c57d32 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:22:33 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-e8e264e0-5286-4a1e-b400-5aee06c57d32 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:22:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e8e264e0-5286-4a1e-b400-5aee06c57d32 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.418s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:22:34 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-e8e264e0-5286-4a1e-b400-5aee06c57d32 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Deleted allocation for migration 2bd04bdf-4db4-4b04-afb6-e24d63bef27e
Aug 26 19:22:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-e8e264e0-5286-4a1e-b400-5aee06c57d32 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "4a2d91a5-9943-43f6-b919-30510ccba727" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.564s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:22:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:22:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:22:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:22:49 user nova-compute[73917]: INFO nova.compute.manager [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] instance snapshotting
Aug 26 19:22:49 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Beginning live snapshot process
Aug 26 19:22:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json -f qcow2 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json -f qcow2 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.180s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp8sunma_/511057fb6f6048acab0c5ad9cbfc683a.delta 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp8sunma_/511057fb6f6048acab0c5ad9cbfc683a.delta 1073741824" returned: 0 in 0.057s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:50 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 19:22:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:22:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:22:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:22:51 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 19:22:51 user nova-compute[73917]: DEBUG nova.privsep.utils [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73917) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 19:22:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp8sunma_/511057fb6f6048acab0c5ad9cbfc683a.delta /opt/stack/data/nova/instances/snapshots/tmpp8sunma_/511057fb6f6048acab0c5ad9cbfc683a {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:22:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp8sunma_/511057fb6f6048acab0c5ad9cbfc683a.delta /opt/stack/data/nova/instances/snapshots/tmpp8sunma_/511057fb6f6048acab0c5ad9cbfc683a" returned: 0 in 0.723s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:22:52 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Snapshot extracted, beginning image upload
Aug 26 19:22:54 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Snapshot image upload complete
Aug 26 19:22:54 user nova-compute[73917]: INFO nova.compute.manager [None req-2bb6778e-9fd7-4a62-af82-6c6688806fba tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Took 5.76 seconds to snapshot the instance on the hypervisor.
Aug 26 19:22:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:22:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:22:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:22:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:22:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:56 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:22:58 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:22:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:22:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-fd801f18-34b6-4682-8d43-edf82bd216c2" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:22:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-fd801f18-34b6-4682-8d43-edf82bd216c2" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:22:58 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:22:58 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Updating instance_info_cache with network_info: [{"id": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "address": "fa:16:3e:9c:f5:38", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b11e5e-5c", "ovs_interfaceid": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:22:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-fd801f18-34b6-4682-8d43-edf82bd216c2" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:22:58 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:22:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:22:59 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:22:59 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 19:22:59 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] There are 0 instances to clean {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 19:23:00 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:23:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:02 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:23:02 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:23:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:23:03 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:23:03 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:23:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:04 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:23:05 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:23:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:06 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:23:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:06 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:23:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:23:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:23:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.256s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:10 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:23:10 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:23:10 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=7702MB free_disk=25.25815200805664GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:23:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:10 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance cc0ae046-2a39-4ab6-9327-2d9452c3035d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:23:10 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fd801f18-34b6-4682-8d43-edf82bd216c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:23:10 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:23:10 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 94f8d4e7-f310-45df-a0ae-82e608ac0119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:23:10 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance df5c717a-62d8-444d-9968-ad682a31733c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:23:10 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c78c30ea-1190-44bc-bd78-b3655e251a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:23:10 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 4a2d91a5-9943-43f6-b919-30510ccba727 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:23:10 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance a4487be3-7267-4ae1-8731-a6bdf49a6070 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:23:10 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:23:10 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:23:10 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing inventories for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 19:23:10 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating ProviderTree inventory for provider d90ad23a-e063-4f0d-8341-c34e0141d16a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 19:23:10 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating inventory in ProviderTree for provider d90ad23a-e063-4f0d-8341-c34e0141d16a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 19:23:10 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing aggregate associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, aggregates: None {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 19:23:10 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing trait associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 19:23:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:11 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:23:11 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:23:11 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:23:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.812s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:11 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:23:11 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73917) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 19:23:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:12 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:23:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Acquiring lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:23:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:19 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:23:19 user nova-compute[73917]: INFO nova.compute.claims [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Claim successful on node user
Aug 26 19:23:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "d30d366d-29cc-430b-ba31-bcbc08a364b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:23:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "c78c30ea-1190-44bc-bd78-b3655e251a35" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:19 user nova-compute[73917]: DEBUG nova.objects.instance [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lazy-loading 'flavor' on Instance uuid c78c30ea-1190-44bc-bd78-b3655e251a35 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:23:19 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:23:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:19 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:23:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:23:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.062s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:23:20 user nova-compute[73917]: INFO nova.compute.claims [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Claim successful on node user
Aug 26 19:23:20 user nova-compute[73917]: DEBUG nova.compute.manager [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG nova.network.neutron [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:23:20 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "c78c30ea-1190-44bc-bd78-b3655e251a35" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:20 user nova-compute[73917]: INFO nova.compute.manager [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Attaching volume 3f803dc6-35e2-4410-9376-559f08ebdd75 to /dev/vdb
Aug 26 19:23:20 user nova-compute[73917]: DEBUG nova.compute.manager [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG os_brick.utils [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f393464-484c-4dff-a5b4-e5085df61a48]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG nova.policy [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df632b88d11245bb9f3393d082e6527f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd87078f3f3e47b687aacabf450e57c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a723376-33e5-4c91-b572-27305fb626fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b666dc95-ad7a-48e3-b4c5-cd19f6143e6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d436d250-e858-4007-af7e-3625132d4ee3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG nova.compute.manager [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:23:20 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Creating image(s)
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "/opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "/opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:23:20 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd0888a-be4a-4ea5-8e47-2307fbc1036f]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG os_brick.utils [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] <== get_connector_properties: return (294ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Updating existing volume attachment record: 8006252c-50f6-4eb7-b80f-4745ba586ccd {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.227s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.756s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG nova.compute.manager [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG nova.compute.manager [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG nova.network.neutron [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:23:20 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.208s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG nova.compute.manager [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0/disk 1073741824" returned: 0 in 0.067s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:20 user nova-compute[73917]: DEBUG nova.policy [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '860f7b92664e43d19c908f3bdb52d717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf0ccd59944be6922b561ecddc7d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:23:21 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Creating image(s)
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "/opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "/opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "/opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG nova.network.neutron [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Successfully created port: 3f214d19-c24c-45d9-8361-36c0d8a5692d {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.217s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.206s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Cannot resize image /opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Ensure instance console log exists: /opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.175s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk 1073741824" returned: 0 in 0.063s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG nova.network.neutron [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Successfully created port: 1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.256s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:23:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Cannot resize image /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Ensure instance console log exists: /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.network.neutron [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Successfully updated port: 3f214d19-c24c-45d9-8361-36c0d8a5692d {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Acquiring lock "refresh_cache-3e94cd92-2e56-4ad4-90d0-03a06c7437f0" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Acquired lock "refresh_cache-3e94cd92-2e56-4ad4-90d0-03a06c7437f0" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.network.neutron [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.network.neutron [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-95341e14-b743-4dd8-b0af-b7077686c149 req-e3058a49-741c-41a2-b98d-8a4ce0539b31 service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Received event network-changed-3f214d19-c24c-45d9-8361-36c0d8a5692d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-95341e14-b743-4dd8-b0af-b7077686c149 req-e3058a49-741c-41a2-b98d-8a4ce0539b31 service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Refreshing instance network info cache due to event network-changed-3f214d19-c24c-45d9-8361-36c0d8a5692d. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-95341e14-b743-4dd8-b0af-b7077686c149 req-e3058a49-741c-41a2-b98d-8a4ce0539b31 service nova] Acquiring lock "refresh_cache-3e94cd92-2e56-4ad4-90d0-03a06c7437f0" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.network.neutron [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Updating instance_info_cache with network_info: [{"id": "3f214d19-c24c-45d9-8361-36c0d8a5692d", "address": "fa:16:3e:f3:e3:db", "network": {"id": "454de19a-252d-4f6b-95c4-5902bc4f0ba7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28701462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd87078f3f3e47b687aacabf450e57c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f214d19-c2", "ovs_interfaceid": "3f214d19-c24c-45d9-8361-36c0d8a5692d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Releasing lock "refresh_cache-3e94cd92-2e56-4ad4-90d0-03a06c7437f0" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Instance network_info: |[{"id": "3f214d19-c24c-45d9-8361-36c0d8a5692d", "address": "fa:16:3e:f3:e3:db", "network": {"id": "454de19a-252d-4f6b-95c4-5902bc4f0ba7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28701462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd87078f3f3e47b687aacabf450e57c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f214d19-c2", "ovs_interfaceid": "3f214d19-c24c-45d9-8361-36c0d8a5692d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-95341e14-b743-4dd8-b0af-b7077686c149 req-e3058a49-741c-41a2-b98d-8a4ce0539b31 service nova] Acquired lock "refresh_cache-3e94cd92-2e56-4ad4-90d0-03a06c7437f0" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.network.neutron [req-95341e14-b743-4dd8-b0af-b7077686c149 req-e3058a49-741c-41a2-b98d-8a4ce0539b31 service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Refreshing network info cache for port 3f214d19-c24c-45d9-8361-36c0d8a5692d {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Start _get_guest_xml network_info=[{"id": "3f214d19-c24c-45d9-8361-36c0d8a5692d", "address": "fa:16:3e:f3:e3:db", "network": {"id": "454de19a-252d-4f6b-95c4-5902bc4f0ba7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28701462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd87078f3f3e47b687aacabf450e57c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f214d19-c2", "ovs_interfaceid": "3f214d19-c24c-45d9-8361-36c0d8a5692d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:23:22 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:23:22 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-414013389',display_name='tempest-VolumesActionsTest-instance-414013389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-414013389',id=33,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd87078f3f3e47b687aacabf450e57c4',ramdisk_id='',reservation_id='r-9jeef7ct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1098860754',owner_user_name='tempest-VolumesActionsTest-1098860754-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:23:20Z,user_data=None,user_id='df632b88d11245bb9f3393d082e6527f',uuid=3e94cd92-2e56-4ad4-90d0-03a06c7437f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f214d19-c24c-45d9-8361-36c0d8a5692d", "address": "fa:16:3e:f3:e3:db", "network": {"id": "454de19a-252d-4f6b-95c4-5902bc4f0ba7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28701462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd87078f3f3e47b687aacabf450e57c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f214d19-c2", "ovs_interfaceid": "3f214d19-c24c-45d9-8361-36c0d8a5692d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Converting VIF {"id": "3f214d19-c24c-45d9-8361-36c0d8a5692d", "address": "fa:16:3e:f3:e3:db", "network": {"id": "454de19a-252d-4f6b-95c4-5902bc4f0ba7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28701462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd87078f3f3e47b687aacabf450e57c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f214d19-c2", "ovs_interfaceid": "3f214d19-c24c-45d9-8361-36c0d8a5692d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e3:db,bridge_name='br-int',has_traffic_filtering=True,id=3f214d19-c24c-45d9-8361-36c0d8a5692d,network=Network(454de19a-252d-4f6b-95c4-5902bc4f0ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f214d19-c2') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.objects.instance [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e94cd92-2e56-4ad4-90d0-03a06c7437f0 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:23:22 user nova-compute[73917]:   <uuid>3e94cd92-2e56-4ad4-90d0-03a06c7437f0</uuid>
Aug 26 19:23:22 user nova-compute[73917]:   <name>instance-00000021</name>
Aug 26 19:23:22 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:23:22 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:23:22 user nova-compute[73917]:   <metadata>
Aug 26 19:23:22 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:23:22 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:23:22 user nova-compute[73917]:       <nova:name>tempest-VolumesActionsTest-instance-414013389</nova:name>
Aug 26 19:23:22 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:23:22</nova:creationTime>
Aug 26 19:23:22 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:23:22 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:23:22 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:23:22 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:23:22 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:23:22 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:23:22 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:23:22 user nova-compute[73917]:       <nova:owner>
Aug 26 19:23:22 user nova-compute[73917]:         <nova:user uuid="df632b88d11245bb9f3393d082e6527f">tempest-VolumesActionsTest-1098860754-project-member</nova:user>
Aug 26 19:23:22 user nova-compute[73917]:         <nova:project uuid="dd87078f3f3e47b687aacabf450e57c4">tempest-VolumesActionsTest-1098860754</nova:project>
Aug 26 19:23:22 user nova-compute[73917]:       </nova:owner>
Aug 26 19:23:22 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:23:22 user nova-compute[73917]:       <nova:ports>
Aug 26 19:23:22 user nova-compute[73917]:         <nova:port uuid="3f214d19-c24c-45d9-8361-36c0d8a5692d">
Aug 26 19:23:22 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 19:23:22 user nova-compute[73917]:         </nova:port>
Aug 26 19:23:22 user nova-compute[73917]:       </nova:ports>
Aug 26 19:23:22 user nova-compute[73917]:     </nova:instance>
Aug 26 19:23:22 user nova-compute[73917]:   </metadata>
Aug 26 19:23:22 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:23:22 user nova-compute[73917]:     <system>
Aug 26 19:23:22 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:23:22 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:23:22 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:23:22 user nova-compute[73917]:       <entry name="serial">3e94cd92-2e56-4ad4-90d0-03a06c7437f0</entry>
Aug 26 19:23:22 user nova-compute[73917]:       <entry name="uuid">3e94cd92-2e56-4ad4-90d0-03a06c7437f0</entry>
Aug 26 19:23:22 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:23:22 user nova-compute[73917]:     </system>
Aug 26 19:23:22 user nova-compute[73917]:   </sysinfo>
Aug 26 19:23:22 user nova-compute[73917]:   <os>
Aug 26 19:23:22 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:23:22 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:23:22 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:23:22 user nova-compute[73917]:   </os>
Aug 26 19:23:22 user nova-compute[73917]:   <features>
Aug 26 19:23:22 user nova-compute[73917]:     <acpi/>
Aug 26 19:23:22 user nova-compute[73917]:     <apic/>
Aug 26 19:23:22 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:23:22 user nova-compute[73917]:   </features>
Aug 26 19:23:22 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:23:22 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:23:22 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:23:22 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:23:22 user nova-compute[73917]:   </clock>
Aug 26 19:23:22 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:23:22 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:23:22 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:23:22 user nova-compute[73917]:   </cpu>
Aug 26 19:23:22 user nova-compute[73917]:   <devices>
Aug 26 19:23:22 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:23:22 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:23:22 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0/disk"/>
Aug 26 19:23:22 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:23:22 user nova-compute[73917]:     </disk>
Aug 26 19:23:22 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:23:22 user nova-compute[73917]:       <mac address="fa:16:3e:f3:e3:db"/>
Aug 26 19:23:22 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:23:22 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:23:22 user nova-compute[73917]:       <target dev="tap3f214d19-c2"/>
Aug 26 19:23:22 user nova-compute[73917]:     </interface>
Aug 26 19:23:22 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:23:22 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0/console.log" append="off"/>
Aug 26 19:23:22 user nova-compute[73917]:     </serial>
Aug 26 19:23:22 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:23:22 user nova-compute[73917]:     <video>
Aug 26 19:23:22 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:23:22 user nova-compute[73917]:     </video>
Aug 26 19:23:22 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:23:22 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:23:22 user nova-compute[73917]:     </rng>
Aug 26 19:23:22 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:23:22 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:23:22 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:23:22 user nova-compute[73917]:     </memballoon>
Aug 26 19:23:22 user nova-compute[73917]:   </devices>
Aug 26 19:23:22 user nova-compute[73917]: </domain>
Aug 26 19:23:22 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-414013389',display_name='tempest-VolumesActionsTest-instance-414013389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-414013389',id=33,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd87078f3f3e47b687aacabf450e57c4',ramdisk_id='',reservation_id='r-9jeef7ct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1098860754',owner_user_name='tempest-VolumesActionsTest-1098860754-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:23:20Z,user_data=None,user_id='df632b88d11245bb9f3393d082e6527f',uuid=3e94cd92-2e56-4ad4-90d0-03a06c7437f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f214d19-c24c-45d9-8361-36c0d8a5692d", "address": "fa:16:3e:f3:e3:db", "network": {"id": "454de19a-252d-4f6b-95c4-5902bc4f0ba7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28701462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd87078f3f3e47b687aacabf450e57c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f214d19-c2", "ovs_interfaceid": "3f214d19-c24c-45d9-8361-36c0d8a5692d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Converting VIF {"id": "3f214d19-c24c-45d9-8361-36c0d8a5692d", "address": "fa:16:3e:f3:e3:db", "network": {"id": "454de19a-252d-4f6b-95c4-5902bc4f0ba7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28701462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd87078f3f3e47b687aacabf450e57c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f214d19-c2", "ovs_interfaceid": "3f214d19-c24c-45d9-8361-36c0d8a5692d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e3:db,bridge_name='br-int',has_traffic_filtering=True,id=3f214d19-c24c-45d9-8361-36c0d8a5692d,network=Network(454de19a-252d-4f6b-95c4-5902bc4f0ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f214d19-c2') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG os_vif [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e3:db,bridge_name='br-int',has_traffic_filtering=True,id=3f214d19-c24c-45d9-8361-36c0d8a5692d,network=Network(454de19a-252d-4f6b-95c4-5902bc4f0ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f214d19-c2') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f214d19-c2, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3f214d19-c2, col_values=(('external_ids', {'iface-id': '3f214d19-c24c-45d9-8361-36c0d8a5692d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:e3:db', 'vm-uuid': '3e94cd92-2e56-4ad4-90d0-03a06c7437f0'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:22 user nova-compute[73917]: INFO os_vif [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e3:db,bridge_name='br-int',has_traffic_filtering=True,id=3f214d19-c24c-45d9-8361-36c0d8a5692d,network=Network(454de19a-252d-4f6b-95c4-5902bc4f0ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f214d19-c2')
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:23:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] No VIF found with MAC fa:16:3e:f3:e3:db, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:23:23 user nova-compute[73917]: DEBUG nova.network.neutron [req-95341e14-b743-4dd8-b0af-b7077686c149 req-e3058a49-741c-41a2-b98d-8a4ce0539b31 service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Updated VIF entry in instance network info cache for port 3f214d19-c24c-45d9-8361-36c0d8a5692d. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:23:23 user nova-compute[73917]: DEBUG nova.network.neutron [req-95341e14-b743-4dd8-b0af-b7077686c149 req-e3058a49-741c-41a2-b98d-8a4ce0539b31 service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Updating instance_info_cache with network_info: [{"id": "3f214d19-c24c-45d9-8361-36c0d8a5692d", "address": "fa:16:3e:f3:e3:db", "network": {"id": "454de19a-252d-4f6b-95c4-5902bc4f0ba7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28701462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd87078f3f3e47b687aacabf450e57c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f214d19-c2", "ovs_interfaceid": "3f214d19-c24c-45d9-8361-36c0d8a5692d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:23:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-95341e14-b743-4dd8-b0af-b7077686c149 req-e3058a49-741c-41a2-b98d-8a4ce0539b31 service nova] Releasing lock "refresh_cache-3e94cd92-2e56-4ad4-90d0-03a06c7437f0" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:23:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.network.neutron [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Successfully updated port: 1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquired lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.network.neutron [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-ad61c1bc-13c4-4e57-8fb0-0ef69f93cb35 req-484f515a-88f5-4470-8516-abb902223e59 service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received event network-changed-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-ad61c1bc-13c4-4e57-8fb0-0ef69f93cb35 req-484f515a-88f5-4470-8516-abb902223e59 service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Refreshing instance network info cache due to event network-changed-1f0ca324-9d6c-4696-a525-76d4ccc1df91. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ad61c1bc-13c4-4e57-8fb0-0ef69f93cb35 req-484f515a-88f5-4470-8516-abb902223e59 service nova] Acquiring lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.network.neutron [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.network.neutron [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Updating instance_info_cache with network_info: [{"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Releasing lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Instance network_info: |[{"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ad61c1bc-13c4-4e57-8fb0-0ef69f93cb35 req-484f515a-88f5-4470-8516-abb902223e59 service nova] Acquired lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.network.neutron [req-ad61c1bc-13c4-4e57-8fb0-0ef69f93cb35 req-484f515a-88f5-4470-8516-abb902223e59 service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Refreshing network info cache for port 1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Start _get_guest_xml network_info=[{"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:23:24 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:23:24 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-964308989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-964308989',id=34,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5d2onuE0v30gwQ4jEufsRWsMY9TbeRWCKYhMnLNiMI80L3e0eEOgGqkVXeCPKdIjnmHflpdmV0MEYeorM+PucSxkA0rIt+i+3QFAvGXmJiVZo59qiKSMAVCLwSImOgXQ==',key_name='tempest-keypair-155698396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96cf0ccd59944be6922b561ecddc7d5b',ramdisk_id='',reservation_id='r-20m7bw3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1729132577',owner_user_name='tempest-AttachVolumeShelveTestJSON-1729132577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860f7b92664e43d19c908f3bdb52d717',uuid=d30d366d-29cc-430b-ba31-bcbc08a364b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converting VIF {"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:8a:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f0ca324-9d6c-4696-a525-76d4ccc1df91,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0ca324-9d') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.objects.instance [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'pci_devices' on Instance uuid d30d366d-29cc-430b-ba31-bcbc08a364b7 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-0caf9355-eb1a-461b-adc0-09a995d9d73d req-e6832994-4024-4162-b881-7cc25e146430 service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Received event network-vif-plugged-3f214d19-c24c-45d9-8361-36c0d8a5692d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0caf9355-eb1a-461b-adc0-09a995d9d73d req-e6832994-4024-4162-b881-7cc25e146430 service nova] Acquiring lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0caf9355-eb1a-461b-adc0-09a995d9d73d req-e6832994-4024-4162-b881-7cc25e146430 service nova] Lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0caf9355-eb1a-461b-adc0-09a995d9d73d req-e6832994-4024-4162-b881-7cc25e146430 service nova] Lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-0caf9355-eb1a-461b-adc0-09a995d9d73d req-e6832994-4024-4162-b881-7cc25e146430 service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] No waiting events found dispatching network-vif-plugged-3f214d19-c24c-45d9-8361-36c0d8a5692d {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:23:24 user nova-compute[73917]: WARNING nova.compute.manager [req-0caf9355-eb1a-461b-adc0-09a995d9d73d req-e6832994-4024-4162-b881-7cc25e146430 service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Received unexpected event network-vif-plugged-3f214d19-c24c-45d9-8361-36c0d8a5692d for instance with vm_state building and task_state spawning.
Aug 26 19:23:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:23:24 user nova-compute[73917]:   <uuid>d30d366d-29cc-430b-ba31-bcbc08a364b7</uuid>
Aug 26 19:23:24 user nova-compute[73917]:   <name>instance-00000022</name>
Aug 26 19:23:24 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:23:24 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:23:24 user nova-compute[73917]:   <metadata>
Aug 26 19:23:24 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:23:24 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:23:24 user nova-compute[73917]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-964308989</nova:name>
Aug 26 19:23:24 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:23:24</nova:creationTime>
Aug 26 19:23:24 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:23:24 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:23:24 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:23:24 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:23:24 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:23:24 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:23:24 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:23:24 user nova-compute[73917]:       <nova:owner>
Aug 26 19:23:24 user nova-compute[73917]:         <nova:user uuid="860f7b92664e43d19c908f3bdb52d717">tempest-AttachVolumeShelveTestJSON-1729132577-project-member</nova:user>
Aug 26 19:23:24 user nova-compute[73917]:         <nova:project uuid="96cf0ccd59944be6922b561ecddc7d5b">tempest-AttachVolumeShelveTestJSON-1729132577</nova:project>
Aug 26 19:23:24 user nova-compute[73917]:       </nova:owner>
Aug 26 19:23:24 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:23:24 user nova-compute[73917]:       <nova:ports>
Aug 26 19:23:24 user nova-compute[73917]:         <nova:port uuid="1f0ca324-9d6c-4696-a525-76d4ccc1df91">
Aug 26 19:23:24 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 19:23:24 user nova-compute[73917]:         </nova:port>
Aug 26 19:23:24 user nova-compute[73917]:       </nova:ports>
Aug 26 19:23:24 user nova-compute[73917]:     </nova:instance>
Aug 26 19:23:24 user nova-compute[73917]:   </metadata>
Aug 26 19:23:24 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:23:24 user nova-compute[73917]:     <system>
Aug 26 19:23:24 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:23:24 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:23:24 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:23:24 user nova-compute[73917]:       <entry name="serial">d30d366d-29cc-430b-ba31-bcbc08a364b7</entry>
Aug 26 19:23:24 user nova-compute[73917]:       <entry name="uuid">d30d366d-29cc-430b-ba31-bcbc08a364b7</entry>
Aug 26 19:23:24 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:23:24 user nova-compute[73917]:     </system>
Aug 26 19:23:24 user nova-compute[73917]:   </sysinfo>
Aug 26 19:23:24 user nova-compute[73917]:   <os>
Aug 26 19:23:24 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:23:24 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:23:24 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:23:24 user nova-compute[73917]:   </os>
Aug 26 19:23:24 user nova-compute[73917]:   <features>
Aug 26 19:23:24 user nova-compute[73917]:     <acpi/>
Aug 26 19:23:24 user nova-compute[73917]:     <apic/>
Aug 26 19:23:24 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:23:24 user nova-compute[73917]:   </features>
Aug 26 19:23:24 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:23:24 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:23:24 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:23:24 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:23:24 user nova-compute[73917]:   </clock>
Aug 26 19:23:24 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:23:24 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:23:24 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:23:24 user nova-compute[73917]:   </cpu>
Aug 26 19:23:24 user nova-compute[73917]:   <devices>
Aug 26 19:23:24 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:23:24 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:23:24 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk"/>
Aug 26 19:23:24 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:23:24 user nova-compute[73917]:     </disk>
Aug 26 19:23:24 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:23:24 user nova-compute[73917]:       <mac address="fa:16:3e:28:8a:f8"/>
Aug 26 19:23:24 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:23:24 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:23:24 user nova-compute[73917]:       <target dev="tap1f0ca324-9d"/>
Aug 26 19:23:24 user nova-compute[73917]:     </interface>
Aug 26 19:23:24 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:23:24 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/console.log" append="off"/>
Aug 26 19:23:24 user nova-compute[73917]:     </serial>
Aug 26 19:23:24 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:23:24 user nova-compute[73917]:     <video>
Aug 26 19:23:24 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:23:24 user nova-compute[73917]:     </video>
Aug 26 19:23:24 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:23:24 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:23:24 user nova-compute[73917]:     </rng>
Aug 26 19:23:24 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:23:24 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:23:24 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:23:24 user nova-compute[73917]:     </memballoon>
Aug 26 19:23:24 user nova-compute[73917]:   </devices>
Aug 26 19:23:24 user nova-compute[73917]: </domain>
Aug 26 19:23:24 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-964308989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-964308989',id=34,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5d2onuE0v30gwQ4jEufsRWsMY9TbeRWCKYhMnLNiMI80L3e0eEOgGqkVXeCPKdIjnmHflpdmV0MEYeorM+PucSxkA0rIt+i+3QFAvGXmJiVZo59qiKSMAVCLwSImOgXQ==',key_name='tempest-keypair-155698396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96cf0ccd59944be6922b561ecddc7d5b',ramdisk_id='',reservation_id='r-20m7bw3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1729132577',owner_user_name='tempest-AttachVolumeShelveTestJSON-1729132577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860f7b92664e43d19c908f3bdb52d717',uuid=d30d366d-29cc-430b-ba31-bcbc08a364b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converting VIF {"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:8a:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f0ca324-9d6c-4696-a525-76d4ccc1df91,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0ca324-9d') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG os_vif [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:8a:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f0ca324-9d6c-4696-a525-76d4ccc1df91,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0ca324-9d') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f0ca324-9d, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f0ca324-9d, col_values=(('external_ids', {'iface-id': '1f0ca324-9d6c-4696-a525-76d4ccc1df91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:8a:f8', 'vm-uuid': 'd30d366d-29cc-430b-ba31-bcbc08a364b7'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:25 user nova-compute[73917]: INFO os_vif [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:8a:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f0ca324-9d6c-4696-a525-76d4ccc1df91,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0ca324-9d')
Aug 26 19:23:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] No VIF found with MAC fa:16:3e:28:8a:f8, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG nova.network.neutron [req-ad61c1bc-13c4-4e57-8fb0-0ef69f93cb35 req-484f515a-88f5-4470-8516-abb902223e59 service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Updated VIF entry in instance network info cache for port 1f0ca324-9d6c-4696-a525-76d4ccc1df91. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG nova.network.neutron [req-ad61c1bc-13c4-4e57-8fb0-0ef69f93cb35 req-484f515a-88f5-4470-8516-abb902223e59 service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Updating instance_info_cache with network_info: [{"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:23:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ad61c1bc-13c4-4e57-8fb0-0ef69f93cb35 req-484f515a-88f5-4470-8516-abb902223e59 service nova] Releasing lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:23:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:26 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077806.971425, 3e94cd92-2e56-4ad4-90d0-03a06c7437f0 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:23:26 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] VM Resumed (Lifecycle Event)
Aug 26 19:23:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:23:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:23:26 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Instance spawned successfully.
Aug 26 19:23:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-3cce835a-c209-4394-abaf-d57c0d84a103 req-c37cb64e-a9d6-4ca6-9fcd-7873fa8ea2df service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Received event network-vif-plugged-3f214d19-c24c-45d9-8361-36c0d8a5692d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3cce835a-c209-4394-abaf-d57c0d84a103 req-c37cb64e-a9d6-4ca6-9fcd-7873fa8ea2df service nova] Acquiring lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3cce835a-c209-4394-abaf-d57c0d84a103 req-c37cb64e-a9d6-4ca6-9fcd-7873fa8ea2df service nova] Lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3cce835a-c209-4394-abaf-d57c0d84a103 req-c37cb64e-a9d6-4ca6-9fcd-7873fa8ea2df service nova] Lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-3cce835a-c209-4394-abaf-d57c0d84a103 req-c37cb64e-a9d6-4ca6-9fcd-7873fa8ea2df service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] No waiting events found dispatching network-vif-plugged-3f214d19-c24c-45d9-8361-36c0d8a5692d {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:23:27 user nova-compute[73917]: WARNING nova.compute.manager [req-3cce835a-c209-4394-abaf-d57c0d84a103 req-c37cb64e-a9d6-4ca6-9fcd-7873fa8ea2df service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Received unexpected event network-vif-plugged-3f214d19-c24c-45d9-8361-36c0d8a5692d for instance with vm_state building and task_state spawning.
Aug 26 19:23:27 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:23:27 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077806.9717798, 3e94cd92-2e56-4ad4-90d0-03a06c7437f0 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:23:27 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] VM Started (Lifecycle Event)
Aug 26 19:23:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:23:27 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:23:27 user nova-compute[73917]: INFO nova.compute.manager [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Took 6.80 seconds to spawn the instance on the hypervisor.
Aug 26 19:23:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:27 user nova-compute[73917]: INFO nova.compute.manager [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Took 7.99 seconds to build instance.
Aug 26 19:23:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-14f4c4f3-322f-4e6d-a960-c53187840720 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.163s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-9eabc617-d0df-4e27-8c8d-ae7731e880b0 req-2f4fd866-9a2a-4c79-8a66-cc4d3ee28ebc service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received event network-vif-plugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9eabc617-d0df-4e27-8c8d-ae7731e880b0 req-2f4fd866-9a2a-4c79-8a66-cc4d3ee28ebc service nova] Acquiring lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9eabc617-d0df-4e27-8c8d-ae7731e880b0 req-2f4fd866-9a2a-4c79-8a66-cc4d3ee28ebc service nova] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9eabc617-d0df-4e27-8c8d-ae7731e880b0 req-2f4fd866-9a2a-4c79-8a66-cc4d3ee28ebc service nova] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-9eabc617-d0df-4e27-8c8d-ae7731e880b0 req-2f4fd866-9a2a-4c79-8a66-cc4d3ee28ebc service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] No waiting events found dispatching network-vif-plugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:23:27 user nova-compute[73917]: WARNING nova.compute.manager [req-9eabc617-d0df-4e27-8c8d-ae7731e880b0 req-2f4fd866-9a2a-4c79-8a66-cc4d3ee28ebc service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received unexpected event network-vif-plugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 for instance with vm_state building and task_state spawning.
Aug 26 19:23:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:29 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077809.1680934, d30d366d-29cc-430b-ba31-bcbc08a364b7 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:23:29 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] VM Resumed (Lifecycle Event)
Aug 26 19:23:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:23:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:23:29 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Instance spawned successfully.
Aug 26 19:23:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:23:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:23:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:23:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:23:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:23:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:23:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:23:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:23:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:23:29 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:23:29 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077809.1695263, d30d366d-29cc-430b-ba31-bcbc08a364b7 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:23:29 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] VM Started (Lifecycle Event)
Aug 26 19:23:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:23:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:23:29 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:23:29 user nova-compute[73917]: INFO nova.compute.manager [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Took 8.30 seconds to spawn the instance on the hypervisor.
Aug 26 19:23:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:23:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-60b308e0-7428-40e2-bf1d-8aa971f30606 req-ea50087e-35c7-408e-8223-9b0c9b958dbe service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received event network-vif-plugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:23:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-60b308e0-7428-40e2-bf1d-8aa971f30606 req-ea50087e-35c7-408e-8223-9b0c9b958dbe service nova] Acquiring lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-60b308e0-7428-40e2-bf1d-8aa971f30606 req-ea50087e-35c7-408e-8223-9b0c9b958dbe service nova] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-60b308e0-7428-40e2-bf1d-8aa971f30606 req-ea50087e-35c7-408e-8223-9b0c9b958dbe service nova] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-60b308e0-7428-40e2-bf1d-8aa971f30606 req-ea50087e-35c7-408e-8223-9b0c9b958dbe service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] No waiting events found dispatching network-vif-plugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:23:29 user nova-compute[73917]: WARNING nova.compute.manager [req-60b308e0-7428-40e2-bf1d-8aa971f30606 req-ea50087e-35c7-408e-8223-9b0c9b958dbe service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received unexpected event network-vif-plugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 for instance with vm_state active and task_state None.
Aug 26 19:23:29 user nova-compute[73917]: INFO nova.compute.manager [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Took 9.60 seconds to build instance.
Aug 26 19:23:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-22f9a39b-07bb-4a01-b770-cbba1af48a3d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.745s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "fd801f18-34b6-4682-8d43-edf82bd216c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:31 user nova-compute[73917]: INFO nova.compute.manager [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Terminating instance
Aug 26 19:23:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:23:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:32 user nova-compute[73917]: DEBUG nova.compute.manager [req-67c140c4-dbb7-4ae7-b198-f014c16ec227 req-4b6772d4-7b60-4e31-ad8b-6d886f289f38 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Received event network-vif-unplugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:23:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-67c140c4-dbb7-4ae7-b198-f014c16ec227 req-4b6772d4-7b60-4e31-ad8b-6d886f289f38 service nova] Acquiring lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-67c140c4-dbb7-4ae7-b198-f014c16ec227 req-4b6772d4-7b60-4e31-ad8b-6d886f289f38 service nova] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-67c140c4-dbb7-4ae7-b198-f014c16ec227 req-4b6772d4-7b60-4e31-ad8b-6d886f289f38 service nova] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:32 user nova-compute[73917]: DEBUG nova.compute.manager [req-67c140c4-dbb7-4ae7-b198-f014c16ec227 req-4b6772d4-7b60-4e31-ad8b-6d886f289f38 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] No waiting events found dispatching network-vif-unplugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:23:32 user nova-compute[73917]: DEBUG nova.compute.manager [req-67c140c4-dbb7-4ae7-b198-f014c16ec227 req-4b6772d4-7b60-4e31-ad8b-6d886f289f38 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Received event network-vif-unplugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:23:32 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Instance destroyed successfully.
Aug 26 19:23:32 user nova-compute[73917]: DEBUG nova.objects.instance [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'resources' on Instance uuid fd801f18-34b6-4682-8d43-edf82bd216c2 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:23:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:06:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-864264859',display_name='tempest-ServerRescueNegativeTestJSON-server-864264859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-864264859',id=4,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:08:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1298aa7a6ca478fb973d5a6d7bea7be',ramdisk_id='',reservation_id='r-yrrbw1ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475026115',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475026115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:08:54Z,user_data=None,user_id='118080e0f2fe4533a25e002e894b99f9',uuid=fd801f18-34b6-4682-8d43-edf82bd216c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "address": "fa:16:3e:9c:f5:38", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b11e5e-5c", "ovs_interfaceid": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:23:32 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converting VIF {"id": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "address": "fa:16:3e:9c:f5:38", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b11e5e-5c", "ovs_interfaceid": "e1b11e5e-5c2a-43b9-bb05-0936cdac7705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:23:32 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:f5:38,bridge_name='br-int',has_traffic_filtering=True,id=e1b11e5e-5c2a-43b9-bb05-0936cdac7705,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b11e5e-5c') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:23:32 user nova-compute[73917]: DEBUG os_vif [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:f5:38,bridge_name='br-int',has_traffic_filtering=True,id=e1b11e5e-5c2a-43b9-bb05-0936cdac7705,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b11e5e-5c') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:23:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1b11e5e-5c, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:23:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:23:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:32 user nova-compute[73917]: INFO os_vif [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:f5:38,bridge_name='br-int',has_traffic_filtering=True,id=e1b11e5e-5c2a-43b9-bb05-0936cdac7705,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b11e5e-5c')
Aug 26 19:23:32 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Deleting instance files /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2_del
Aug 26 19:23:32 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Deletion of /opt/stack/data/nova/instances/fd801f18-34b6-4682-8d43-edf82bd216c2_del complete
Aug 26 19:23:32 user nova-compute[73917]: INFO nova.compute.manager [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 26 19:23:32 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:23:32 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:23:32 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:23:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:33 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:23:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-26094d4b-cf68-45ea-a62c-f721e75949af req-c7c7663e-3bb0-43fa-960f-29fbfdf71bb9 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Received event network-vif-deleted-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:23:33 user nova-compute[73917]: INFO nova.compute.manager [req-26094d4b-cf68-45ea-a62c-f721e75949af req-c7c7663e-3bb0-43fa-960f-29fbfdf71bb9 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Neutron deleted interface e1b11e5e-5c2a-43b9-bb05-0936cdac7705; detaching it from the instance and deleting it from the info cache
Aug 26 19:23:33 user nova-compute[73917]: DEBUG nova.network.neutron [req-26094d4b-cf68-45ea-a62c-f721e75949af req-c7c7663e-3bb0-43fa-960f-29fbfdf71bb9 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:23:33 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Took 0.96 seconds to deallocate network for instance.
Aug 26 19:23:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-26094d4b-cf68-45ea-a62c-f721e75949af req-c7c7663e-3bb0-43fa-960f-29fbfdf71bb9 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Detach interface failed, port_id=e1b11e5e-5c2a-43b9-bb05-0936cdac7705, reason: Instance fd801f18-34b6-4682-8d43-edf82bd216c2 could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:23:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-e1373a70-050f-4f76-9f5a-6964ecb71737 req-2424612d-d466-44ef-ac32-4c0fe286f325 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Received event network-vif-plugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e1373a70-050f-4f76-9f5a-6964ecb71737 req-2424612d-d466-44ef-ac32-4c0fe286f325 service nova] Acquiring lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e1373a70-050f-4f76-9f5a-6964ecb71737 req-2424612d-d466-44ef-ac32-4c0fe286f325 service nova] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e1373a70-050f-4f76-9f5a-6964ecb71737 req-2424612d-d466-44ef-ac32-4c0fe286f325 service nova] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-e1373a70-050f-4f76-9f5a-6964ecb71737 req-2424612d-d466-44ef-ac32-4c0fe286f325 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] No waiting events found dispatching network-vif-plugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:23:34 user nova-compute[73917]: WARNING nova.compute.manager [req-e1373a70-050f-4f76-9f5a-6964ecb71737 req-2424612d-d466-44ef-ac32-4c0fe286f325 service nova] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Received unexpected event network-vif-plugged-e1b11e5e-5c2a-43b9-bb05-0936cdac7705 for instance with vm_state deleted and task_state None.
Aug 26 19:23:34 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.536s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DIQbYZcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:23:34 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:23:34 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:23:34 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:34 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Deleted allocations for instance fd801f18-34b6-4682-8d43-edf82bd216c2
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d37965-b550-4f22-a0c5-b5b2a294292f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:23:34 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[36714649-dfbf-4309-9316-dead6c915fb0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75] added
Aug 26 19:23:34 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[423abe82-d3cf-45db-bdf7-d2f0f95332b3]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a963f05e-c72f-42c3-bdf8-761054e9d2c3]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DIQbYZcs {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0c807ae7-5bd0-40bf-98fd-f5e1a296f1a4 tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "fd801f18-34b6-4682-8d43-edf82bd216c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.948s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DIQbYZcs" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20c82c3-04d7-4afe-bddb-7fafd8c179ae]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DIQbYZcs'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b905b05-892d-4fd5-92ba-f40032a1d37d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae3052e-6d29-4068-88ab-0655318c868c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:23:34 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:23:34 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:23:34 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:23:34 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cdc234-ab9c-40d5-987b-15236ff34bc3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75, portal: 172.16.0.220,3260]
Aug 26 19:23:34 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75, portal: 172.16.0.220,3260] successful.
Aug 26 19:23:34 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f4a073-d3e0-4b96-ab9b-455842e0beb7]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8aece9-25c5-4c6f-a35e-5584bf4c50d0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:23:34 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:23:34 user nova-compute[73917]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 (non-flash)
Aug 26 19:23:34 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:23:34 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:23:34 user nova-compute[73917]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 (non-flash)
Aug 26 19:23:34 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4822c3a2-d9aa-499d-8a8d-35bbe4e9dc58]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:23:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DIQbYZcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:23:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:23:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '23032303333353237', 'path': '/dev/sdc'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:23:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032303333353237', 'path': '/dev/sdc'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:23:35 user nova-compute[73917]: DEBUG nova.objects.instance [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lazy-loading 'flavor' on Instance uuid c78c30ea-1190-44bc-bd78-b3655e251a35 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:23:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:23:35 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:23:35 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:23:35 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:23:35 user nova-compute[73917]:   <serial>3f803dc6-35e2-4410-9376-559f08ebdd75</serial>
Aug 26 19:23:35 user nova-compute[73917]: </disk>
Aug 26 19:23:35 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:23:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:23:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:23:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] No VIF found with MAC fa:16:3e:97:c2:28, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:23:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f4bbe873-a6bb-4d2b-852c-01d23564ed7d tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.550s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "c78c30ea-1190-44bc-bd78-b3655e251a35" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:39 user nova-compute[73917]: INFO nova.compute.manager [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Detaching volume 3f803dc6-35e2-4410-9376-559f08ebdd75
Aug 26 19:23:39 user nova-compute[73917]: INFO nova.virt.block_device [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Attempting to driver detach volume 3f803dc6-35e2-4410-9376-559f08ebdd75 from mountpoint /dev/vdb
Aug 26 19:23:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Attempting to detach device vdb from instance c78c30ea-1190-44bc-bd78-b3655e251a35 from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:23:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:23:39 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:23:39 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:23:39 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:23:39 user nova-compute[73917]:   <serial>3f803dc6-35e2-4410-9376-559f08ebdd75</serial>
Aug 26 19:23:39 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:23:39 user nova-compute[73917]: </disk>
Aug 26 19:23:39 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:23:39 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Successfully detached device vdb from instance c78c30ea-1190-44bc-bd78-b3655e251a35 from the persistent domain config.
Aug 26 19:23:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c78c30ea-1190-44bc-bd78-b3655e251a35 from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:23:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:23:39 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:23:39 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:23:39 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:23:39 user nova-compute[73917]:   <serial>3f803dc6-35e2-4410-9376-559f08ebdd75</serial>
Aug 26 19:23:39 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:23:39 user nova-compute[73917]: </disk>
Aug 26 19:23:39 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693077820.2431931, c78c30ea-1190-44bc-bd78-b3655e251a35 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c78c30ea-1190-44bc-bd78-b3655e251a35 {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:23:40 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Successfully detached device vdb from instance c78c30ea-1190-44bc-bd78-b3655e251a35 from the live domain config.
Aug 26 19:23:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DIQbYZcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:23:40 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:23:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5218ca-05b5-4772-89bb-92f3af0f0d67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[850a8406-d5c8-4502-a1c2-c57bede9fad2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:23:40 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:23:40 user nova-compute[73917]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 (non-flash)
Aug 26 19:23:40 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:23:40 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:23:40 user nova-compute[73917]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 (non-flash)
Aug 26 19:23:40 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b78566680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75'): ({'sdc'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Removing single pathed devices sdc {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e8e735-8c2f-4407-af18-1bb303db672a]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f172cd50-821f-42cd-9c9d-c8ee45f1bd80]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Flushing IO for device /dev/sdc {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4674b33-187b-4598-b120-1d25d49e397d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dc08a7-43b6-468c-a97c-f820eb11030e]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9922f0-7d0b-484b-8d96-efaa8f792133]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e68faaf-8631-4dcc-8e78-a642e79323a6]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75, portal: 172.16.0.220,3260]
Aug 26 19:23:40 user nova-compute[73917]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75, portal: 172.16.0.220,3260] successful.
Aug 26 19:23:40 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f803dc6-35e2-4410-9376-559f08ebdd75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[43575881-6d99-44e6-bd6b-7283242e96e7]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] <== disconnect_volume: return (355ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:23:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:23:41 user nova-compute[73917]: DEBUG nova.objects.instance [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lazy-loading 'flavor' on Instance uuid c78c30ea-1190-44bc-bd78-b3655e251a35 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:23:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0450f499-5ef4-4dca-8ebe-4e430c60d6f2 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.851s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:47 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077812.5176778, fd801f18-34b6-4682-8d43-edf82bd216c2 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:23:47 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] VM Stopped (Lifecycle Event)
Aug 26 19:23:47 user nova-compute[73917]: DEBUG nova.compute.manager [None req-daa4b9a3-8ede-4a88-8f7b-9a6e71135ee5 None None] [instance: fd801f18-34b6-4682-8d43-edf82bd216c2] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:23:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid cc0ae046-2a39-4ab6-9327-2d9452c3035d {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid 1c12fdf0-17e7-438b-aa6c-729dd67676aa {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid 94f8d4e7-f310-45df-a0ae-82e608ac0119 {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid df5c717a-62d8-444d-9968-ad682a31733c {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid c78c30ea-1190-44bc-bd78-b3655e251a35 {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid 4a2d91a5-9943-43f6-b919-30510ccba727 {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid a4487be3-7267-4ae1-8731-a6bdf49a6070 {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid 3e94cd92-2e56-4ad4-90d0-03a06c7437f0 {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid d30d366d-29cc-430b-ba31-bcbc08a364b7 {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "94f8d4e7-f310-45df-a0ae-82e608ac0119" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "94f8d4e7-f310-45df-a0ae-82e608ac0119" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "df5c717a-62d8-444d-9968-ad682a31733c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "df5c717a-62d8-444d-9968-ad682a31733c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "c78c30ea-1190-44bc-bd78-b3655e251a35" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "4a2d91a5-9943-43f6-b919-30510ccba727" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "4a2d91a5-9943-43f6-b919-30510ccba727" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "a4487be3-7267-4ae1-8731-a6bdf49a6070" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "a4487be3-7267-4ae1-8731-a6bdf49a6070" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "d30d366d-29cc-430b-ba31-bcbc08a364b7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "94f8d4e7-f310-45df-a0ae-82e608ac0119" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "df5c717a-62d8-444d-9968-ad682a31733c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "a4487be3-7267-4ae1-8731-a6bdf49a6070" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "4a2d91a5-9943-43f6-b919-30510ccba727" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "c94a0ea3-5230-453b-959c-5d7689c408a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:23:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:23:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:23:57 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:23:57 user nova-compute[73917]: INFO nova.compute.claims [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Claim successful on node user
Aug 26 19:23:57 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:23:57 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:23:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:23:57 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:23:57 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:23:57 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:23:57 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:23:57 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:23:57 user nova-compute[73917]: DEBUG nova.policy [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e056c4ed5a18427a8fd1eaa6a3a795c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68229e3ed72a45fa8c2c9a33780479ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:23:57 user nova-compute[73917]: INFO nova.virt.block_device [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Booting with volume-backed-image 7a0152a1-b7ea-410d-a483-7d6785711f32 at /dev/vda
Aug 26 19:23:58 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Successfully created port: 07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:23:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:23:59 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Successfully updated port: 07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:23:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "refresh_cache-c94a0ea3-5230-453b-959c-5d7689c408a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:23:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquired lock "refresh_cache-c94a0ea3-5230-453b-959c-5d7689c408a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:23:59 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:23:59 user nova-compute[73917]: DEBUG nova.compute.manager [req-404f1516-225f-44b7-8f98-4884e974766c req-114e0451-7c41-45c7-951c-23e24a2dda15 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received event network-changed-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:23:59 user nova-compute[73917]: DEBUG nova.compute.manager [req-404f1516-225f-44b7-8f98-4884e974766c req-114e0451-7c41-45c7-951c-23e24a2dda15 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Refreshing instance network info cache due to event network-changed-07d7c95e-7fc7-4390-9b2d-000e93a3c889. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:23:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-404f1516-225f-44b7-8f98-4884e974766c req-114e0451-7c41-45c7-951c-23e24a2dda15 service nova] Acquiring lock "refresh_cache-c94a0ea3-5230-453b-959c-5d7689c408a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:23:59 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:23:59 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:23:59 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:23:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:23:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:23:59 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:23:59 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Updating instance_info_cache with network_info: [{"id": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "address": "fa:16:3e:49:6c:5b", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d7c95e-7f", "ovs_interfaceid": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:23:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Releasing lock "refresh_cache-c94a0ea3-5230-453b-959c-5d7689c408a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:23:59 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Instance network_info: |[{"id": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "address": "fa:16:3e:49:6c:5b", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d7c95e-7f", "ovs_interfaceid": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:23:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-404f1516-225f-44b7-8f98-4884e974766c req-114e0451-7c41-45c7-951c-23e24a2dda15 service nova] Acquired lock "refresh_cache-c94a0ea3-5230-453b-959c-5d7689c408a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:23:59 user nova-compute[73917]: DEBUG nova.network.neutron [req-404f1516-225f-44b7-8f98-4884e974766c req-114e0451-7c41-45c7-951c-23e24a2dda15 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Refreshing network info cache for port 07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:24:00 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Updating instance_info_cache with network_info: [{"id": "2738a59b-9109-4fef-8868-920d458dfaa1", "address": "fa:16:3e:e9:a2:a3", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2738a59b-91", "ovs_interfaceid": "2738a59b-9109-4fef-8868-920d458dfaa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:24:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-1c12fdf0-17e7-438b-aa6c-729dd67676aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:24:00 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:24:00 user nova-compute[73917]: DEBUG nova.network.neutron [req-404f1516-225f-44b7-8f98-4884e974766c req-114e0451-7c41-45c7-951c-23e24a2dda15 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Updated VIF entry in instance network info cache for port 07d7c95e-7fc7-4390-9b2d-000e93a3c889. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:24:00 user nova-compute[73917]: DEBUG nova.network.neutron [req-404f1516-225f-44b7-8f98-4884e974766c req-114e0451-7c41-45c7-951c-23e24a2dda15 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Updating instance_info_cache with network_info: [{"id": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "address": "fa:16:3e:49:6c:5b", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d7c95e-7f", "ovs_interfaceid": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:24:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-404f1516-225f-44b7-8f98-4884e974766c req-114e0451-7c41-45c7-951c-23e24a2dda15 service nova] Releasing lock "refresh_cache-c94a0ea3-5230-453b-959c-5d7689c408a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "18682407-e406-4f49-a1a0-28eae64b121d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "18682407-e406-4f49-a1a0-28eae64b121d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:24:02 user nova-compute[73917]: INFO nova.compute.claims [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Claim successful on node user
Aug 26 19:24:02 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:24:02 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:24:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG nova.policy [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '714d650d67d74694b520329848fc88b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a44e229f9e4101bb1edf230efcf8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:24:02 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Creating image(s)
Aug 26 19:24:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "/opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "/opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "/opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.189s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.190s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk 1073741824" returned: 0 in 0.051s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.224s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Cannot resize image /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Ensure instance console log exists: /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:03 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Successfully created port: 29703ca1-fe7e-4164-8885-481fcb21887a {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:24:04 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:24:04 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:24:04 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:24:04 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Successfully updated port: 29703ca1-fe7e-4164-8885-481fcb21887a {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:24:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "refresh_cache-18682407-e406-4f49-a1a0-28eae64b121d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:24:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquired lock "refresh_cache-18682407-e406-4f49-a1a0-28eae64b121d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:24:04 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:24:04 user nova-compute[73917]: DEBUG nova.compute.manager [req-03578518-f6b9-48e7-a798-c2c498b5a6e1 req-09e7541e-3c94-4015-9db5-0018fef09b3b service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Received event network-changed-29703ca1-fe7e-4164-8885-481fcb21887a {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:24:04 user nova-compute[73917]: DEBUG nova.compute.manager [req-03578518-f6b9-48e7-a798-c2c498b5a6e1 req-09e7541e-3c94-4015-9db5-0018fef09b3b service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Refreshing instance network info cache due to event network-changed-29703ca1-fe7e-4164-8885-481fcb21887a. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:24:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03578518-f6b9-48e7-a798-c2c498b5a6e1 req-09e7541e-3c94-4015-9db5-0018fef09b3b service nova] Acquiring lock "refresh_cache-18682407-e406-4f49-a1a0-28eae64b121d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:24:04 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.network.neutron [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Updating instance_info_cache with network_info: [{"id": "29703ca1-fe7e-4164-8885-481fcb21887a", "address": "fa:16:3e:84:4f:31", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29703ca1-fe", "ovs_interfaceid": "29703ca1-fe7e-4164-8885-481fcb21887a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Releasing lock "refresh_cache-18682407-e406-4f49-a1a0-28eae64b121d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Instance network_info: |[{"id": "29703ca1-fe7e-4164-8885-481fcb21887a", "address": "fa:16:3e:84:4f:31", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29703ca1-fe", "ovs_interfaceid": "29703ca1-fe7e-4164-8885-481fcb21887a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03578518-f6b9-48e7-a798-c2c498b5a6e1 req-09e7541e-3c94-4015-9db5-0018fef09b3b service nova] Acquired lock "refresh_cache-18682407-e406-4f49-a1a0-28eae64b121d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.network.neutron [req-03578518-f6b9-48e7-a798-c2c498b5a6e1 req-09e7541e-3c94-4015-9db5-0018fef09b3b service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Refreshing network info cache for port 29703ca1-fe7e-4164-8885-481fcb21887a {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Start _get_guest_xml network_info=[{"id": "29703ca1-fe7e-4164-8885-481fcb21887a", "address": "fa:16:3e:84:4f:31", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29703ca1-fe", "ovs_interfaceid": "29703ca1-fe7e-4164-8885-481fcb21887a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:24:05 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:24:05 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1456946171',display_name='tempest-VolumesSnapshotTestJSON-instance-1456946171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1456946171',id=36,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+kK1W+c9oeveSKbhViQBVWjAnDMAmczE6jvn2Hw8599J/1Ab0JWr1jeoL+NMTBFREwUwgpIRCBPXmgzuspUeHrLMw17UsgkxUpSeCGWlxeR6pfJDeUbx48SdiAcqnK6Q==',key_name='tempest-keypair-534024245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02a44e229f9e4101bb1edf230efcf8bd',ramdisk_id='',reservation_id='r-0n3rov19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1190045200',owner_user_name='tempest-VolumesSnapshotTestJSON-1190045200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:24:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='714d650d67d74694b520329848fc88b7',uuid=18682407-e406-4f49-a1a0-28eae64b121d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29703ca1-fe7e-4164-8885-481fcb21887a", "address": "fa:16:3e:84:4f:31", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29703ca1-fe", "ovs_interfaceid": "29703ca1-fe7e-4164-8885-481fcb21887a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Converting VIF {"id": "29703ca1-fe7e-4164-8885-481fcb21887a", "address": "fa:16:3e:84:4f:31", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29703ca1-fe", "ovs_interfaceid": "29703ca1-fe7e-4164-8885-481fcb21887a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:4f:31,bridge_name='br-int',has_traffic_filtering=True,id=29703ca1-fe7e-4164-8885-481fcb21887a,network=Network(b47e702d-90fc-48c8-bdef-274729c534a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29703ca1-fe') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.objects.instance [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lazy-loading 'pci_devices' on Instance uuid 18682407-e406-4f49-a1a0-28eae64b121d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:24:05 user nova-compute[73917]:   <uuid>18682407-e406-4f49-a1a0-28eae64b121d</uuid>
Aug 26 19:24:05 user nova-compute[73917]:   <name>instance-00000024</name>
Aug 26 19:24:05 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:24:05 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:24:05 user nova-compute[73917]:   <metadata>
Aug 26 19:24:05 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:24:05 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:24:05 user nova-compute[73917]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1456946171</nova:name>
Aug 26 19:24:05 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:24:05</nova:creationTime>
Aug 26 19:24:05 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:24:05 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:24:05 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:24:05 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:24:05 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:24:05 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:24:05 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:24:05 user nova-compute[73917]:       <nova:owner>
Aug 26 19:24:05 user nova-compute[73917]:         <nova:user uuid="714d650d67d74694b520329848fc88b7">tempest-VolumesSnapshotTestJSON-1190045200-project-member</nova:user>
Aug 26 19:24:05 user nova-compute[73917]:         <nova:project uuid="02a44e229f9e4101bb1edf230efcf8bd">tempest-VolumesSnapshotTestJSON-1190045200</nova:project>
Aug 26 19:24:05 user nova-compute[73917]:       </nova:owner>
Aug 26 19:24:05 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:24:05 user nova-compute[73917]:       <nova:ports>
Aug 26 19:24:05 user nova-compute[73917]:         <nova:port uuid="29703ca1-fe7e-4164-8885-481fcb21887a">
Aug 26 19:24:05 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 19:24:05 user nova-compute[73917]:         </nova:port>
Aug 26 19:24:05 user nova-compute[73917]:       </nova:ports>
Aug 26 19:24:05 user nova-compute[73917]:     </nova:instance>
Aug 26 19:24:05 user nova-compute[73917]:   </metadata>
Aug 26 19:24:05 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:24:05 user nova-compute[73917]:     <system>
Aug 26 19:24:05 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:24:05 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:24:05 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:24:05 user nova-compute[73917]:       <entry name="serial">18682407-e406-4f49-a1a0-28eae64b121d</entry>
Aug 26 19:24:05 user nova-compute[73917]:       <entry name="uuid">18682407-e406-4f49-a1a0-28eae64b121d</entry>
Aug 26 19:24:05 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:24:05 user nova-compute[73917]:     </system>
Aug 26 19:24:05 user nova-compute[73917]:   </sysinfo>
Aug 26 19:24:05 user nova-compute[73917]:   <os>
Aug 26 19:24:05 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:24:05 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:24:05 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:24:05 user nova-compute[73917]:   </os>
Aug 26 19:24:05 user nova-compute[73917]:   <features>
Aug 26 19:24:05 user nova-compute[73917]:     <acpi/>
Aug 26 19:24:05 user nova-compute[73917]:     <apic/>
Aug 26 19:24:05 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:24:05 user nova-compute[73917]:   </features>
Aug 26 19:24:05 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:24:05 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:24:05 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:24:05 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:24:05 user nova-compute[73917]:   </clock>
Aug 26 19:24:05 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:24:05 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:24:05 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:24:05 user nova-compute[73917]:   </cpu>
Aug 26 19:24:05 user nova-compute[73917]:   <devices>
Aug 26 19:24:05 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:24:05 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:24:05 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk"/>
Aug 26 19:24:05 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:24:05 user nova-compute[73917]:     </disk>
Aug 26 19:24:05 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:24:05 user nova-compute[73917]:       <mac address="fa:16:3e:84:4f:31"/>
Aug 26 19:24:05 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:24:05 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:24:05 user nova-compute[73917]:       <target dev="tap29703ca1-fe"/>
Aug 26 19:24:05 user nova-compute[73917]:     </interface>
Aug 26 19:24:05 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:24:05 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/console.log" append="off"/>
Aug 26 19:24:05 user nova-compute[73917]:     </serial>
Aug 26 19:24:05 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:24:05 user nova-compute[73917]:     <video>
Aug 26 19:24:05 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:24:05 user nova-compute[73917]:     </video>
Aug 26 19:24:05 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:24:05 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:24:05 user nova-compute[73917]:     </rng>
Aug 26 19:24:05 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:24:05 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:24:05 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:24:05 user nova-compute[73917]:     </memballoon>
Aug 26 19:24:05 user nova-compute[73917]:   </devices>
Aug 26 19:24:05 user nova-compute[73917]: </domain>
Aug 26 19:24:05 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1456946171',display_name='tempest-VolumesSnapshotTestJSON-instance-1456946171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1456946171',id=36,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+kK1W+c9oeveSKbhViQBVWjAnDMAmczE6jvn2Hw8599J/1Ab0JWr1jeoL+NMTBFREwUwgpIRCBPXmgzuspUeHrLMw17UsgkxUpSeCGWlxeR6pfJDeUbx48SdiAcqnK6Q==',key_name='tempest-keypair-534024245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02a44e229f9e4101bb1edf230efcf8bd',ramdisk_id='',reservation_id='r-0n3rov19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1190045200',owner_user_name='tempest-VolumesSnapshotTestJSON-1190045200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:24:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='714d650d67d74694b520329848fc88b7',uuid=18682407-e406-4f49-a1a0-28eae64b121d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29703ca1-fe7e-4164-8885-481fcb21887a", "address": "fa:16:3e:84:4f:31", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29703ca1-fe", "ovs_interfaceid": "29703ca1-fe7e-4164-8885-481fcb21887a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Converting VIF {"id": "29703ca1-fe7e-4164-8885-481fcb21887a", "address": "fa:16:3e:84:4f:31", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29703ca1-fe", "ovs_interfaceid": "29703ca1-fe7e-4164-8885-481fcb21887a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:4f:31,bridge_name='br-int',has_traffic_filtering=True,id=29703ca1-fe7e-4164-8885-481fcb21887a,network=Network(b47e702d-90fc-48c8-bdef-274729c534a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29703ca1-fe') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG os_vif [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:4f:31,bridge_name='br-int',has_traffic_filtering=True,id=29703ca1-fe7e-4164-8885-481fcb21887a,network=Network(b47e702d-90fc-48c8-bdef-274729c534a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29703ca1-fe') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29703ca1-fe, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap29703ca1-fe, col_values=(('external_ids', {'iface-id': '29703ca1-fe7e-4164-8885-481fcb21887a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:4f:31', 'vm-uuid': '18682407-e406-4f49-a1a0-28eae64b121d'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:05 user nova-compute[73917]: INFO os_vif [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:4f:31,bridge_name='br-int',has_traffic_filtering=True,id=29703ca1-fe7e-4164-8885-481fcb21887a,network=Network(b47e702d-90fc-48c8-bdef-274729c534a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29703ca1-fe')
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] No VIF found with MAC fa:16:3e:84:4f:31, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.network.neutron [req-03578518-f6b9-48e7-a798-c2c498b5a6e1 req-09e7541e-3c94-4015-9db5-0018fef09b3b service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Updated VIF entry in instance network info cache for port 29703ca1-fe7e-4164-8885-481fcb21887a. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG nova.network.neutron [req-03578518-f6b9-48e7-a798-c2c498b5a6e1 req-09e7541e-3c94-4015-9db5-0018fef09b3b service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Updating instance_info_cache with network_info: [{"id": "29703ca1-fe7e-4164-8885-481fcb21887a", "address": "fa:16:3e:84:4f:31", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29703ca1-fe", "ovs_interfaceid": "29703ca1-fe7e-4164-8885-481fcb21887a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:24:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-03578518-f6b9-48e7-a798-c2c498b5a6e1 req-09e7541e-3c94-4015-9db5-0018fef09b3b service nova] Releasing lock "refresh_cache-18682407-e406-4f49-a1a0-28eae64b121d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:24:06 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:24:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:24:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:24:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:06 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:24:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:06 user nova-compute[73917]: DEBUG nova.compute.manager [req-64d01eba-d90c-4226-bf9d-aa08c70d4209 req-dbfb62bc-7693-4fd2-89b0-a1cebc521634 service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Received event network-vif-plugged-29703ca1-fe7e-4164-8885-481fcb21887a {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:24:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-64d01eba-d90c-4226-bf9d-aa08c70d4209 req-dbfb62bc-7693-4fd2-89b0-a1cebc521634 service nova] Acquiring lock "18682407-e406-4f49-a1a0-28eae64b121d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:24:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-64d01eba-d90c-4226-bf9d-aa08c70d4209 req-dbfb62bc-7693-4fd2-89b0-a1cebc521634 service nova] Lock "18682407-e406-4f49-a1a0-28eae64b121d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:24:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-64d01eba-d90c-4226-bf9d-aa08c70d4209 req-dbfb62bc-7693-4fd2-89b0-a1cebc521634 service nova] Lock "18682407-e406-4f49-a1a0-28eae64b121d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:06 user nova-compute[73917]: DEBUG nova.compute.manager [req-64d01eba-d90c-4226-bf9d-aa08c70d4209 req-dbfb62bc-7693-4fd2-89b0-a1cebc521634 service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] No waiting events found dispatching network-vif-plugged-29703ca1-fe7e-4164-8885-481fcb21887a {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:24:06 user nova-compute[73917]: WARNING nova.compute.manager [req-64d01eba-d90c-4226-bf9d-aa08c70d4209 req-dbfb62bc-7693-4fd2-89b0-a1cebc521634 service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Received unexpected event network-vif-plugged-29703ca1-fe7e-4164-8885-481fcb21887a for instance with vm_state building and task_state spawning.
Aug 26 19:24:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:08 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:24:08 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:24:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077849.034729, 18682407-e406-4f49-a1a0-28eae64b121d => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:24:09 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] VM Resumed (Lifecycle Event)
Aug 26 19:24:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG nova.compute.manager [req-b0e48319-a61d-429f-b7a3-652d7b8e68f5 req-7c9dd90f-0b7f-4442-a295-4afe75300ff2 service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Received event network-vif-plugged-29703ca1-fe7e-4164-8885-481fcb21887a {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b0e48319-a61d-429f-b7a3-652d7b8e68f5 req-7c9dd90f-0b7f-4442-a295-4afe75300ff2 service nova] Acquiring lock "18682407-e406-4f49-a1a0-28eae64b121d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b0e48319-a61d-429f-b7a3-652d7b8e68f5 req-7c9dd90f-0b7f-4442-a295-4afe75300ff2 service nova] Lock "18682407-e406-4f49-a1a0-28eae64b121d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b0e48319-a61d-429f-b7a3-652d7b8e68f5 req-7c9dd90f-0b7f-4442-a295-4afe75300ff2 service nova] Lock "18682407-e406-4f49-a1a0-28eae64b121d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG nova.compute.manager [req-b0e48319-a61d-429f-b7a3-652d7b8e68f5 req-7c9dd90f-0b7f-4442-a295-4afe75300ff2 service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] No waiting events found dispatching network-vif-plugged-29703ca1-fe7e-4164-8885-481fcb21887a {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:24:09 user nova-compute[73917]: WARNING nova.compute.manager [req-b0e48319-a61d-429f-b7a3-652d7b8e68f5 req-7c9dd90f-0b7f-4442-a295-4afe75300ff2 service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Received unexpected event network-vif-plugged-29703ca1-fe7e-4164-8885-481fcb21887a for instance with vm_state building and task_state spawning.
Aug 26 19:24:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:24:09 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Instance spawned successfully.
Aug 26 19:24:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:24:09 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:24:09 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077849.039606, 18682407-e406-4f49-a1a0-28eae64b121d => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:24:09 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] VM Started (Lifecycle Event)
Aug 26 19:24:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:24:09 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:24:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:09 user nova-compute[73917]: INFO nova.compute.manager [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Took 6.29 seconds to spawn the instance on the hypervisor.
Aug 26 19:24:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:24:09 user nova-compute[73917]: INFO nova.compute.manager [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Took 7.11 seconds to build instance.
Aug 26 19:24:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ca9077d1-5ef5-4eca-8b61-78510ff4518b tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "18682407-e406-4f49-a1a0-28eae64b121d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.198s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:11 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:24:11 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:24:11 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=7477MB free_disk=25.198467254638672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:24:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:24:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:24:11 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance cc0ae046-2a39-4ab6-9327-2d9452c3035d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:24:11 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:24:11 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 94f8d4e7-f310-45df-a0ae-82e608ac0119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:24:11 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance df5c717a-62d8-444d-9968-ad682a31733c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:24:11 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c78c30ea-1190-44bc-bd78-b3655e251a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:24:11 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 4a2d91a5-9943-43f6-b919-30510ccba727 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:24:11 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance a4487be3-7267-4ae1-8731-a6bdf49a6070 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:24:11 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 3e94cd92-2e56-4ad4-90d0-03a06c7437f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:24:11 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance d30d366d-29cc-430b-ba31-bcbc08a364b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:24:11 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c94a0ea3-5230-453b-959c-5d7689c408a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:24:11 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 18682407-e406-4f49-a1a0-28eae64b121d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:24:11 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:24:11 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:24:11 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:24:11 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:24:11 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:24:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.586s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:13 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:24:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:24:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:24:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:24:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:24:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:24:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:24:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:24:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:24:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:22 user nova-compute[73917]: INFO nova.compute.manager [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Terminating instance
Aug 26 19:24:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-001221bd-595a-43db-86c9-8658c7204661 req-7c8676cd-f64a-4fea-9eea-91980d42ad40 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received event network-vif-unplugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-001221bd-595a-43db-86c9-8658c7204661 req-7c8676cd-f64a-4fea-9eea-91980d42ad40 service nova] Acquiring lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-001221bd-595a-43db-86c9-8658c7204661 req-7c8676cd-f64a-4fea-9eea-91980d42ad40 service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-001221bd-595a-43db-86c9-8658c7204661 req-7c8676cd-f64a-4fea-9eea-91980d42ad40 service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-001221bd-595a-43db-86c9-8658c7204661 req-7c8676cd-f64a-4fea-9eea-91980d42ad40 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] No waiting events found dispatching network-vif-unplugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-001221bd-595a-43db-86c9-8658c7204661 req-7c8676cd-f64a-4fea-9eea-91980d42ad40 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received event network-vif-unplugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG os_brick.utils [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b751f8b6-4b84-4ec9-8745-84559f661652]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b92fb0-eb3b-47a1-8aaf-a5805ff1ab31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad56dbf8-22d7-4140-a322-a1ba53ceb0de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a77b07c-7506-4a7b-bd26-e05ee0a95d2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:23 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Instance destroyed successfully.
Aug 26 19:24:23 user nova-compute[73917]: DEBUG nova.objects.instance [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lazy-loading 'resources' on Instance uuid cc0ae046-2a39-4ab6-9327-2d9452c3035d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:24:23 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:24:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f37cd77-d0d4-4e6a-a394-693cea55b896]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG os_brick.utils [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Updating existing volume attachment record: 251aa156-502f-4d9a-8aa1-c8b835931e77 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1476169522',display_name='tempest-ServerRescueNegativeTestJSON-server-1476169522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1476169522',id=2,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:11:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1298aa7a6ca478fb973d5a6d7bea7be',ramdisk_id='',reservation_id='r-0yp9qq21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475026115',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475026115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:13:41Z,user_data=None,user_id='118080e0f2fe4533a25e002e894b99f9',uuid=cc0ae046-2a39-4ab6-9327-2d9452c3035d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "address": "fa:16:3e:89:79:8b", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8ac63b-61", "ovs_interfaceid": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converting VIF {"id": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "address": "fa:16:3e:89:79:8b", "network": {"id": "6e198f71-ff66-4d88-9445-fc0fdda39da7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1029342242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1298aa7a6ca478fb973d5a6d7bea7be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8ac63b-61", "ovs_interfaceid": "3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:79:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8ac63b-61') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG os_vif [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:79:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8ac63b-61') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e8ac63b-61, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:23 user nova-compute[73917]: INFO os_vif [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:79:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b,network=Network(6e198f71-ff66-4d88-9445-fc0fdda39da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8ac63b-61')
Aug 26 19:24:23 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Deleting instance files /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d_del
Aug 26 19:24:23 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Deletion of /opt/stack/data/nova/instances/cc0ae046-2a39-4ab6-9327-2d9452c3035d_del complete
Aug 26 19:24:23 user nova-compute[73917]: INFO nova.compute.manager [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 26 19:24:23 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:24:23 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:24:24 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:24:24 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Took 0.61 seconds to deallocate network for instance.
Aug 26 19:24:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-c475f900-788c-4bc6-b86a-4655d7921423 req-c8abe7c8-58c6-4ac0-add2-0cb6e624b164 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received event network-vif-deleted-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:24:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:24:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:24:24 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:24:24 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:24:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:25 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Deleted allocations for instance cc0ae046-2a39-4ab6-9327-2d9452c3035d
Aug 26 19:24:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f0071316-21c9-4e67-881e-155ba3e89fdb tempest-ServerRescueNegativeTestJSON-1475026115 tempest-ServerRescueNegativeTestJSON-1475026115-project-member] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.189s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-0371ed60-c376-4c5f-a865-a93e782c0028 req-f4fbfa23-05b7-4314-a388-c1e324aa71c1 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received event network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:24:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0371ed60-c376-4c5f-a865-a93e782c0028 req-f4fbfa23-05b7-4314-a388-c1e324aa71c1 service nova] Acquiring lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:24:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0371ed60-c376-4c5f-a865-a93e782c0028 req-f4fbfa23-05b7-4314-a388-c1e324aa71c1 service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:24:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0371ed60-c376-4c5f-a865-a93e782c0028 req-f4fbfa23-05b7-4314-a388-c1e324aa71c1 service nova] Lock "cc0ae046-2a39-4ab6-9327-2d9452c3035d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-0371ed60-c376-4c5f-a865-a93e782c0028 req-f4fbfa23-05b7-4314-a388-c1e324aa71c1 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] No waiting events found dispatching network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:24:25 user nova-compute[73917]: WARNING nova.compute.manager [req-0371ed60-c376-4c5f-a865-a93e782c0028 req-f4fbfa23-05b7-4314-a388-c1e324aa71c1 service nova] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Received unexpected event network-vif-plugged-3e8ac63b-6134-4ebc-8681-7f14ce2b1d9b for instance with vm_state deleted and task_state None.
Aug 26 19:24:25 user nova-compute[73917]: INFO nova.compute.manager [None req-ddad1d65-b1c4-448c-9dca-1bb1f595d1c0 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Get console output
Aug 26 19:24:25 user nova-compute[73917]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 26 19:24:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "c78c30ea-1190-44bc-bd78-b3655e251a35" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:24:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:24:34 user nova-compute[73917]: DEBUG nova.objects.instance [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lazy-loading 'flavor' on Instance uuid c78c30ea-1190-44bc-bd78-b3655e251a35 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:24:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "c78c30ea-1190-44bc-bd78-b3655e251a35" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:24:35 user nova-compute[73917]: INFO nova.compute.manager [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Attaching volume d6dfd7c1-5106-41e9-9f05-9f29793234b0 to /dev/vdb
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.utils [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a89ad3-1b73-4a95-bc28-972f70c002dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98f858d-6a76-4583-8b4c-9e121ae0405f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f3608d-135e-4a56-9267-1f10c92c8d0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bdb1a3-710f-4d4a-90cd-6695d7f794c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:24:35 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6812abd-2b94-4de8-ba1d-574189a01b79]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.utils [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Updating existing volume attachment record: f6199c24-1b80-48fb-b618-07723d29920d {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:24:35 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Creating image(s)
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Did not create local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Ensure instance console log exists: /opt/stack/data/nova/instances/c94a0ea3-5230-453b-959c-5d7689c408a6/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Start _get_guest_xml network_info=[{"id": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "address": "fa:16:3e:49:6c:5b", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d7c95e-7f", "ovs_interfaceid": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkAzYZFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c94a0ea3-5230-453b-959c-5d7689c408a6', 'attached_at': '', 'detached_at': '', 'volume_id': '66bbdc9d-8da4-4b8b-bce8-71881d15aff1', 'serial': '66bbdc9d-8da4-4b8b-bce8-71881d15aff1'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '251aa156-502f-4d9a-8aa1-c8b835931e77', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:24:35 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:24:35 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkAzYZFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:24:35 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:24:35 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:24:35 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[38945c05-826c-4a7a-ac32-c576d7bf4ba0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:24:35 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aac7321-67b2-43bc-9f2f-fe405041301b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1] added
Aug 26 19:24:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fe1a52-050a-472c-b687-fdda56009c93]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[477c17dc-29c1-4462-a21e-82f4b64d5fe5]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hkAzYZFg {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hkAzYZFg" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a3b996-08db-49b7-ba97-389363c9c2f9]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hkAzYZFg'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d0d7a1-4935-48d1-ba69-81c99d583b6b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[41134c1c-8445-41f9-a6f5-e3878dde5fcb]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:24:35 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:24:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:24:35 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:24:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c452bb9a-3c40-4959-bb41-43429ea266ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1, portal: 172.16.0.220,3260]
Aug 26 19:24:35 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1, portal: 172.16.0.220,3260] successful.
Aug 26 19:24:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c744be5a-ec61-43b9-9ed0-f7cf3ed0dd0d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a1f795-c936-4b9f-a108-c2132ec87786]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:24:35 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:24:35 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:24:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:24:35 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:24:35 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:24:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaedd94-c148-4ecb-8c86-b3ac8f367cb7]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:24:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkAzYZFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26561316662316664', 'path': '/dev/sdc'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561316662316664', 'path': '/dev/sdc'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:23:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-111348542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-111348542',id=35,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68229e3ed72a45fa8c2c9a33780479ce',ramdisk_id='',reservation_id='r-3pi0cwrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:23:58Z,user_data=None,user_id='e056c4ed5a18427a8fd1eaa6a3a795c0',uuid=c94a0ea3-5230-453b-959c-5d7689c408a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "address": "fa:16:3e:49:6c:5b", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d7c95e-7f", "ovs_interfaceid": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converting VIF {"id": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "address": "fa:16:3e:49:6c:5b", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d7c95e-7f", "ovs_interfaceid": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:6c:5b,bridge_name='br-int',has_traffic_filtering=True,id=07d7c95e-7fc7-4390-9b2d-000e93a3c889,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d7c95e-7f') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG nova.objects.instance [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'pci_devices' on Instance uuid c94a0ea3-5230-453b-959c-5d7689c408a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:24:36 user nova-compute[73917]:   <uuid>c94a0ea3-5230-453b-959c-5d7689c408a6</uuid>
Aug 26 19:24:36 user nova-compute[73917]:   <name>instance-00000023</name>
Aug 26 19:24:36 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:24:36 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:24:36 user nova-compute[73917]:   <metadata>
Aug 26 19:24:36 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:24:36 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:24:36 user nova-compute[73917]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-111348542</nova:name>
Aug 26 19:24:36 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:24:35</nova:creationTime>
Aug 26 19:24:36 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:24:36 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:24:36 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:24:36 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:24:36 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:24:36 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:24:36 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:24:36 user nova-compute[73917]:       <nova:owner>
Aug 26 19:24:36 user nova-compute[73917]:         <nova:user uuid="e056c4ed5a18427a8fd1eaa6a3a795c0">tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member</nova:user>
Aug 26 19:24:36 user nova-compute[73917]:         <nova:project uuid="68229e3ed72a45fa8c2c9a33780479ce">tempest-ServerBootFromVolumeStableRescueTest-1067875450</nova:project>
Aug 26 19:24:36 user nova-compute[73917]:       </nova:owner>
Aug 26 19:24:36 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:24:36 user nova-compute[73917]:       <nova:ports>
Aug 26 19:24:36 user nova-compute[73917]:         <nova:port uuid="07d7c95e-7fc7-4390-9b2d-000e93a3c889">
Aug 26 19:24:36 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 19:24:36 user nova-compute[73917]:         </nova:port>
Aug 26 19:24:36 user nova-compute[73917]:       </nova:ports>
Aug 26 19:24:36 user nova-compute[73917]:     </nova:instance>
Aug 26 19:24:36 user nova-compute[73917]:   </metadata>
Aug 26 19:24:36 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:24:36 user nova-compute[73917]:     <system>
Aug 26 19:24:36 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:24:36 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:24:36 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:24:36 user nova-compute[73917]:       <entry name="serial">c94a0ea3-5230-453b-959c-5d7689c408a6</entry>
Aug 26 19:24:36 user nova-compute[73917]:       <entry name="uuid">c94a0ea3-5230-453b-959c-5d7689c408a6</entry>
Aug 26 19:24:36 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:24:36 user nova-compute[73917]:     </system>
Aug 26 19:24:36 user nova-compute[73917]:   </sysinfo>
Aug 26 19:24:36 user nova-compute[73917]:   <os>
Aug 26 19:24:36 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:24:36 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:24:36 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:24:36 user nova-compute[73917]:   </os>
Aug 26 19:24:36 user nova-compute[73917]:   <features>
Aug 26 19:24:36 user nova-compute[73917]:     <acpi/>
Aug 26 19:24:36 user nova-compute[73917]:     <apic/>
Aug 26 19:24:36 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:24:36 user nova-compute[73917]:   </features>
Aug 26 19:24:36 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:24:36 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:24:36 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:24:36 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:24:36 user nova-compute[73917]:   </clock>
Aug 26 19:24:36 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:24:36 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:24:36 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:24:36 user nova-compute[73917]:   </cpu>
Aug 26 19:24:36 user nova-compute[73917]:   <devices>
Aug 26 19:24:36 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:24:36 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:24:36 user nova-compute[73917]:       <source dev="/dev/sdc"/>
Aug 26 19:24:36 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:24:36 user nova-compute[73917]:       <serial>66bbdc9d-8da4-4b8b-bce8-71881d15aff1</serial>
Aug 26 19:24:36 user nova-compute[73917]:     </disk>
Aug 26 19:24:36 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:24:36 user nova-compute[73917]:       <mac address="fa:16:3e:49:6c:5b"/>
Aug 26 19:24:36 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:24:36 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:24:36 user nova-compute[73917]:       <target dev="tap07d7c95e-7f"/>
Aug 26 19:24:36 user nova-compute[73917]:     </interface>
Aug 26 19:24:36 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:24:36 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/c94a0ea3-5230-453b-959c-5d7689c408a6/console.log" append="off"/>
Aug 26 19:24:36 user nova-compute[73917]:     </serial>
Aug 26 19:24:36 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:24:36 user nova-compute[73917]:     <video>
Aug 26 19:24:36 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:24:36 user nova-compute[73917]:     </video>
Aug 26 19:24:36 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:24:36 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:24:36 user nova-compute[73917]:     </rng>
Aug 26 19:24:36 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:24:36 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:24:36 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:24:36 user nova-compute[73917]:     </memballoon>
Aug 26 19:24:36 user nova-compute[73917]:   </devices>
Aug 26 19:24:36 user nova-compute[73917]: </domain>
Aug 26 19:24:36 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:23:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-111348542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-111348542',id=35,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68229e3ed72a45fa8c2c9a33780479ce',ramdisk_id='',reservation_id='r-3pi0cwrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:23:58Z,user_data=None,user_id='e056c4ed5a18427a8fd1eaa6a3a795c0',uuid=c94a0ea3-5230-453b-959c-5d7689c408a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "address": "fa:16:3e:49:6c:5b", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d7c95e-7f", "ovs_interfaceid": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converting VIF {"id": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "address": "fa:16:3e:49:6c:5b", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d7c95e-7f", "ovs_interfaceid": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:6c:5b,bridge_name='br-int',has_traffic_filtering=True,id=07d7c95e-7fc7-4390-9b2d-000e93a3c889,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d7c95e-7f') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG os_vif [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:6c:5b,bridge_name='br-int',has_traffic_filtering=True,id=07d7c95e-7fc7-4390-9b2d-000e93a3c889,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d7c95e-7f') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07d7c95e-7f, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap07d7c95e-7f, col_values=(('external_ids', {'iface-id': '07d7c95e-7fc7-4390-9b2d-000e93a3c889', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:6c:5b', 'vm-uuid': 'c94a0ea3-5230-453b-959c-5d7689c408a6'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:36 user nova-compute[73917]: INFO os_vif [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:6c:5b,bridge_name='br-int',has_traffic_filtering=True,id=07d7c95e-7fc7-4390-9b2d-000e93a3c889,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d7c95e-7f')
Aug 26 19:24:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:24:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] No VIF found with MAC fa:16:3e:49:6c:5b, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:24:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:38 user nova-compute[73917]: DEBUG nova.compute.manager [req-1d16d5a7-da57-4e14-8c8d-5548ce8fe634 req-3755ae6b-b4fa-4c97-b939-bae6c16ffb3e service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:24:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1d16d5a7-da57-4e14-8c8d-5548ce8fe634 req-3755ae6b-b4fa-4c97-b939-bae6c16ffb3e service nova] Acquiring lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:24:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1d16d5a7-da57-4e14-8c8d-5548ce8fe634 req-3755ae6b-b4fa-4c97-b939-bae6c16ffb3e service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:24:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1d16d5a7-da57-4e14-8c8d-5548ce8fe634 req-3755ae6b-b4fa-4c97-b939-bae6c16ffb3e service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:38 user nova-compute[73917]: DEBUG nova.compute.manager [req-1d16d5a7-da57-4e14-8c8d-5548ce8fe634 req-3755ae6b-b4fa-4c97-b939-bae6c16ffb3e service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] No waiting events found dispatching network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:24:38 user nova-compute[73917]: WARNING nova.compute.manager [req-1d16d5a7-da57-4e14-8c8d-5548ce8fe634 req-3755ae6b-b4fa-4c97-b939-bae6c16ffb3e service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received unexpected event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 for instance with vm_state building and task_state spawning.
Aug 26 19:24:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:38 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077863.7009754, cc0ae046-2a39-4ab6-9327-2d9452c3035d => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:24:38 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] VM Stopped (Lifecycle Event)
Aug 26 19:24:38 user nova-compute[73917]: DEBUG nova.compute.manager [None req-e60f6870-79cd-4bc9-a1d5-90c901cf64cb None None] [instance: cc0ae046-2a39-4ab6-9327-2d9452c3035d] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:24:40 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077880.509534, c94a0ea3-5230-453b-959c-5d7689c408a6 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:24:40 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] VM Resumed (Lifecycle Event)
Aug 26 19:24:40 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:24:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:24:40 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Instance spawned successfully.
Aug 26 19:24:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:24:40 user nova-compute[73917]: DEBUG nova.compute.manager [req-3f681b8b-4ae2-42fb-832b-850cc0d2b5e3 req-2fbed6fd-17e6-4be8-8290-3924c8ab8f11 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:24:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3f681b8b-4ae2-42fb-832b-850cc0d2b5e3 req-2fbed6fd-17e6-4be8-8290-3924c8ab8f11 service nova] Acquiring lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:24:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3f681b8b-4ae2-42fb-832b-850cc0d2b5e3 req-2fbed6fd-17e6-4be8-8290-3924c8ab8f11 service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:24:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3f681b8b-4ae2-42fb-832b-850cc0d2b5e3 req-2fbed6fd-17e6-4be8-8290-3924c8ab8f11 service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:40 user nova-compute[73917]: DEBUG nova.compute.manager [req-3f681b8b-4ae2-42fb-832b-850cc0d2b5e3 req-2fbed6fd-17e6-4be8-8290-3924c8ab8f11 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] No waiting events found dispatching network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:24:40 user nova-compute[73917]: WARNING nova.compute.manager [req-3f681b8b-4ae2-42fb-832b-850cc0d2b5e3 req-2fbed6fd-17e6-4be8-8290-3924c8ab8f11 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received unexpected event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 for instance with vm_state building and task_state spawning.
Aug 26 19:24:40 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:24:40 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:24:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:24:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:24:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:24:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:24:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:24:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:24:40 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:24:40 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077880.5127392, c94a0ea3-5230-453b-959c-5d7689c408a6 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:24:40 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] VM Started (Lifecycle Event)
Aug 26 19:24:40 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:24:40 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:24:40 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:24:40 user nova-compute[73917]: INFO nova.compute.manager [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Took 5.18 seconds to spawn the instance on the hypervisor.
Aug 26 19:24:40 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:24:40 user nova-compute[73917]: INFO nova.compute.manager [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Took 43.71 seconds to build instance.
Aug 26 19:24:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ab36b0b1-cb14-4bcd-b42d-bdf4d121db16 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.801s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:24:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ViNYTJHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:24:46 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:24:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:24:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:24:46 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:24:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:24:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:24:46 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:24:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:46 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab5c112-19bf-4992-9789-b042f6ed27f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:46 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:24:46 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bb49cf-d077-40d5-bfcf-018a37741e20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0] added
Aug 26 19:24:47 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ad3bff-5215-4184-a2c6-a2893e36a798]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d38023-d45a-4c1b-adc6-1744fb991032]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ViNYTJHL {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ViNYTJHL" returned: 0 in 0.036s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44c0375-a528-4b4c-96b7-556fb9ae5400]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ViNYTJHL'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84e9966-debb-4593-b2d6-7d4e53e56b08]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bdb6b1-4955-4eee-af4c-ca3e9f38efac]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:24:47 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:24:47 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:24:47 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:24:47 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:24:47 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:24:47 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31e9236-34e0-4117-8906-67ab121589d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0, portal: 172.16.0.220,3260]
Aug 26 19:24:47 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0, portal: 172.16.0.220,3260] successful.
Aug 26 19:24:47 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e9c700-bd63-490e-919c-ad5521341fa8]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c688b6-267b-4a32-b749-a60713c95479]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:24:47 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:24:47 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:24:47 user nova-compute[73917]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 (non-flash)
Aug 26 19:24:47 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:24:47 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:24:47 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:24:47 user nova-compute[73917]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 (non-flash)
Aug 26 19:24:47 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9de4277-e109-42d8-85ce-cbc49b98c9ab]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:24:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ViNYTJHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:24:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:24:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26534623964323966', 'path': '/dev/sdd'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:24:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534623964323966', 'path': '/dev/sdd'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:24:48 user nova-compute[73917]: DEBUG nova.objects.instance [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lazy-loading 'flavor' on Instance uuid c78c30ea-1190-44bc-bd78-b3655e251a35 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:24:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:24:48 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:24:48 user nova-compute[73917]:   <source dev="/dev/sdd"/>
Aug 26 19:24:48 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:24:48 user nova-compute[73917]:   <serial>d6dfd7c1-5106-41e9-9f05-9f29793234b0</serial>
Aug 26 19:24:48 user nova-compute[73917]: </disk>
Aug 26 19:24:48 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:24:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:24:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:24:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] No VIF found with MAC fa:16:3e:97:c2:28, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:24:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-11926747-0490-4909-8bc9-39c01bf5055b tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.843s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "c78c30ea-1190-44bc-bd78-b3655e251a35" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:24:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:24:50 user nova-compute[73917]: INFO nova.compute.manager [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Detaching volume d6dfd7c1-5106-41e9-9f05-9f29793234b0
Aug 26 19:24:50 user nova-compute[73917]: INFO nova.virt.block_device [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Attempting to driver detach volume d6dfd7c1-5106-41e9-9f05-9f29793234b0 from mountpoint /dev/vdb
Aug 26 19:24:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Attempting to detach device vdb from instance c78c30ea-1190-44bc-bd78-b3655e251a35 from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:24:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:24:50 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:24:50 user nova-compute[73917]:   <source dev="/dev/sdd"/>
Aug 26 19:24:50 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:24:50 user nova-compute[73917]:   <serial>d6dfd7c1-5106-41e9-9f05-9f29793234b0</serial>
Aug 26 19:24:50 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:24:50 user nova-compute[73917]: </disk>
Aug 26 19:24:50 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:24:50 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Successfully detached device vdb from instance c78c30ea-1190-44bc-bd78-b3655e251a35 from the persistent domain config.
Aug 26 19:24:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c78c30ea-1190-44bc-bd78-b3655e251a35 from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:24:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:24:50 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:24:50 user nova-compute[73917]:   <source dev="/dev/sdd"/>
Aug 26 19:24:50 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:24:50 user nova-compute[73917]:   <serial>d6dfd7c1-5106-41e9-9f05-9f29793234b0</serial>
Aug 26 19:24:50 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:24:50 user nova-compute[73917]: </disk>
Aug 26 19:24:50 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693077891.2827086, c78c30ea-1190-44bc-bd78-b3655e251a35 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c78c30ea-1190-44bc-bd78-b3655e251a35 {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:24:51 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Successfully detached device vdb from instance c78c30ea-1190-44bc-bd78-b3655e251a35 from the live domain config.
Aug 26 19:24:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ViNYTJHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:24:51 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:24:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8dc774-da96-4702-bd37-3eaed91e6993]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ad5655-f527-4843-b05c-a37aff166a24]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:24:51 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:24:51 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:24:51 user nova-compute[73917]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 (non-flash)
Aug 26 19:24:51 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:24:51 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:24:51 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:24:51 user nova-compute[73917]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 (non-flash)
Aug 26 19:24:51 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b785dea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0'): ({'sdd'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Removing single pathed devices sdd {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4194a967-0c0e-4c81-b743-8ac7de8fb465]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[835270b9-10a1-4381-9ac3-20c1a384239d]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Flushing IO for device /dev/sdd {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f997eca-b776-4bdf-8a65-21e06e773d12]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7298db-7117-43db-b347-306d831ecc4b]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] SCSI volumes sdd have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8210ca64-7b2c-4d19-ba8f-580664c95343]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dd999f-942c-42c2-9a3b-28269ca017aa]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0, portal: 172.16.0.220,3260]
Aug 26 19:24:51 user nova-compute[73917]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0, portal: 172.16.0.220,3260] successful.
Aug 26 19:24:51 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6dfd7c1-5106-41e9-9f05-9f29793234b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[00963a1e-90fe-41ac-bde9-0061764af31e]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] <== disconnect_volume: return (318ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:24:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:52 user nova-compute[73917]: DEBUG nova.objects.instance [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lazy-loading 'flavor' on Instance uuid c78c30ea-1190-44bc-bd78-b3655e251a35 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:24:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d457409d-0ddd-4c63-9a3e-bab22d23a906 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.770s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:24:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:24:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:00 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:25:00 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:25:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-94f8d4e7-f310-45df-a0ae-82e608ac0119" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:25:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-94f8d4e7-f310-45df-a0ae-82e608ac0119" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:25:00 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:25:00 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Updating instance_info_cache with network_info: [{"id": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "address": "fa:16:3e:45:49:40", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea31a0cf-61", "ovs_interfaceid": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:25:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-94f8d4e7-f310-45df-a0ae-82e608ac0119" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:25:00 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:25:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:03 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:25:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:04 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:25:04 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:25:04 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:25:05 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:25:06 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:25:06 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:25:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:08 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:25:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:08 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:25:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Acquiring lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Acquiring lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:09 user nova-compute[73917]: INFO nova.compute.manager [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Terminating instance
Aug 26 19:25:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:25:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG nova.compute.manager [req-7e1dbfe6-b0e4-41ba-9274-bac7b0093ec4 req-f90f6ccd-8f58-4090-8bda-fc541df899bc service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Received event network-vif-unplugged-3f214d19-c24c-45d9-8361-36c0d8a5692d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-7e1dbfe6-b0e4-41ba-9274-bac7b0093ec4 req-f90f6ccd-8f58-4090-8bda-fc541df899bc service nova] Acquiring lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-7e1dbfe6-b0e4-41ba-9274-bac7b0093ec4 req-f90f6ccd-8f58-4090-8bda-fc541df899bc service nova] Lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-7e1dbfe6-b0e4-41ba-9274-bac7b0093ec4 req-f90f6ccd-8f58-4090-8bda-fc541df899bc service nova] Lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG nova.compute.manager [req-7e1dbfe6-b0e4-41ba-9274-bac7b0093ec4 req-f90f6ccd-8f58-4090-8bda-fc541df899bc service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] No waiting events found dispatching network-vif-unplugged-3f214d19-c24c-45d9-8361-36c0d8a5692d {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG nova.compute.manager [req-7e1dbfe6-b0e4-41ba-9274-bac7b0093ec4 req-f90f6ccd-8f58-4090-8bda-fc541df899bc service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Received event network-vif-unplugged-3f214d19-c24c-45d9-8361-36c0d8a5692d for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:10 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Instance destroyed successfully.
Aug 26 19:25:10 user nova-compute[73917]: DEBUG nova.objects.instance [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lazy-loading 'resources' on Instance uuid 3e94cd92-2e56-4ad4-90d0-03a06c7437f0 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-414013389',display_name='tempest-VolumesActionsTest-instance-414013389',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-414013389',id=33,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:23:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd87078f3f3e47b687aacabf450e57c4',ramdisk_id='',reservation_id='r-9jeef7ct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1098860754',owner_user_name='tempest-VolumesActionsTest-1098860754-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:23:27Z,user_data=None,user_id='df632b88d11245bb9f3393d082e6527f',uuid=3e94cd92-2e56-4ad4-90d0-03a06c7437f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f214d19-c24c-45d9-8361-36c0d8a5692d", "address": "fa:16:3e:f3:e3:db", "network": {"id": "454de19a-252d-4f6b-95c4-5902bc4f0ba7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28701462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd87078f3f3e47b687aacabf450e57c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f214d19-c2", "ovs_interfaceid": "3f214d19-c24c-45d9-8361-36c0d8a5692d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Converting VIF {"id": "3f214d19-c24c-45d9-8361-36c0d8a5692d", "address": "fa:16:3e:f3:e3:db", "network": {"id": "454de19a-252d-4f6b-95c4-5902bc4f0ba7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28701462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd87078f3f3e47b687aacabf450e57c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f214d19-c2", "ovs_interfaceid": "3f214d19-c24c-45d9-8361-36c0d8a5692d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e3:db,bridge_name='br-int',has_traffic_filtering=True,id=3f214d19-c24c-45d9-8361-36c0d8a5692d,network=Network(454de19a-252d-4f6b-95c4-5902bc4f0ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f214d19-c2') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG os_vif [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e3:db,bridge_name='br-int',has_traffic_filtering=True,id=3f214d19-c24c-45d9-8361-36c0d8a5692d,network=Network(454de19a-252d-4f6b-95c4-5902bc4f0ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f214d19-c2') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f214d19-c2, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:25:10 user nova-compute[73917]: INFO os_vif [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e3:db,bridge_name='br-int',has_traffic_filtering=True,id=3f214d19-c24c-45d9-8361-36c0d8a5692d,network=Network(454de19a-252d-4f6b-95c4-5902bc4f0ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f214d19-c2')
Aug 26 19:25:10 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Deleting instance files /opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0_del
Aug 26 19:25:10 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Deletion of /opt/stack/data/nova/instances/3e94cd92-2e56-4ad4-90d0-03a06c7437f0_del complete
Aug 26 19:25:10 user nova-compute[73917]: INFO nova.compute.manager [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 26 19:25:10 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-a0fc78b8-cdda-4085-ab59-0f894c76a2f5 req-897adec9-d4fc-4790-bcff-6acc7199ac0b service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received event network-changed-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-a0fc78b8-cdda-4085-ab59-0f894c76a2f5 req-897adec9-d4fc-4790-bcff-6acc7199ac0b service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Refreshing instance network info cache due to event network-changed-1f0ca324-9d6c-4696-a525-76d4ccc1df91. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:25:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a0fc78b8-cdda-4085-ab59-0f894c76a2f5 req-897adec9-d4fc-4790-bcff-6acc7199ac0b service nova] Acquiring lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:25:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a0fc78b8-cdda-4085-ab59-0f894c76a2f5 req-897adec9-d4fc-4790-bcff-6acc7199ac0b service nova] Acquired lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:25:11 user nova-compute[73917]: DEBUG nova.network.neutron [req-a0fc78b8-cdda-4085-ab59-0f894c76a2f5 req-897adec9-d4fc-4790-bcff-6acc7199ac0b service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Refreshing network info cache for port 1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:25:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:11 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:25:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-eb9944da-4daf-4850-9b42-900abc2586d0 req-0854c30a-a110-4e29-bf7f-c1282ddb4aab service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Received event network-vif-deleted-3f214d19-c24c-45d9-8361-36c0d8a5692d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:11 user nova-compute[73917]: INFO nova.compute.manager [req-eb9944da-4daf-4850-9b42-900abc2586d0 req-0854c30a-a110-4e29-bf7f-c1282ddb4aab service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Neutron deleted interface 3f214d19-c24c-45d9-8361-36c0d8a5692d; detaching it from the instance and deleting it from the info cache
Aug 26 19:25:11 user nova-compute[73917]: DEBUG nova.network.neutron [req-eb9944da-4daf-4850-9b42-900abc2586d0 req-0854c30a-a110-4e29-bf7f-c1282ddb4aab service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:25:11 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Took 0.57 seconds to deallocate network for instance.
Aug 26 19:25:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-eb9944da-4daf-4850-9b42-900abc2586d0 req-0854c30a-a110-4e29-bf7f-c1282ddb4aab service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Detach interface failed, port_id=3f214d19-c24c-45d9-8361-36c0d8a5692d, reason: Instance 3e94cd92-2e56-4ad4-90d0-03a06c7437f0 could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:25:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG nova.compute.manager [req-1dc68fbc-b9be-48bc-8dd7-5731e22775d4 req-9e34df1a-9b0f-4fa1-9532-d3fc1df24f68 service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Received event network-vif-plugged-3f214d19-c24c-45d9-8361-36c0d8a5692d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1dc68fbc-b9be-48bc-8dd7-5731e22775d4 req-9e34df1a-9b0f-4fa1-9532-d3fc1df24f68 service nova] Acquiring lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1dc68fbc-b9be-48bc-8dd7-5731e22775d4 req-9e34df1a-9b0f-4fa1-9532-d3fc1df24f68 service nova] Lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1dc68fbc-b9be-48bc-8dd7-5731e22775d4 req-9e34df1a-9b0f-4fa1-9532-d3fc1df24f68 service nova] Lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG nova.compute.manager [req-1dc68fbc-b9be-48bc-8dd7-5731e22775d4 req-9e34df1a-9b0f-4fa1-9532-d3fc1df24f68 service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] No waiting events found dispatching network-vif-plugged-3f214d19-c24c-45d9-8361-36c0d8a5692d {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:25:12 user nova-compute[73917]: WARNING nova.compute.manager [req-1dc68fbc-b9be-48bc-8dd7-5731e22775d4 req-9e34df1a-9b0f-4fa1-9532-d3fc1df24f68 service nova] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Received unexpected event network-vif-plugged-3f214d19-c24c-45d9-8361-36c0d8a5692d for instance with vm_state deleted and task_state None.
Aug 26 19:25:12 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:25:12 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:25:12 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=7403MB free_disk=25.194564819335938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG nova.network.neutron [req-a0fc78b8-cdda-4085-ab59-0f894c76a2f5 req-897adec9-d4fc-4790-bcff-6acc7199ac0b service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Updated VIF entry in instance network info cache for port 1f0ca324-9d6c-4696-a525-76d4ccc1df91. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG nova.network.neutron [req-a0fc78b8-cdda-4085-ab59-0f894c76a2f5 req-897adec9-d4fc-4790-bcff-6acc7199ac0b service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Updating instance_info_cache with network_info: [{"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a0fc78b8-cdda-4085-ab59-0f894c76a2f5 req-897adec9-d4fc-4790-bcff-6acc7199ac0b service nova] Releasing lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.379s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:12 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Deleted allocations for instance 3e94cd92-2e56-4ad4-90d0-03a06c7437f0
Aug 26 19:25:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ef6ee478-e1aa-4672-9674-eb0d691199b5 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "3e94cd92-2e56-4ad4-90d0-03a06c7437f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.019s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 94f8d4e7-f310-45df-a0ae-82e608ac0119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance df5c717a-62d8-444d-9968-ad682a31733c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c78c30ea-1190-44bc-bd78-b3655e251a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 4a2d91a5-9943-43f6-b919-30510ccba727 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance a4487be3-7267-4ae1-8731-a6bdf49a6070 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance d30d366d-29cc-430b-ba31-bcbc08a364b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c94a0ea3-5230-453b-959c-5d7689c408a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 18682407-e406-4f49-a1a0-28eae64b121d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:25:12 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:25:13 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:25:13 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:25:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:25:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:14 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:25:14 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:25:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "d30d366d-29cc-430b-ba31-bcbc08a364b7" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:16 user nova-compute[73917]: INFO nova.compute.manager [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Shelving
Aug 26 19:25:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:17 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Instance destroyed successfully.
Aug 26 19:25:17 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Beginning cold snapshot process
Aug 26 19:25:17 user nova-compute[73917]: DEBUG nova.compute.manager [req-9ba50448-16f0-485c-8e8f-f8afaa66b0c6 req-da0f8a35-8217-41d4-adc2-b61ac6de23dc service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received event network-vif-unplugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9ba50448-16f0-485c-8e8f-f8afaa66b0c6 req-da0f8a35-8217-41d4-adc2-b61ac6de23dc service nova] Acquiring lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9ba50448-16f0-485c-8e8f-f8afaa66b0c6 req-da0f8a35-8217-41d4-adc2-b61ac6de23dc service nova] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9ba50448-16f0-485c-8e8f-f8afaa66b0c6 req-da0f8a35-8217-41d4-adc2-b61ac6de23dc service nova] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:17 user nova-compute[73917]: DEBUG nova.compute.manager [req-9ba50448-16f0-485c-8e8f-f8afaa66b0c6 req-da0f8a35-8217-41d4-adc2-b61ac6de23dc service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] No waiting events found dispatching network-vif-unplugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:25:17 user nova-compute[73917]: WARNING nova.compute.manager [req-9ba50448-16f0-485c-8e8f-f8afaa66b0c6 req-da0f8a35-8217-41d4-adc2-b61ac6de23dc service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received unexpected event network-vif-unplugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 19:25:17 user nova-compute[73917]: DEBUG nova.privsep.utils [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73917) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 19:25:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk /opt/stack/data/nova/instances/snapshots/tmpt755dcy4/4df8b7aff16e42f4ae683523f44c1013 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk /opt/stack/data/nova/instances/snapshots/tmpt755dcy4/4df8b7aff16e42f4ae683523f44c1013" returned: 0 in 0.690s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:18 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Snapshot extracted, beginning image upload
Aug 26 19:25:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:19 user nova-compute[73917]: DEBUG nova.compute.manager [req-3f360eb1-c67a-4c31-859c-967378edea01 req-75ec8fc7-3b51-463f-bf6d-2709ee24c2e6 service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received event network-vif-plugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3f360eb1-c67a-4c31-859c-967378edea01 req-75ec8fc7-3b51-463f-bf6d-2709ee24c2e6 service nova] Acquiring lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3f360eb1-c67a-4c31-859c-967378edea01 req-75ec8fc7-3b51-463f-bf6d-2709ee24c2e6 service nova] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3f360eb1-c67a-4c31-859c-967378edea01 req-75ec8fc7-3b51-463f-bf6d-2709ee24c2e6 service nova] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:19 user nova-compute[73917]: DEBUG nova.compute.manager [req-3f360eb1-c67a-4c31-859c-967378edea01 req-75ec8fc7-3b51-463f-bf6d-2709ee24c2e6 service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] No waiting events found dispatching network-vif-plugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:25:19 user nova-compute[73917]: WARNING nova.compute.manager [req-3f360eb1-c67a-4c31-859c-967378edea01 req-75ec8fc7-3b51-463f-bf6d-2709ee24c2e6 service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received unexpected event network-vif-plugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 19:25:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:20 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Snapshot image upload complete
Aug 26 19:25:20 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:25:21 user nova-compute[73917]: INFO nova.compute.manager [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Shelve offloading
Aug 26 19:25:21 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Instance destroyed successfully.
Aug 26 19:25:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:25:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:25:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquired lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:25:21 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:25:21 user nova-compute[73917]: DEBUG nova.network.neutron [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Updating instance_info_cache with network_info: [{"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:25:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Releasing lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:22 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Instance destroyed successfully.
Aug 26 19:25:22 user nova-compute[73917]: DEBUG nova.objects.instance [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'resources' on Instance uuid d30d366d-29cc-430b-ba31-bcbc08a364b7 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-964308989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-964308989',id=34,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5d2onuE0v30gwQ4jEufsRWsMY9TbeRWCKYhMnLNiMI80L3e0eEOgGqkVXeCPKdIjnmHflpdmV0MEYeorM+PucSxkA0rIt+i+3QFAvGXmJiVZo59qiKSMAVCLwSImOgXQ==',key_name='tempest-keypair-155698396',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:23:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='96cf0ccd59944be6922b561ecddc7d5b',ramdisk_id='',reservation_id='r-20m7bw3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1729132577',owner_user_name='tempest-AttachVolumeShelveTestJSON-1729132577-project-member',shelved_at='2023-08-26T19:25:20.952622',shelved_host='user',shelved_image_id='68171b46-0d90-4244-af73-99ab801934c7'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:25:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860f7b92664e43d19c908f3bdb52d717',uuid=d30d366d-29cc-430b-ba31-bcbc08a364b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converting VIF {"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:8a:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f0ca324-9d6c-4696-a525-76d4ccc1df91,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0ca324-9d') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG os_vif [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:8a:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f0ca324-9d6c-4696-a525-76d4ccc1df91,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0ca324-9d') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f0ca324-9d, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:25:22 user nova-compute[73917]: INFO os_vif [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:8a:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f0ca324-9d6c-4696-a525-76d4ccc1df91,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0ca324-9d')
Aug 26 19:25:22 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Deleting instance files /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7_del
Aug 26 19:25:22 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Deletion of /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7_del complete
Aug 26 19:25:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-e90fb5bc-2b24-47be-abfd-0d5e13d543c4 req-aa9bb4b1-d559-475a-9ad2-2b8f7efec6ac service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received event network-changed-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-e90fb5bc-2b24-47be-abfd-0d5e13d543c4 req-aa9bb4b1-d559-475a-9ad2-2b8f7efec6ac service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Refreshing instance network info cache due to event network-changed-1f0ca324-9d6c-4696-a525-76d4ccc1df91. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e90fb5bc-2b24-47be-abfd-0d5e13d543c4 req-aa9bb4b1-d559-475a-9ad2-2b8f7efec6ac service nova] Acquiring lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e90fb5bc-2b24-47be-abfd-0d5e13d543c4 req-aa9bb4b1-d559-475a-9ad2-2b8f7efec6ac service nova] Acquired lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG nova.network.neutron [req-e90fb5bc-2b24-47be-abfd-0d5e13d543c4 req-aa9bb4b1-d559-475a-9ad2-2b8f7efec6ac service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Refreshing network info cache for port 1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:25:22 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Deleted allocations for instance d30d366d-29cc-430b-ba31-bcbc08a364b7
Aug 26 19:25:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG nova.objects.instance [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'numa_topology' on Instance uuid d30d366d-29cc-430b-ba31-bcbc08a364b7 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG nova.objects.base [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Object Instance<d30d366d-29cc-430b-ba31-bcbc08a364b7> lazy-loaded attributes: resources,numa_topology {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG nova.network.neutron [req-e90fb5bc-2b24-47be-abfd-0d5e13d543c4 req-aa9bb4b1-d559-475a-9ad2-2b8f7efec6ac service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Updated VIF entry in instance network info cache for port 1f0ca324-9d6c-4696-a525-76d4ccc1df91. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG nova.network.neutron [req-e90fb5bc-2b24-47be-abfd-0d5e13d543c4 req-aa9bb4b1-d559-475a-9ad2-2b8f7efec6ac service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Updating instance_info_cache with network_info: [{"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e90fb5bc-2b24-47be-abfd-0d5e13d543c4 req-aa9bb4b1-d559-475a-9ad2-2b8f7efec6ac service nova] Releasing lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b262adcc-7cf7-42e4-92a5-ccbfe7a97ff6 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.929s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:25 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077910.4931614, 3e94cd92-2e56-4ad4-90d0-03a06c7437f0 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:25:25 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] VM Stopped (Lifecycle Event)
Aug 26 19:25:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9806f091-0d0f-414c-9cb6-cae7d7157c7b None None] [instance: 3e94cd92-2e56-4ad4-90d0-03a06c7437f0] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "4a2d91a5-9943-43f6-b919-30510ccba727" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "4a2d91a5-9943-43f6-b919-30510ccba727" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:26 user nova-compute[73917]: INFO nova.compute.manager [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Terminating instance
Aug 26 19:25:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-5aa732bd-bd9a-4b56-8b0a-ab90ddd08918 req-0e0034fe-25aa-4f11-9a6e-3ae4144969a0 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Received event network-vif-unplugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5aa732bd-bd9a-4b56-8b0a-ab90ddd08918 req-0e0034fe-25aa-4f11-9a6e-3ae4144969a0 service nova] Acquiring lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5aa732bd-bd9a-4b56-8b0a-ab90ddd08918 req-0e0034fe-25aa-4f11-9a6e-3ae4144969a0 service nova] Lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-5aa732bd-bd9a-4b56-8b0a-ab90ddd08918 req-0e0034fe-25aa-4f11-9a6e-3ae4144969a0 service nova] Lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-5aa732bd-bd9a-4b56-8b0a-ab90ddd08918 req-0e0034fe-25aa-4f11-9a6e-3ae4144969a0 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] No waiting events found dispatching network-vif-unplugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-5aa732bd-bd9a-4b56-8b0a-ab90ddd08918 req-0e0034fe-25aa-4f11-9a6e-3ae4144969a0 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Received event network-vif-unplugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:25:26 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Instance destroyed successfully.
Aug 26 19:25:26 user nova-compute[73917]: DEBUG nova.objects.instance [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lazy-loading 'resources' on Instance uuid 4a2d91a5-9943-43f6-b919-30510ccba727 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1428844380',display_name='tempest-ServerActionsTestOtherA-server-1428844380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1428844380',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoE8tZDc68JWUNde0nWnasqq1vYa5ON2YNQwHw+xO1EiolhKGRVVBiykxwLyvBezUmZpO4CsEARWWqkHIKpn0pTvCPDPPJIP+G7BbRXcHe4wp+29J3exWEnrrk3yPKzjg==',key_name='tempest-keypair-1254307896',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:21:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2e09fe7b38e4bb991bfaaf5b4ad357a',ramdisk_id='',reservation_id='r-4dv3wxu4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2069094918',owner_user_name='tempest-ServerActionsTestOtherA-2069094918-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:22:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd1b7d3fe22c4b239cf03235866e17d4',uuid=4a2d91a5-9943-43f6-b919-30510ccba727,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converting VIF {"id": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "address": "fa:16:3e:d9:5d:6b", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8c2f16-54", "ovs_interfaceid": "af8c2f16-54b2-4a39-b893-e95b3794b8b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=af8c2f16-54b2-4a39-b893-e95b3794b8b1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c2f16-54') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG os_vif [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=af8c2f16-54b2-4a39-b893-e95b3794b8b1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c2f16-54') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf8c2f16-54, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:25:26 user nova-compute[73917]: INFO os_vif [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:5d:6b,bridge_name='br-int',has_traffic_filtering=True,id=af8c2f16-54b2-4a39-b893-e95b3794b8b1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8c2f16-54')
Aug 26 19:25:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kBypRFGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:25:26 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:25:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[362bd740-0f4e-4937-b459-54fe2462cacb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efd16f0-083f-41d4-afa3-00d5dbd86f2c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:25:26 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:25:26 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:25:26 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:25:26 user nova-compute[73917]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a (non-flash)
Aug 26 19:25:26 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:25:26 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b987d8ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a'): ({'sde'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Removing single pathed devices sde {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[07488031-4289-4ea4-a381-0b5655c45690]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7882e675-9e23-4720-a792-9c6060dbc3e1]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Flushing IO for device /dev/sde {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b257a6b-d5a6-4e07-bab0-a01a43007dfc]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[43086d49-a92b-44c3-a9dc-0cd88892eef6]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] SCSI volumes sde have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3476dfc6-1796-4335-9372-f598cceaf497]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6e760e-99b0-4442-8a08-8d432f4365bb]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a, portal: 172.16.0.220,3260]
Aug 26 19:25:27 user nova-compute[73917]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a, portal: 172.16.0.220,3260] successful.
Aug 26 19:25:27 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c062201-81b9-42d1-8ae2-5b6fe648bc2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[288d6c06-5085-4bb6-aa2b-b795a20e26b5]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] <== disconnect_volume: return (325ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:25:27 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Deleting instance files /opt/stack/data/nova/instances/4a2d91a5-9943-43f6-b919-30510ccba727_del
Aug 26 19:25:27 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Deletion of /opt/stack/data/nova/instances/4a2d91a5-9943-43f6-b919-30510ccba727_del complete
Aug 26 19:25:27 user nova-compute[73917]: INFO nova.compute.manager [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 26 19:25:27 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:25:27 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:25:28 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:25:28 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Took 0.97 seconds to deallocate network for instance.
Aug 26 19:25:28 user nova-compute[73917]: DEBUG nova.compute.manager [req-19479018-ecce-4803-8397-16434cf4487e req-3c801b5f-2aa1-4f35-a670-ab6debaed288 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Received event network-vif-plugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-19479018-ecce-4803-8397-16434cf4487e req-3c801b5f-2aa1-4f35-a670-ab6debaed288 service nova] Acquiring lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-19479018-ecce-4803-8397-16434cf4487e req-3c801b5f-2aa1-4f35-a670-ab6debaed288 service nova] Lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-19479018-ecce-4803-8397-16434cf4487e req-3c801b5f-2aa1-4f35-a670-ab6debaed288 service nova] Lock "4a2d91a5-9943-43f6-b919-30510ccba727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:28 user nova-compute[73917]: DEBUG nova.compute.manager [req-19479018-ecce-4803-8397-16434cf4487e req-3c801b5f-2aa1-4f35-a670-ab6debaed288 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] No waiting events found dispatching network-vif-plugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:25:28 user nova-compute[73917]: WARNING nova.compute.manager [req-19479018-ecce-4803-8397-16434cf4487e req-3c801b5f-2aa1-4f35-a670-ab6debaed288 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Received unexpected event network-vif-plugged-af8c2f16-54b2-4a39-b893-e95b3794b8b1 for instance with vm_state active and task_state deleting.
Aug 26 19:25:28 user nova-compute[73917]: DEBUG nova.compute.manager [req-19479018-ecce-4803-8397-16434cf4487e req-3c801b5f-2aa1-4f35-a670-ab6debaed288 service nova] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Received event network-vif-deleted-af8c2f16-54b2-4a39-b893-e95b3794b8b1 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:29 user nova-compute[73917]: INFO nova.compute.manager [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Took 0.81 seconds to detach 1 volumes for instance.
Aug 26 19:25:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Deleting volume: 4c062201-81b9-42d1-8ae2-5b6fe648bc2a {{(pid=73917) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 19:25:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:29 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:25:29 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:25:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:29 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Deleted allocations for instance 4a2d91a5-9943-43f6-b919-30510ccba727
Aug 26 19:25:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-66c55898-5613-448f-b67f-9aa8f031bc93 tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "4a2d91a5-9943-43f6-b919-30510ccba727" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.724s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:32 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077917.4914324, d30d366d-29cc-430b-ba31-bcbc08a364b7 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:25:32 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] VM Stopped (Lifecycle Event)
Aug 26 19:25:32 user nova-compute[73917]: DEBUG nova.compute.manager [None req-3e1c80f2-bd31-488f-a526-69f4594fb803 None None] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:25:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "fbc66439-479c-4818-a416-c3c64d49741d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "fbc66439-479c-4818-a416-c3c64d49741d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:25:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:25:35 user nova-compute[73917]: INFO nova.compute.claims [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Claim successful on node user
Aug 26 19:25:35 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:25:35 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:25:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG nova.network.neutron [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:25:36 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:25:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG nova.policy [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22f87b69a0fb471f9ec5373b208d3abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e307e771e354caa99ff68b73b842743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:25:36 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Creating image(s)
Aug 26 19:25:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "/opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "/opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.196s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.174s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk 1073741824" returned: 0 in 0.055s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.198s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG nova.network.neutron [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Successfully created port: dcd0eceb-374a-46e1-92cd-5e5fcb947a75 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:25:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:37 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Cannot resize image /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:25:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:25:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Ensure instance console log exists: /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:25:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:37 user nova-compute[73917]: DEBUG nova.network.neutron [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Successfully updated port: dcd0eceb-374a-46e1-92cd-5e5fcb947a75 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:25:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "refresh_cache-fbc66439-479c-4818-a416-c3c64d49741d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:25:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquired lock "refresh_cache-fbc66439-479c-4818-a416-c3c64d49741d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:25:37 user nova-compute[73917]: DEBUG nova.network.neutron [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:25:37 user nova-compute[73917]: DEBUG nova.compute.manager [req-448a3439-5921-45d3-ab4b-a2e62d2dda36 req-a2e23025-ee0f-47f0-ae1b-cc4e290c8a59 service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Received event network-changed-dcd0eceb-374a-46e1-92cd-5e5fcb947a75 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:37 user nova-compute[73917]: DEBUG nova.compute.manager [req-448a3439-5921-45d3-ab4b-a2e62d2dda36 req-a2e23025-ee0f-47f0-ae1b-cc4e290c8a59 service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Refreshing instance network info cache due to event network-changed-dcd0eceb-374a-46e1-92cd-5e5fcb947a75. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:25:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-448a3439-5921-45d3-ab4b-a2e62d2dda36 req-a2e23025-ee0f-47f0-ae1b-cc4e290c8a59 service nova] Acquiring lock "refresh_cache-fbc66439-479c-4818-a416-c3c64d49741d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:25:37 user nova-compute[73917]: DEBUG nova.network.neutron [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.network.neutron [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Updating instance_info_cache with network_info: [{"id": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "address": "fa:16:3e:92:aa:c8", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd0eceb-37", "ovs_interfaceid": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Releasing lock "refresh_cache-fbc66439-479c-4818-a416-c3c64d49741d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.compute.manager [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Instance network_info: |[{"id": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "address": "fa:16:3e:92:aa:c8", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd0eceb-37", "ovs_interfaceid": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-448a3439-5921-45d3-ab4b-a2e62d2dda36 req-a2e23025-ee0f-47f0-ae1b-cc4e290c8a59 service nova] Acquired lock "refresh_cache-fbc66439-479c-4818-a416-c3c64d49741d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.network.neutron [req-448a3439-5921-45d3-ab4b-a2e62d2dda36 req-a2e23025-ee0f-47f0-ae1b-cc4e290c8a59 service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Refreshing network info cache for port dcd0eceb-374a-46e1-92cd-5e5fcb947a75 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Start _get_guest_xml network_info=[{"id": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "address": "fa:16:3e:92:aa:c8", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd0eceb-37", "ovs_interfaceid": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:25:38 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:25:38 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:25:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1123877833',display_name='tempest-TestStampPattern-server-1123877833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1123877833',id=37,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3qikrHaZv1b57+PYsAMrjbGE8666IZRULu8TbUkxpO21qNoIsGBqbZ/2lTZ8QJOtcHXsoQIRIproBK4xx57gBXc3m4j4E+STy5i75C4teNDHC5iYRzQB7oXEceIdSncQ==',key_name='tempest-TestStampPattern-235197864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e307e771e354caa99ff68b73b842743',ramdisk_id='',reservation_id='r-0lhmcms6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-432009003',owner_user_name='tempest-TestStampPattern-432009003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:25:36Z,user_data=None,user_id='22f87b69a0fb471f9ec5373b208d3abc',uuid=fbc66439-479c-4818-a416-c3c64d49741d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "address": "fa:16:3e:92:aa:c8", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd0eceb-37", "ovs_interfaceid": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Converting VIF {"id": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "address": "fa:16:3e:92:aa:c8", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd0eceb-37", "ovs_interfaceid": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:aa:c8,bridge_name='br-int',has_traffic_filtering=True,id=dcd0eceb-374a-46e1-92cd-5e5fcb947a75,network=Network(1cf7828d-2911-4253-bc82-d0fa6677f746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcd0eceb-37') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.objects.instance [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lazy-loading 'pci_devices' on Instance uuid fbc66439-479c-4818-a416-c3c64d49741d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:25:38 user nova-compute[73917]:   <uuid>fbc66439-479c-4818-a416-c3c64d49741d</uuid>
Aug 26 19:25:38 user nova-compute[73917]:   <name>instance-00000025</name>
Aug 26 19:25:38 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:25:38 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:25:38 user nova-compute[73917]:   <metadata>
Aug 26 19:25:38 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:25:38 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:25:38 user nova-compute[73917]:       <nova:name>tempest-TestStampPattern-server-1123877833</nova:name>
Aug 26 19:25:38 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:25:38</nova:creationTime>
Aug 26 19:25:38 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:25:38 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:25:38 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:25:38 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:25:38 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:25:38 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:25:38 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:25:38 user nova-compute[73917]:       <nova:owner>
Aug 26 19:25:38 user nova-compute[73917]:         <nova:user uuid="22f87b69a0fb471f9ec5373b208d3abc">tempest-TestStampPattern-432009003-project-member</nova:user>
Aug 26 19:25:38 user nova-compute[73917]:         <nova:project uuid="4e307e771e354caa99ff68b73b842743">tempest-TestStampPattern-432009003</nova:project>
Aug 26 19:25:38 user nova-compute[73917]:       </nova:owner>
Aug 26 19:25:38 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:25:38 user nova-compute[73917]:       <nova:ports>
Aug 26 19:25:38 user nova-compute[73917]:         <nova:port uuid="dcd0eceb-374a-46e1-92cd-5e5fcb947a75">
Aug 26 19:25:38 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 19:25:38 user nova-compute[73917]:         </nova:port>
Aug 26 19:25:38 user nova-compute[73917]:       </nova:ports>
Aug 26 19:25:38 user nova-compute[73917]:     </nova:instance>
Aug 26 19:25:38 user nova-compute[73917]:   </metadata>
Aug 26 19:25:38 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:25:38 user nova-compute[73917]:     <system>
Aug 26 19:25:38 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:25:38 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:25:38 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:25:38 user nova-compute[73917]:       <entry name="serial">fbc66439-479c-4818-a416-c3c64d49741d</entry>
Aug 26 19:25:38 user nova-compute[73917]:       <entry name="uuid">fbc66439-479c-4818-a416-c3c64d49741d</entry>
Aug 26 19:25:38 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:25:38 user nova-compute[73917]:     </system>
Aug 26 19:25:38 user nova-compute[73917]:   </sysinfo>
Aug 26 19:25:38 user nova-compute[73917]:   <os>
Aug 26 19:25:38 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:25:38 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:25:38 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:25:38 user nova-compute[73917]:   </os>
Aug 26 19:25:38 user nova-compute[73917]:   <features>
Aug 26 19:25:38 user nova-compute[73917]:     <acpi/>
Aug 26 19:25:38 user nova-compute[73917]:     <apic/>
Aug 26 19:25:38 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:25:38 user nova-compute[73917]:   </features>
Aug 26 19:25:38 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:25:38 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:25:38 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:25:38 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:25:38 user nova-compute[73917]:   </clock>
Aug 26 19:25:38 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:25:38 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:25:38 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:25:38 user nova-compute[73917]:   </cpu>
Aug 26 19:25:38 user nova-compute[73917]:   <devices>
Aug 26 19:25:38 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:25:38 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:25:38 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk"/>
Aug 26 19:25:38 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:25:38 user nova-compute[73917]:     </disk>
Aug 26 19:25:38 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:25:38 user nova-compute[73917]:       <mac address="fa:16:3e:92:aa:c8"/>
Aug 26 19:25:38 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:25:38 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:25:38 user nova-compute[73917]:       <target dev="tapdcd0eceb-37"/>
Aug 26 19:25:38 user nova-compute[73917]:     </interface>
Aug 26 19:25:38 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:25:38 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/console.log" append="off"/>
Aug 26 19:25:38 user nova-compute[73917]:     </serial>
Aug 26 19:25:38 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:25:38 user nova-compute[73917]:     <video>
Aug 26 19:25:38 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:25:38 user nova-compute[73917]:     </video>
Aug 26 19:25:38 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:25:38 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:25:38 user nova-compute[73917]:     </rng>
Aug 26 19:25:38 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:25:38 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:25:38 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:25:38 user nova-compute[73917]:     </memballoon>
Aug 26 19:25:38 user nova-compute[73917]:   </devices>
Aug 26 19:25:38 user nova-compute[73917]: </domain>
Aug 26 19:25:38 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:25:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1123877833',display_name='tempest-TestStampPattern-server-1123877833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1123877833',id=37,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3qikrHaZv1b57+PYsAMrjbGE8666IZRULu8TbUkxpO21qNoIsGBqbZ/2lTZ8QJOtcHXsoQIRIproBK4xx57gBXc3m4j4E+STy5i75C4teNDHC5iYRzQB7oXEceIdSncQ==',key_name='tempest-TestStampPattern-235197864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e307e771e354caa99ff68b73b842743',ramdisk_id='',reservation_id='r-0lhmcms6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-432009003',owner_user_name='tempest-TestStampPattern-432009003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:25:36Z,user_data=None,user_id='22f87b69a0fb471f9ec5373b208d3abc',uuid=fbc66439-479c-4818-a416-c3c64d49741d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "address": "fa:16:3e:92:aa:c8", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd0eceb-37", "ovs_interfaceid": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Converting VIF {"id": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "address": "fa:16:3e:92:aa:c8", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd0eceb-37", "ovs_interfaceid": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:aa:c8,bridge_name='br-int',has_traffic_filtering=True,id=dcd0eceb-374a-46e1-92cd-5e5fcb947a75,network=Network(1cf7828d-2911-4253-bc82-d0fa6677f746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcd0eceb-37') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG os_vif [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:aa:c8,bridge_name='br-int',has_traffic_filtering=True,id=dcd0eceb-374a-46e1-92cd-5e5fcb947a75,network=Network(1cf7828d-2911-4253-bc82-d0fa6677f746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcd0eceb-37') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcd0eceb-37, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdcd0eceb-37, col_values=(('external_ids', {'iface-id': 'dcd0eceb-374a-46e1-92cd-5e5fcb947a75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:aa:c8', 'vm-uuid': 'fbc66439-479c-4818-a416-c3c64d49741d'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:38 user nova-compute[73917]: INFO os_vif [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:aa:c8,bridge_name='br-int',has_traffic_filtering=True,id=dcd0eceb-374a-46e1-92cd-5e5fcb947a75,network=Network(1cf7828d-2911-4253-bc82-d0fa6677f746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcd0eceb-37')
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] No VIF found with MAC fa:16:3e:92:aa:c8, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.network.neutron [req-448a3439-5921-45d3-ab4b-a2e62d2dda36 req-a2e23025-ee0f-47f0-ae1b-cc4e290c8a59 service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Updated VIF entry in instance network info cache for port dcd0eceb-374a-46e1-92cd-5e5fcb947a75. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG nova.network.neutron [req-448a3439-5921-45d3-ab4b-a2e62d2dda36 req-a2e23025-ee0f-47f0-ae1b-cc4e290c8a59 service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Updating instance_info_cache with network_info: [{"id": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "address": "fa:16:3e:92:aa:c8", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd0eceb-37", "ovs_interfaceid": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-448a3439-5921-45d3-ab4b-a2e62d2dda36 req-a2e23025-ee0f-47f0-ae1b-cc4e290c8a59 service nova] Releasing lock "refresh_cache-fbc66439-479c-4818-a416-c3c64d49741d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:25:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:40 user nova-compute[73917]: DEBUG nova.compute.manager [req-b39fce93-c2cd-4d1c-b9b4-46df42bb9d50 req-02f0c73b-884b-4504-9912-0942af43d06f service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Received event network-vif-plugged-dcd0eceb-374a-46e1-92cd-5e5fcb947a75 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b39fce93-c2cd-4d1c-b9b4-46df42bb9d50 req-02f0c73b-884b-4504-9912-0942af43d06f service nova] Acquiring lock "fbc66439-479c-4818-a416-c3c64d49741d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b39fce93-c2cd-4d1c-b9b4-46df42bb9d50 req-02f0c73b-884b-4504-9912-0942af43d06f service nova] Lock "fbc66439-479c-4818-a416-c3c64d49741d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b39fce93-c2cd-4d1c-b9b4-46df42bb9d50 req-02f0c73b-884b-4504-9912-0942af43d06f service nova] Lock "fbc66439-479c-4818-a416-c3c64d49741d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:40 user nova-compute[73917]: DEBUG nova.compute.manager [req-b39fce93-c2cd-4d1c-b9b4-46df42bb9d50 req-02f0c73b-884b-4504-9912-0942af43d06f service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] No waiting events found dispatching network-vif-plugged-dcd0eceb-374a-46e1-92cd-5e5fcb947a75 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:25:40 user nova-compute[73917]: WARNING nova.compute.manager [req-b39fce93-c2cd-4d1c-b9b4-46df42bb9d50 req-02f0c73b-884b-4504-9912-0942af43d06f service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Received unexpected event network-vif-plugged-dcd0eceb-374a-46e1-92cd-5e5fcb947a75 for instance with vm_state building and task_state spawning.
Aug 26 19:25:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:41 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077926.8168888, 4a2d91a5-9943-43f6-b919-30510ccba727 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:25:41 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] VM Stopped (Lifecycle Event)
Aug 26 19:25:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f849695f-4e3b-4b0f-bc8e-5dcf5f89e1e4 None None] [instance: 4a2d91a5-9943-43f6-b919-30510ccba727] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:25:41 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077941.8673751, fbc66439-479c-4818-a416-c3c64d49741d => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:25:41 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fbc66439-479c-4818-a416-c3c64d49741d] VM Resumed (Lifecycle Event)
Aug 26 19:25:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:25:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:25:41 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Instance spawned successfully.
Aug 26 19:25:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:25:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:25:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:25:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:25:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:25:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:25:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:25:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:25:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:25:41 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fbc66439-479c-4818-a416-c3c64d49741d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:25:41 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077941.8694477, fbc66439-479c-4818-a416-c3c64d49741d => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:25:41 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fbc66439-479c-4818-a416-c3c64d49741d] VM Started (Lifecycle Event)
Aug 26 19:25:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:25:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:25:41 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: fbc66439-479c-4818-a416-c3c64d49741d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:25:41 user nova-compute[73917]: INFO nova.compute.manager [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Took 5.83 seconds to spawn the instance on the hypervisor.
Aug 26 19:25:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:25:42 user nova-compute[73917]: DEBUG nova.compute.manager [req-b41f378f-19bb-40a9-90f6-03eee4931a1d req-33cafcf9-60cd-4853-9a41-4bd9f30aad7e service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Received event network-vif-plugged-dcd0eceb-374a-46e1-92cd-5e5fcb947a75 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b41f378f-19bb-40a9-90f6-03eee4931a1d req-33cafcf9-60cd-4853-9a41-4bd9f30aad7e service nova] Acquiring lock "fbc66439-479c-4818-a416-c3c64d49741d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b41f378f-19bb-40a9-90f6-03eee4931a1d req-33cafcf9-60cd-4853-9a41-4bd9f30aad7e service nova] Lock "fbc66439-479c-4818-a416-c3c64d49741d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b41f378f-19bb-40a9-90f6-03eee4931a1d req-33cafcf9-60cd-4853-9a41-4bd9f30aad7e service nova] Lock "fbc66439-479c-4818-a416-c3c64d49741d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:42 user nova-compute[73917]: DEBUG nova.compute.manager [req-b41f378f-19bb-40a9-90f6-03eee4931a1d req-33cafcf9-60cd-4853-9a41-4bd9f30aad7e service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] No waiting events found dispatching network-vif-plugged-dcd0eceb-374a-46e1-92cd-5e5fcb947a75 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:25:42 user nova-compute[73917]: WARNING nova.compute.manager [req-b41f378f-19bb-40a9-90f6-03eee4931a1d req-33cafcf9-60cd-4853-9a41-4bd9f30aad7e service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Received unexpected event network-vif-plugged-dcd0eceb-374a-46e1-92cd-5e5fcb947a75 for instance with vm_state building and task_state spawning.
Aug 26 19:25:42 user nova-compute[73917]: INFO nova.compute.manager [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Took 6.53 seconds to build instance.
Aug 26 19:25:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-346e10da-37ae-49a2-abfa-3edb8b583a34 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "fbc66439-479c-4818-a416-c3c64d49741d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.621s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:47 user nova-compute[73917]: INFO nova.compute.manager [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Rescuing
Aug 26 19:25:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "refresh_cache-c94a0ea3-5230-453b-959c-5d7689c408a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:25:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquired lock "refresh_cache-c94a0ea3-5230-453b-959c-5d7689c408a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:25:47 user nova-compute[73917]: DEBUG nova.network.neutron [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:25:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:48 user nova-compute[73917]: DEBUG nova.network.neutron [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Updating instance_info_cache with network_info: [{"id": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "address": "fa:16:3e:49:6c:5b", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d7c95e-7f", "ovs_interfaceid": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:25:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Releasing lock "refresh_cache-c94a0ea3-5230-453b-959c-5d7689c408a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:25:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:49 user nova-compute[73917]: DEBUG nova.compute.manager [req-a93fd31c-03c0-43f4-a8f7-2075e14b9796 req-0ac266eb-d8fb-4a7b-bdf7-308fe692a59d service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received event network-vif-unplugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a93fd31c-03c0-43f4-a8f7-2075e14b9796 req-0ac266eb-d8fb-4a7b-bdf7-308fe692a59d service nova] Acquiring lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a93fd31c-03c0-43f4-a8f7-2075e14b9796 req-0ac266eb-d8fb-4a7b-bdf7-308fe692a59d service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a93fd31c-03c0-43f4-a8f7-2075e14b9796 req-0ac266eb-d8fb-4a7b-bdf7-308fe692a59d service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:49 user nova-compute[73917]: DEBUG nova.compute.manager [req-a93fd31c-03c0-43f4-a8f7-2075e14b9796 req-0ac266eb-d8fb-4a7b-bdf7-308fe692a59d service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] No waiting events found dispatching network-vif-unplugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:25:49 user nova-compute[73917]: WARNING nova.compute.manager [req-a93fd31c-03c0-43f4-a8f7-2075e14b9796 req-0ac266eb-d8fb-4a7b-bdf7-308fe692a59d service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received unexpected event network-vif-unplugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 for instance with vm_state active and task_state rescuing.
Aug 26 19:25:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:49 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Instance destroyed successfully.
Aug 26 19:25:49 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Attempting a stable device rescue
Aug 26 19:25:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73917) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 19:25:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Instance directory exists: not creating {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 19:25:49 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Creating image(s)
Aug 26 19:25:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "/opt/stack/data/nova/instances/c94a0ea3-5230-453b-959c-5d7689c408a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "/opt/stack/data/nova/instances/c94a0ea3-5230-453b-959c-5d7689c408a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "/opt/stack/data/nova/instances/c94a0ea3-5230-453b-959c-5d7689c408a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:49 user nova-compute[73917]: DEBUG nova.objects.instance [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'trusted_certs' on Instance uuid c94a0ea3-5230-453b-959c-5d7689c408a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:25:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "695c3c85c9dab820408047df6ace8ae5eea18e2b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "695c3c85c9dab820408047df6ace8ae5eea18e2b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/695c3c85c9dab820408047df6ace8ae5eea18e2b.part --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/695c3c85c9dab820408047df6ace8ae5eea18e2b.part --force-share --output=json" returned: 0 in 0.195s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:50 user nova-compute[73917]: DEBUG nova.virt.images [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] 56a44a57-ba05-491a-b104-8db192c4427c was qcow2, converting to raw {{(pid=73917) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 19:25:50 user nova-compute[73917]: DEBUG nova.privsep.utils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73917) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 19:25:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/695c3c85c9dab820408047df6ace8ae5eea18e2b.part /opt/stack/data/nova/instances/_base/695c3c85c9dab820408047df6ace8ae5eea18e2b.converted {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/695c3c85c9dab820408047df6ace8ae5eea18e2b.part /opt/stack/data/nova/instances/_base/695c3c85c9dab820408047df6ace8ae5eea18e2b.converted" returned: 0 in 0.336s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/695c3c85c9dab820408047df6ace8ae5eea18e2b.converted --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] Acquiring lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] No waiting events found dispatching network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:25:51 user nova-compute[73917]: WARNING nova.compute.manager [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received unexpected event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 for instance with vm_state active and task_state rescuing.
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] Acquiring lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] No waiting events found dispatching network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:25:51 user nova-compute[73917]: WARNING nova.compute.manager [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received unexpected event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 for instance with vm_state active and task_state rescuing.
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] Acquiring lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] No waiting events found dispatching network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:25:51 user nova-compute[73917]: WARNING nova.compute.manager [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received unexpected event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 for instance with vm_state active and task_state rescuing.
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received event network-vif-unplugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] Acquiring lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] No waiting events found dispatching network-vif-unplugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:25:51 user nova-compute[73917]: WARNING nova.compute.manager [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received unexpected event network-vif-unplugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 for instance with vm_state active and task_state rescuing.
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] Acquiring lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] No waiting events found dispatching network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:25:51 user nova-compute[73917]: WARNING nova.compute.manager [req-1b7aa8d9-36a6-4aa6-b9c1-2205506e92cc req-612c2140-3549-40a3-a05a-010a1e96fb1e service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received unexpected event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 for instance with vm_state active and task_state rescuing.
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/695c3c85c9dab820408047df6ace8ae5eea18e2b.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "695c3c85c9dab820408047df6ace8ae5eea18e2b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.975s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "695c3c85c9dab820408047df6ace8ae5eea18e2b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "695c3c85c9dab820408047df6ace8ae5eea18e2b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/695c3c85c9dab820408047df6ace8ae5eea18e2b --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/695c3c85c9dab820408047df6ace8ae5eea18e2b --force-share --output=json" returned: 0 in 0.190s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/695c3c85c9dab820408047df6ace8ae5eea18e2b,backing_fmt=raw /opt/stack/data/nova/instances/c94a0ea3-5230-453b-959c-5d7689c408a6/disk.rescue {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/695c3c85c9dab820408047df6ace8ae5eea18e2b,backing_fmt=raw /opt/stack/data/nova/instances/c94a0ea3-5230-453b-959c-5d7689c408a6/disk.rescue" returned: 0 in 0.048s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "695c3c85c9dab820408047df6ace8ae5eea18e2b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.objects.instance [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'migration_context' on Instance uuid c94a0ea3-5230-453b-959c-5d7689c408a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.objects.base [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Object Instance<c94a0ea3-5230-453b-959c-5d7689c408a6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Start _get_guest_xml network_info=[{"id": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "address": "fa:16:3e:49:6c:5b", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "vif_mac": "fa:16:3e:49:6c:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d7c95e-7f", "ovs_interfaceid": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '56a44a57-ba05-491a-b104-8db192c4427c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkAzYZFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'c94a0ea3-5230-453b-959c-5d7689c408a6', 'attached_at': '', 'detached_at': '', 'volume_id': '66bbdc9d-8da4-4b8b-bce8-71881d15aff1', 'serial': '66bbdc9d-8da4-4b8b-bce8-71881d15aff1'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '251aa156-502f-4d9a-8aa1-c8b835931e77', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.objects.instance [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'resources' on Instance uuid c94a0ea3-5230-453b-959c-5d7689c408a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.objects.base [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Object Instance<c94a0ea3-5230-453b-959c-5d7689c408a6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.objects.instance [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'numa_topology' on Instance uuid c94a0ea3-5230-453b-959c-5d7689c408a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.objects.base [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Object Instance<c94a0ea3-5230-453b-959c-5d7689c408a6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:25:51 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:25:51 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.objects.instance [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'vcpu_model' on Instance uuid c94a0ea3-5230-453b-959c-5d7689c408a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.objects.base [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Object Instance<c94a0ea3-5230-453b-959c-5d7689c408a6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkAzYZFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:25:51 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:25:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:25:51 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:25:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:25:51 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a7c906-a0c8-4a87-bbfb-a16ae179370c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = hkAzYZFg\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 19:25:51 user nova-compute[73917]: node.name = iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1
Aug 26 19:25:51 user nova-compute[73917]: node.tpgt = -1
Aug 26 19:25:51 user nova-compute[73917]: node.startup = automatic
Aug 26 19:25:51 user nova-compute[73917]: node.leading_login = No
Aug 26 19:25:51 user nova-compute[73917]: iface.iscsi_ifacename = default
Aug 26 19:25:51 user nova-compute[73917]: iface.net_ifacename = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.ipaddress = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.prefix_len = 0
Aug 26 19:25:51 user nova-compute[73917]: iface.hwaddress = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.transport_name = tcp
Aug 26 19:25:51 user nova-compute[73917]: iface.initiatorname = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.state = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.vlan_id = 0
Aug 26 19:25:51 user nova-compute[73917]: iface.vlan_priority = 0
Aug 26 19:25:51 user nova-compute[73917]: iface.vlan_state = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.iface_num = 0
Aug 26 19:25:51 user nova-compute[73917]: iface.mtu = 0
Aug 26 19:25:51 user nova-compute[73917]: iface.port = 0
Aug 26 19:25:51 user nova-compute[73917]: iface.bootproto = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.subnet_mask = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.gateway = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.dhcp_alt_client_id = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.dhcp_dns = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.dhcp_learn_iqn = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.dhcp_vendor_id_state = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.dhcp_vendor_id = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.dhcp_slp_da = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.fragmentation = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.gratuitous_arp = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.incoming_forwarding = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.tos_state = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.tos = 0
Aug 26 19:25:51 user nova-compute[73917]: iface.ttl = 0
Aug 26 19:25:51 user nova-compute[73917]: iface.delayed_ack = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.tcp_nagle = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.tcp_wsf_state = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.tcp_wsf = 0
Aug 26 19:25:51 user nova-compute[73917]: iface.tcp_timer_scale = 0
Aug 26 19:25:51 user nova-compute[73917]: iface.tcp_timestamp = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.redirect = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.def_task_mgmt_timeout = 0
Aug 26 19:25:51 user nova-compute[73917]: iface.header_digest = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.data_digest = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.immediate_data = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.initial_r2t = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.data_seq_inorder = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.data_pdu_inorder = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.erl = 0
Aug 26 19:25:51 user nova-compute[73917]: iface.max_receive_data_len = 0
Aug 26 19:25:51 user nova-compute[73917]: iface.first_burst_len = 0
Aug 26 19:25:51 user nova-compute[73917]: iface.max_outstanding_r2t = 0
Aug 26 19:25:51 user nova-compute[73917]: iface.max_burst_len = 0
Aug 26 19:25:51 user nova-compute[73917]: iface.chap_auth = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.bidi_chap = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.strict_login_compliance = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.discovery_auth = <empty>
Aug 26 19:25:51 user nova-compute[73917]: iface.discovery_logout = <empty>
Aug 26 19:25:51 user nova-compute[73917]: node.discovery_address = <empty>
Aug 26 19:25:51 user nova-compute[73917]: node.discovery_port = 0
Aug 26 19:25:51 user nova-compute[73917]: node.discovery_type = static
Aug 26 19:25:51 user nova-compute[73917]: node.session.initial_cmdsn = 0
Aug 26 19:25:51 user nova-compute[73917]: node.session.initial_login_retry_max = 8
Aug 26 19:25:51 user nova-compute[73917]: node.session.xmit_thread_priority = -20
Aug 26 19:25:51 user nova-compute[73917]: node.session.cmds_max = 128
Aug 26 19:25:51 user nova-compute[73917]: node.session.queue_depth = 32
Aug 26 19:25:51 user nova-compute[73917]: node.session.nr_sessions = 1
Aug 26 19:25:51 user nova-compute[73917]: node.session.auth.authmethod = CHAP
Aug 26 19:25:51 user nova-compute[73917]: node.session.auth.username = hkAzYZFg
Aug 26 19:25:51 user nova-compute[73917]: node.session.auth.password = ***
Aug 26 19:25:51 user nova-compute[73917]: node.session.auth.username_in = <empty>
Aug 26 19:25:51 user nova-compute[73917]: node.session.auth.password_in = <empty>
Aug 26 19:25:51 user nova-compute[73917]: node.session.auth.chap_algs = MD5
Aug 26 19:25:51 user nova-compute[73917]: node.session.timeo.replacement_timeout = 120
Aug 26 19:25:51 user nova-compute[73917]: node.session.err_timeo.abort_timeout = 15
Aug 26 19:25:51 user nova-compute[73917]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 19:25:51 user nova-compute[73917]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 19:25:51 user nova-compute[73917]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 19:25:51 user nova-compute[73917]: node.session.iscsi.FastAbort = Yes
Aug 26 19:25:51 user nova-compute[73917]: node.session.iscsi.InitialR2T = No
Aug 26 19:25:51 user nova-compute[73917]: node.session.iscsi.ImmediateData = Yes
Aug 26 19:25:51 user nova-compute[73917]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 19:25:51 user nova-compute[73917]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 19:25:51 user nova-compute[73917]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 19:25:51 user nova-compute[73917]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 19:25:51 user nova-compute[73917]: node.session.iscsi.MaxConnections = 1
Aug 26 19:25:51 user nova-compute[73917]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 19:25:51 user nova-compute[73917]: node.session.iscsi.ERL = 0
Aug 26 19:25:51 user nova-compute[73917]: node.session.scan = manual
Aug 26 19:25:51 user nova-compute[73917]: node.session.reopen_max = 0
Aug 26 19:25:51 user nova-compute[73917]: node.conn[0].address = 172.16.0.220
Aug 26 19:25:51 user nova-compute[73917]: node.conn[0].port = 3260
Aug 26 19:25:51 user nova-compute[73917]: node.conn[0].startup = manual
Aug 26 19:25:51 user nova-compute[73917]: node.conn[0].tcp.window_size = 524288
Aug 26 19:25:51 user nova-compute[73917]: node.conn[0].tcp.type_of_service = 0
Aug 26 19:25:51 user nova-compute[73917]: node.conn[0].timeo.logout_timeout = 15
Aug 26 19:25:51 user nova-compute[73917]: node.conn[0].timeo.login_timeout = 15
Aug 26 19:25:51 user nova-compute[73917]: node.conn[0].timeo.auth_timeout = 45
Aug 26 19:25:51 user nova-compute[73917]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 19:25:51 user nova-compute[73917]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 19:25:51 user nova-compute[73917]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 19:25:51 user nova-compute[73917]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 19:25:51 user nova-compute[73917]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 19:25:51 user nova-compute[73917]: node.conn[0].iscsi.DataDigest = None
Aug 26 19:25:51 user nova-compute[73917]: node.conn[0].iscsi.IFMarker = No
Aug 26 19:25:51 user nova-compute[73917]: node.conn[0].iscsi.OFMarker = No
Aug 26 19:25:51 user nova-compute[73917]: # END RECORD
Aug 26 19:25:51 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a584e80-c40f-4e72-aa9b-db907714d202]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa0fd16-c459-42bd-b7a6-d2dc902f6f22]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hkAzYZFg {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hkAzYZFg" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50620e7-11b9-4078-bb00-fa227c9d4d47]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hkAzYZFg'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3820d070-a1a6-4035-bec2-f9fd147585ab]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0543da5-19d2-4e3b-81de-e21e94529daf]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:25:51 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:25:51 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:25:51 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:25:51 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.130s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] HCTL ('34', '0', '0', 0) found on session 40 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[010d0443-9260-4fe5-85ca-8e1e99a0a966]: (4, ('0 0 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Searching for a device in session 40 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkAzYZFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.153s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] <== connect_volume: return (155ms) {'type': 'block', 'scsi_wwn': '26561316662316664', 'path': '/dev/sdc'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561316662316664', 'path': '/dev/sdc'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:23:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-111348542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-111348542',id=35,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:24:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68229e3ed72a45fa8c2c9a33780479ce',ramdisk_id='',reservation_id='r-3pi0cwrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:24:41Z,user_data=None,user_id='e056c4ed5a18427a8fd1eaa6a3a795c0',uuid=c94a0ea3-5230-453b-959c-5d7689c408a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "address": "fa:16:3e:49:6c:5b", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "vif_mac": "fa:16:3e:49:6c:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d7c95e-7f", "ovs_interfaceid": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converting VIF {"id": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "address": "fa:16:3e:49:6c:5b", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "vif_mac": "fa:16:3e:49:6c:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d7c95e-7f", "ovs_interfaceid": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:6c:5b,bridge_name='br-int',has_traffic_filtering=True,id=07d7c95e-7fc7-4390-9b2d-000e93a3c889,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d7c95e-7f') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.objects.instance [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'pci_devices' on Instance uuid c94a0ea3-5230-453b-959c-5d7689c408a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.objects.base [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Object Instance<c94a0ea3-5230-453b-959c-5d7689c408a6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:25:51 user nova-compute[73917]:   <uuid>c94a0ea3-5230-453b-959c-5d7689c408a6</uuid>
Aug 26 19:25:51 user nova-compute[73917]:   <name>instance-00000023</name>
Aug 26 19:25:51 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:25:51 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:25:51 user nova-compute[73917]:   <metadata>
Aug 26 19:25:51 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:25:51 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:25:51 user nova-compute[73917]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-111348542</nova:name>
Aug 26 19:25:51 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:25:51</nova:creationTime>
Aug 26 19:25:51 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:25:51 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:25:51 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:25:51 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:25:51 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:25:51 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:25:51 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:25:51 user nova-compute[73917]:       <nova:owner>
Aug 26 19:25:51 user nova-compute[73917]:         <nova:user uuid="e056c4ed5a18427a8fd1eaa6a3a795c0">tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member</nova:user>
Aug 26 19:25:51 user nova-compute[73917]:         <nova:project uuid="68229e3ed72a45fa8c2c9a33780479ce">tempest-ServerBootFromVolumeStableRescueTest-1067875450</nova:project>
Aug 26 19:25:51 user nova-compute[73917]:       </nova:owner>
Aug 26 19:25:51 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:25:51 user nova-compute[73917]:       <nova:ports>
Aug 26 19:25:51 user nova-compute[73917]:         <nova:port uuid="07d7c95e-7fc7-4390-9b2d-000e93a3c889">
Aug 26 19:25:51 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 19:25:51 user nova-compute[73917]:         </nova:port>
Aug 26 19:25:51 user nova-compute[73917]:       </nova:ports>
Aug 26 19:25:51 user nova-compute[73917]:     </nova:instance>
Aug 26 19:25:51 user nova-compute[73917]:   </metadata>
Aug 26 19:25:51 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:25:51 user nova-compute[73917]:     <system>
Aug 26 19:25:51 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:25:51 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:25:51 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:25:51 user nova-compute[73917]:       <entry name="serial">c94a0ea3-5230-453b-959c-5d7689c408a6</entry>
Aug 26 19:25:51 user nova-compute[73917]:       <entry name="uuid">c94a0ea3-5230-453b-959c-5d7689c408a6</entry>
Aug 26 19:25:51 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:25:51 user nova-compute[73917]:     </system>
Aug 26 19:25:51 user nova-compute[73917]:   </sysinfo>
Aug 26 19:25:51 user nova-compute[73917]:   <os>
Aug 26 19:25:51 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:25:51 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:25:51 user nova-compute[73917]:   </os>
Aug 26 19:25:51 user nova-compute[73917]:   <features>
Aug 26 19:25:51 user nova-compute[73917]:     <acpi/>
Aug 26 19:25:51 user nova-compute[73917]:     <apic/>
Aug 26 19:25:51 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:25:51 user nova-compute[73917]:   </features>
Aug 26 19:25:51 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:25:51 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:25:51 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:25:51 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:25:51 user nova-compute[73917]:   </clock>
Aug 26 19:25:51 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:25:51 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:25:51 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:25:51 user nova-compute[73917]:   </cpu>
Aug 26 19:25:51 user nova-compute[73917]:   <devices>
Aug 26 19:25:51 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:25:51 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:25:51 user nova-compute[73917]:       <source dev="/dev/sdc"/>
Aug 26 19:25:51 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:25:51 user nova-compute[73917]:       <serial>66bbdc9d-8da4-4b8b-bce8-71881d15aff1</serial>
Aug 26 19:25:51 user nova-compute[73917]:     </disk>
Aug 26 19:25:51 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:25:51 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:25:51 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/c94a0ea3-5230-453b-959c-5d7689c408a6/disk.rescue"/>
Aug 26 19:25:51 user nova-compute[73917]:       <target dev="vdb" bus="virtio"/>
Aug 26 19:25:51 user nova-compute[73917]:       <boot order="1"/>
Aug 26 19:25:51 user nova-compute[73917]:     </disk>
Aug 26 19:25:51 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:25:51 user nova-compute[73917]:       <mac address="fa:16:3e:49:6c:5b"/>
Aug 26 19:25:51 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:25:51 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:25:51 user nova-compute[73917]:       <target dev="tap07d7c95e-7f"/>
Aug 26 19:25:51 user nova-compute[73917]:     </interface>
Aug 26 19:25:51 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:25:51 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/c94a0ea3-5230-453b-959c-5d7689c408a6/console.log" append="off"/>
Aug 26 19:25:51 user nova-compute[73917]:     </serial>
Aug 26 19:25:51 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:25:51 user nova-compute[73917]:     <video>
Aug 26 19:25:51 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:25:51 user nova-compute[73917]:     </video>
Aug 26 19:25:51 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:25:51 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:25:51 user nova-compute[73917]:     </rng>
Aug 26 19:25:51 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:25:51 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:25:51 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:25:51 user nova-compute[73917]:     </memballoon>
Aug 26 19:25:51 user nova-compute[73917]:   </devices>
Aug 26 19:25:51 user nova-compute[73917]: </domain>
Aug 26 19:25:51 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:25:51 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Instance destroyed successfully.
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:25:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] No VIF found with MAC fa:16:3e:49:6c:5b, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:25:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-cde04db3-6c16-4c52-9030-e84feb2aab39 req-cff438b3-b808-4479-8789-48265c0a0c73 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cde04db3-6c16-4c52-9030-e84feb2aab39 req-cff438b3-b808-4479-8789-48265c0a0c73 service nova] Acquiring lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cde04db3-6c16-4c52-9030-e84feb2aab39 req-cff438b3-b808-4479-8789-48265c0a0c73 service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cde04db3-6c16-4c52-9030-e84feb2aab39 req-cff438b3-b808-4479-8789-48265c0a0c73 service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-cde04db3-6c16-4c52-9030-e84feb2aab39 req-cff438b3-b808-4479-8789-48265c0a0c73 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] No waiting events found dispatching network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:25:53 user nova-compute[73917]: WARNING nova.compute.manager [req-cde04db3-6c16-4c52-9030-e84feb2aab39 req-cff438b3-b808-4479-8789-48265c0a0c73 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received unexpected event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 for instance with vm_state active and task_state rescuing.
Aug 26 19:25:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-6286f82c-7fad-4d3a-8557-9f2471117402 req-5dfa0bd3-762d-4ece-92af-01a83171023f service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Received event network-changed-29703ca1-fe7e-4164-8885-481fcb21887a {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-6286f82c-7fad-4d3a-8557-9f2471117402 req-5dfa0bd3-762d-4ece-92af-01a83171023f service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Refreshing instance network info cache due to event network-changed-29703ca1-fe7e-4164-8885-481fcb21887a. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:25:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6286f82c-7fad-4d3a-8557-9f2471117402 req-5dfa0bd3-762d-4ece-92af-01a83171023f service nova] Acquiring lock "refresh_cache-18682407-e406-4f49-a1a0-28eae64b121d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:25:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6286f82c-7fad-4d3a-8557-9f2471117402 req-5dfa0bd3-762d-4ece-92af-01a83171023f service nova] Acquired lock "refresh_cache-18682407-e406-4f49-a1a0-28eae64b121d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:25:53 user nova-compute[73917]: DEBUG nova.network.neutron [req-6286f82c-7fad-4d3a-8557-9f2471117402 req-5dfa0bd3-762d-4ece-92af-01a83171023f service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Refreshing network info cache for port 29703ca1-fe7e-4164-8885-481fcb21887a {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "18682407-e406-4f49-a1a0-28eae64b121d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "18682407-e406-4f49-a1a0-28eae64b121d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG nova.objects.instance [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lazy-loading 'flavor' on Instance uuid 18682407-e406-4f49-a1a0-28eae64b121d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:25:54 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Ignoring supplied device name: /dev/vdb
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "18682407-e406-4f49-a1a0-28eae64b121d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "18682407-e406-4f49-a1a0-28eae64b121d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "18682407-e406-4f49-a1a0-28eae64b121d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:54 user nova-compute[73917]: INFO nova.compute.manager [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Attaching volume 2b3bb4f6-3775-4eee-93fc-f37b034ece2b to /dev/vdb
Aug 26 19:25:54 user nova-compute[73917]: DEBUG nova.network.neutron [req-6286f82c-7fad-4d3a-8557-9f2471117402 req-5dfa0bd3-762d-4ece-92af-01a83171023f service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Updated VIF entry in instance network info cache for port 29703ca1-fe7e-4164-8885-481fcb21887a. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG nova.network.neutron [req-6286f82c-7fad-4d3a-8557-9f2471117402 req-5dfa0bd3-762d-4ece-92af-01a83171023f service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Updating instance_info_cache with network_info: [{"id": "29703ca1-fe7e-4164-8885-481fcb21887a", "address": "fa:16:3e:84:4f:31", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29703ca1-fe", "ovs_interfaceid": "29703ca1-fe7e-4164-8885-481fcb21887a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6286f82c-7fad-4d3a-8557-9f2471117402 req-5dfa0bd3-762d-4ece-92af-01a83171023f service nova] Releasing lock "refresh_cache-18682407-e406-4f49-a1a0-28eae64b121d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG os_brick.utils [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14c1440-a11d-46b9-b869-4a8fe5d6a760]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f722e914-7f7c-4994-a291-6e8e55a429ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b57d5d-8666-4cd4-9116-7a8e7f05eff2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c103c109-a9df-4c33-8ee6-f9256fde3623]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:25:54 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:25:54 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c8bea2-ee25-49da-8e53-e07e23fa4f7e]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG os_brick.utils [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:25:54 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Updating existing volume attachment record: 9f2ca00c-86af-40ad-9a67-6ab0b05ca494 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:25:55 user nova-compute[73917]: DEBUG nova.compute.manager [req-42742c1c-4c97-4794-8847-94e3ff2979bf req-80de9110-514e-4dc4-9f4a-dd484e1b96b1 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:25:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-42742c1c-4c97-4794-8847-94e3ff2979bf req-80de9110-514e-4dc4-9f4a-dd484e1b96b1 service nova] Acquiring lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:25:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-42742c1c-4c97-4794-8847-94e3ff2979bf req-80de9110-514e-4dc4-9f4a-dd484e1b96b1 service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:25:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-42742c1c-4c97-4794-8847-94e3ff2979bf req-80de9110-514e-4dc4-9f4a-dd484e1b96b1 service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:25:55 user nova-compute[73917]: DEBUG nova.compute.manager [req-42742c1c-4c97-4794-8847-94e3ff2979bf req-80de9110-514e-4dc4-9f4a-dd484e1b96b1 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] No waiting events found dispatching network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:25:55 user nova-compute[73917]: WARNING nova.compute.manager [req-42742c1c-4c97-4794-8847-94e3ff2979bf req-80de9110-514e-4dc4-9f4a-dd484e1b96b1 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received unexpected event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 for instance with vm_state active and task_state rescuing.
Aug 26 19:25:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Removed pending event for c94a0ea3-5230-453b-959c-5d7689c408a6 due to event {{(pid=73917) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 19:25:55 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077955.7224312, c94a0ea3-5230-453b-959c-5d7689c408a6 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:25:55 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] VM Resumed (Lifecycle Event)
Aug 26 19:25:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-35fc174c-1e4e-4640-b8b4-7c2da3b25206 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:25:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:25:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:25:55 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 19:25:55 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077955.7258463, c94a0ea3-5230-453b-959c-5d7689c408a6 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:25:55 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] VM Started (Lifecycle Event)
Aug 26 19:25:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:25:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:25:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:25:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Acquiring lock "7270fe83-39ff-430d-b026-b8a1c4ea6976" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "7270fe83-39ff-430d-b026-b8a1c4ea6976" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:26:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:26:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:26:01 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:26:01 user nova-compute[73917]: INFO nova.compute.claims [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Claim successful on node user
Aug 26 19:26:02 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:26:02 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:26:02 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:26:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:26:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:26:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:26:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:26:02 user nova-compute[73917]: DEBUG nova.network.neutron [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:26:02 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:26:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:26:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-df5c717a-62d8-444d-9968-ad682a31733c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:26:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-df5c717a-62d8-444d-9968-ad682a31733c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:26:02 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:26:02 user nova-compute[73917]: DEBUG nova.policy [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df632b88d11245bb9f3393d082e6527f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd87078f3f3e47b687aacabf450e57c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:26:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:26:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:26:02 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Creating image(s)
Aug 26 19:26:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Acquiring lock "/opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "/opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:26:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "/opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:26:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.221s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:26:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.256s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976/disk 1073741824" returned: 0 in 0.073s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.283s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG nova.network.neutron [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Successfully created port: 31000cf6-e614-4dd5-bab1-1e1a439cd8e7 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Updating instance_info_cache with network_info: [{"id": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "address": "fa:16:3e:ca:39:fd", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79ade91-3e", "ovs_interfaceid": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-df5c717a-62d8-444d-9968-ad682a31733c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Cannot resize image /opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Ensure instance console log exists: /opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:26:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:04 user nova-compute[73917]: DEBUG nova.network.neutron [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Successfully updated port: 31000cf6-e614-4dd5-bab1-1e1a439cd8e7 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:26:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Acquiring lock "refresh_cache-7270fe83-39ff-430d-b026-b8a1c4ea6976" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:26:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Acquired lock "refresh_cache-7270fe83-39ff-430d-b026-b8a1c4ea6976" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:26:04 user nova-compute[73917]: DEBUG nova.network.neutron [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:26:04 user nova-compute[73917]: DEBUG nova.compute.manager [req-b3e810cc-b950-4daa-a0fb-ed657245ebe6 req-f0e624b8-6e8e-4858-b04b-5d84e8df6d7f service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Received event network-changed-31000cf6-e614-4dd5-bab1-1e1a439cd8e7 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:26:04 user nova-compute[73917]: DEBUG nova.compute.manager [req-b3e810cc-b950-4daa-a0fb-ed657245ebe6 req-f0e624b8-6e8e-4858-b04b-5d84e8df6d7f service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Refreshing instance network info cache due to event network-changed-31000cf6-e614-4dd5-bab1-1e1a439cd8e7. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:26:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b3e810cc-b950-4daa-a0fb-ed657245ebe6 req-f0e624b8-6e8e-4858-b04b-5d84e8df6d7f service nova] Acquiring lock "refresh_cache-7270fe83-39ff-430d-b026-b8a1c4ea6976" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:26:04 user nova-compute[73917]: DEBUG nova.network.neutron [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.network.neutron [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Updating instance_info_cache with network_info: [{"id": "31000cf6-e614-4dd5-bab1-1e1a439cd8e7", "address": "fa:16:3e:74:19:dd", "network": {"id": "454de19a-252d-4f6b-95c4-5902bc4f0ba7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28701462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd87078f3f3e47b687aacabf450e57c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31000cf6-e6", "ovs_interfaceid": "31000cf6-e614-4dd5-bab1-1e1a439cd8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Releasing lock "refresh_cache-7270fe83-39ff-430d-b026-b8a1c4ea6976" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.compute.manager [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Instance network_info: |[{"id": "31000cf6-e614-4dd5-bab1-1e1a439cd8e7", "address": "fa:16:3e:74:19:dd", "network": {"id": "454de19a-252d-4f6b-95c4-5902bc4f0ba7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28701462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd87078f3f3e47b687aacabf450e57c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31000cf6-e6", "ovs_interfaceid": "31000cf6-e614-4dd5-bab1-1e1a439cd8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b3e810cc-b950-4daa-a0fb-ed657245ebe6 req-f0e624b8-6e8e-4858-b04b-5d84e8df6d7f service nova] Acquired lock "refresh_cache-7270fe83-39ff-430d-b026-b8a1c4ea6976" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.network.neutron [req-b3e810cc-b950-4daa-a0fb-ed657245ebe6 req-f0e624b8-6e8e-4858-b04b-5d84e8df6d7f service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Refreshing network info cache for port 31000cf6-e614-4dd5-bab1-1e1a439cd8e7 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Start _get_guest_xml network_info=[{"id": "31000cf6-e614-4dd5-bab1-1e1a439cd8e7", "address": "fa:16:3e:74:19:dd", "network": {"id": "454de19a-252d-4f6b-95c4-5902bc4f0ba7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28701462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd87078f3f3e47b687aacabf450e57c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31000cf6-e6", "ovs_interfaceid": "31000cf6-e614-4dd5-bab1-1e1a439cd8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:26:05 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:26:05 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:26:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-559723355',display_name='tempest-VolumesActionsTest-instance-559723355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-559723355',id=38,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd87078f3f3e47b687aacabf450e57c4',ramdisk_id='',reservation_id='r-w451qc4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1098860754',owner_user_name='tempest-VolumesActionsTest-1098860754-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:26:02Z,user_data=None,user_id='df632b88d11245bb9f3393d082e6527f',uuid=7270fe83-39ff-430d-b026-b8a1c4ea6976,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31000cf6-e614-4dd5-bab1-1e1a439cd8e7", "address": "fa:16:3e:74:19:dd", "network": {"id": "454de19a-252d-4f6b-95c4-5902bc4f0ba7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28701462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd87078f3f3e47b687aacabf450e57c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31000cf6-e6", "ovs_interfaceid": "31000cf6-e614-4dd5-bab1-1e1a439cd8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Converting VIF {"id": "31000cf6-e614-4dd5-bab1-1e1a439cd8e7", "address": "fa:16:3e:74:19:dd", "network": {"id": "454de19a-252d-4f6b-95c4-5902bc4f0ba7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28701462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd87078f3f3e47b687aacabf450e57c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31000cf6-e6", "ovs_interfaceid": "31000cf6-e614-4dd5-bab1-1e1a439cd8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:19:dd,bridge_name='br-int',has_traffic_filtering=True,id=31000cf6-e614-4dd5-bab1-1e1a439cd8e7,network=Network(454de19a-252d-4f6b-95c4-5902bc4f0ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31000cf6-e6') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.objects.instance [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lazy-loading 'pci_devices' on Instance uuid 7270fe83-39ff-430d-b026-b8a1c4ea6976 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:26:05 user nova-compute[73917]:   <uuid>7270fe83-39ff-430d-b026-b8a1c4ea6976</uuid>
Aug 26 19:26:05 user nova-compute[73917]:   <name>instance-00000026</name>
Aug 26 19:26:05 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:26:05 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:26:05 user nova-compute[73917]:   <metadata>
Aug 26 19:26:05 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:26:05 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:26:05 user nova-compute[73917]:       <nova:name>tempest-VolumesActionsTest-instance-559723355</nova:name>
Aug 26 19:26:05 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:26:05</nova:creationTime>
Aug 26 19:26:05 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:26:05 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:26:05 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:26:05 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:26:05 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:26:05 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:26:05 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:26:05 user nova-compute[73917]:       <nova:owner>
Aug 26 19:26:05 user nova-compute[73917]:         <nova:user uuid="df632b88d11245bb9f3393d082e6527f">tempest-VolumesActionsTest-1098860754-project-member</nova:user>
Aug 26 19:26:05 user nova-compute[73917]:         <nova:project uuid="dd87078f3f3e47b687aacabf450e57c4">tempest-VolumesActionsTest-1098860754</nova:project>
Aug 26 19:26:05 user nova-compute[73917]:       </nova:owner>
Aug 26 19:26:05 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:26:05 user nova-compute[73917]:       <nova:ports>
Aug 26 19:26:05 user nova-compute[73917]:         <nova:port uuid="31000cf6-e614-4dd5-bab1-1e1a439cd8e7">
Aug 26 19:26:05 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 19:26:05 user nova-compute[73917]:         </nova:port>
Aug 26 19:26:05 user nova-compute[73917]:       </nova:ports>
Aug 26 19:26:05 user nova-compute[73917]:     </nova:instance>
Aug 26 19:26:05 user nova-compute[73917]:   </metadata>
Aug 26 19:26:05 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:26:05 user nova-compute[73917]:     <system>
Aug 26 19:26:05 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:26:05 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:26:05 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:26:05 user nova-compute[73917]:       <entry name="serial">7270fe83-39ff-430d-b026-b8a1c4ea6976</entry>
Aug 26 19:26:05 user nova-compute[73917]:       <entry name="uuid">7270fe83-39ff-430d-b026-b8a1c4ea6976</entry>
Aug 26 19:26:05 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:26:05 user nova-compute[73917]:     </system>
Aug 26 19:26:05 user nova-compute[73917]:   </sysinfo>
Aug 26 19:26:05 user nova-compute[73917]:   <os>
Aug 26 19:26:05 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:26:05 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:26:05 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:26:05 user nova-compute[73917]:   </os>
Aug 26 19:26:05 user nova-compute[73917]:   <features>
Aug 26 19:26:05 user nova-compute[73917]:     <acpi/>
Aug 26 19:26:05 user nova-compute[73917]:     <apic/>
Aug 26 19:26:05 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:26:05 user nova-compute[73917]:   </features>
Aug 26 19:26:05 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:26:05 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:26:05 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:26:05 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:26:05 user nova-compute[73917]:   </clock>
Aug 26 19:26:05 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:26:05 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:26:05 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:26:05 user nova-compute[73917]:   </cpu>
Aug 26 19:26:05 user nova-compute[73917]:   <devices>
Aug 26 19:26:05 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:26:05 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:26:05 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976/disk"/>
Aug 26 19:26:05 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:26:05 user nova-compute[73917]:     </disk>
Aug 26 19:26:05 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:26:05 user nova-compute[73917]:       <mac address="fa:16:3e:74:19:dd"/>
Aug 26 19:26:05 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:26:05 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:26:05 user nova-compute[73917]:       <target dev="tap31000cf6-e6"/>
Aug 26 19:26:05 user nova-compute[73917]:     </interface>
Aug 26 19:26:05 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:26:05 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976/console.log" append="off"/>
Aug 26 19:26:05 user nova-compute[73917]:     </serial>
Aug 26 19:26:05 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:26:05 user nova-compute[73917]:     <video>
Aug 26 19:26:05 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:26:05 user nova-compute[73917]:     </video>
Aug 26 19:26:05 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:26:05 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:26:05 user nova-compute[73917]:     </rng>
Aug 26 19:26:05 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:26:05 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:26:05 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:26:05 user nova-compute[73917]:     </memballoon>
Aug 26 19:26:05 user nova-compute[73917]:   </devices>
Aug 26 19:26:05 user nova-compute[73917]: </domain>
Aug 26 19:26:05 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:26:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-559723355',display_name='tempest-VolumesActionsTest-instance-559723355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-559723355',id=38,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd87078f3f3e47b687aacabf450e57c4',ramdisk_id='',reservation_id='r-w451qc4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1098860754',owner_user_name='tempest-VolumesActionsTest-1098860754-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:26:02Z,user_data=None,user_id='df632b88d11245bb9f3393d082e6527f',uuid=7270fe83-39ff-430d-b026-b8a1c4ea6976,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31000cf6-e614-4dd5-bab1-1e1a439cd8e7", "address": "fa:16:3e:74:19:dd", "network": {"id": "454de19a-252d-4f6b-95c4-5902bc4f0ba7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28701462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd87078f3f3e47b687aacabf450e57c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31000cf6-e6", "ovs_interfaceid": "31000cf6-e614-4dd5-bab1-1e1a439cd8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Converting VIF {"id": "31000cf6-e614-4dd5-bab1-1e1a439cd8e7", "address": "fa:16:3e:74:19:dd", "network": {"id": "454de19a-252d-4f6b-95c4-5902bc4f0ba7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28701462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd87078f3f3e47b687aacabf450e57c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31000cf6-e6", "ovs_interfaceid": "31000cf6-e614-4dd5-bab1-1e1a439cd8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:19:dd,bridge_name='br-int',has_traffic_filtering=True,id=31000cf6-e614-4dd5-bab1-1e1a439cd8e7,network=Network(454de19a-252d-4f6b-95c4-5902bc4f0ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31000cf6-e6') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG os_vif [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:19:dd,bridge_name='br-int',has_traffic_filtering=True,id=31000cf6-e614-4dd5-bab1-1e1a439cd8e7,network=Network(454de19a-252d-4f6b-95c4-5902bc4f0ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31000cf6-e6') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31000cf6-e6, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31000cf6-e6, col_values=(('external_ids', {'iface-id': '31000cf6-e614-4dd5-bab1-1e1a439cd8e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:19:dd', 'vm-uuid': '7270fe83-39ff-430d-b026-b8a1c4ea6976'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:05 user nova-compute[73917]: INFO os_vif [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:19:dd,bridge_name='br-int',has_traffic_filtering=True,id=31000cf6-e614-4dd5-bab1-1e1a439cd8e7,network=Network(454de19a-252d-4f6b-95c4-5902bc4f0ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31000cf6-e6')
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] No VIF found with MAC fa:16:3e:74:19:dd, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:26:05 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:26:06 user nova-compute[73917]: DEBUG nova.network.neutron [req-b3e810cc-b950-4daa-a0fb-ed657245ebe6 req-f0e624b8-6e8e-4858-b04b-5d84e8df6d7f service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Updated VIF entry in instance network info cache for port 31000cf6-e614-4dd5-bab1-1e1a439cd8e7. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:26:06 user nova-compute[73917]: DEBUG nova.network.neutron [req-b3e810cc-b950-4daa-a0fb-ed657245ebe6 req-f0e624b8-6e8e-4858-b04b-5d84e8df6d7f service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Updating instance_info_cache with network_info: [{"id": "31000cf6-e614-4dd5-bab1-1e1a439cd8e7", "address": "fa:16:3e:74:19:dd", "network": {"id": "454de19a-252d-4f6b-95c4-5902bc4f0ba7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28701462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd87078f3f3e47b687aacabf450e57c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31000cf6-e6", "ovs_interfaceid": "31000cf6-e614-4dd5-bab1-1e1a439cd8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:26:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b3e810cc-b950-4daa-a0fb-ed657245ebe6 req-f0e624b8-6e8e-4858-b04b-5d84e8df6d7f service nova] Releasing lock "refresh_cache-7270fe83-39ff-430d-b026-b8a1c4ea6976" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:26:06 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:26:06 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:26:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:06 user nova-compute[73917]: DEBUG nova.compute.manager [req-8372d005-bbb9-4745-b175-d361d86c9e9b req-6e7589f9-4931-4c7a-a608-82d01b040725 service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Received event network-vif-plugged-31000cf6-e614-4dd5-bab1-1e1a439cd8e7 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:26:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8372d005-bbb9-4745-b175-d361d86c9e9b req-6e7589f9-4931-4c7a-a608-82d01b040725 service nova] Acquiring lock "7270fe83-39ff-430d-b026-b8a1c4ea6976-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8372d005-bbb9-4745-b175-d361d86c9e9b req-6e7589f9-4931-4c7a-a608-82d01b040725 service nova] Lock "7270fe83-39ff-430d-b026-b8a1c4ea6976-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:26:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8372d005-bbb9-4745-b175-d361d86c9e9b req-6e7589f9-4931-4c7a-a608-82d01b040725 service nova] Lock "7270fe83-39ff-430d-b026-b8a1c4ea6976-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:26:06 user nova-compute[73917]: DEBUG nova.compute.manager [req-8372d005-bbb9-4745-b175-d361d86c9e9b req-6e7589f9-4931-4c7a-a608-82d01b040725 service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] No waiting events found dispatching network-vif-plugged-31000cf6-e614-4dd5-bab1-1e1a439cd8e7 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:26:06 user nova-compute[73917]: WARNING nova.compute.manager [req-8372d005-bbb9-4745-b175-d361d86c9e9b req-6e7589f9-4931-4c7a-a608-82d01b040725 service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Received unexpected event network-vif-plugged-31000cf6-e614-4dd5-bab1-1e1a439cd8e7 for instance with vm_state building and task_state spawning.
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IiPqlBAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:26:07 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:26:07 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:26:07 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3209f670-2711-42b2-a116-e361675e84e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:26:07 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d886fe-7b25-4e35-baeb-016456bbb160]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b] added
Aug 26 19:26:07 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bff8db-02bc-4001-8e57-a232234204e4]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e46939-0d9c-4480-bee5-8f880c078876]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IiPqlBAS {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IiPqlBAS" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32dea80-cd03-456f-ae0b-2eed51c6f4b2]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IiPqlBAS'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc58ed32-76c6-4783-b456-110ded39687e]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d4d00f-3cee-4886-9cf8-555d038adab9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:26:07 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:26:07 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:26:07 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:26:07 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36e6261-727f-4289-8613-353b109a71f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b, portal: 172.16.0.220,3260]
Aug 26 19:26:07 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b, portal: 172.16.0.220,3260] successful.
Aug 26 19:26:07 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9df1fe-0020-4dfb-b0df-872c4ecbfeed]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32bcef4-1203-43bb-817e-b7c3b81400e4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:26:07 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:26:07 user nova-compute[73917]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b (non-flash)
Aug 26 19:26:07 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:26:07 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:26:07 user nova-compute[73917]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b (non-flash)
Aug 26 19:26:07 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ceb6b6d-d632-4162-9e4f-ee51eab64701]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:26:07 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: None {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:26:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:08 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:26:08 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IiPqlBAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:26:08 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:26:08 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23336633634346565', 'path': '/dev/sdd'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:26:08 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336633634346565', 'path': '/dev/sdd'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:26:08 user nova-compute[73917]: DEBUG nova.objects.instance [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lazy-loading 'flavor' on Instance uuid 18682407-e406-4f49-a1a0-28eae64b121d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:26:08 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:26:08 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:26:08 user nova-compute[73917]:   <source dev="/dev/sdd"/>
Aug 26 19:26:08 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:26:08 user nova-compute[73917]:   <serial>2b3bb4f6-3775-4eee-93fc-f37b034ece2b</serial>
Aug 26 19:26:08 user nova-compute[73917]: </disk>
Aug 26 19:26:08 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.compute.manager [req-3d5ef13d-1bc1-478f-8f55-d56b3cee687f req-2954d7c7-aeb1-495b-b401-919bca1cf837 service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Received event network-vif-plugged-31000cf6-e614-4dd5-bab1-1e1a439cd8e7 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3d5ef13d-1bc1-478f-8f55-d56b3cee687f req-2954d7c7-aeb1-495b-b401-919bca1cf837 service nova] Acquiring lock "7270fe83-39ff-430d-b026-b8a1c4ea6976-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3d5ef13d-1bc1-478f-8f55-d56b3cee687f req-2954d7c7-aeb1-495b-b401-919bca1cf837 service nova] Lock "7270fe83-39ff-430d-b026-b8a1c4ea6976-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3d5ef13d-1bc1-478f-8f55-d56b3cee687f req-2954d7c7-aeb1-495b-b401-919bca1cf837 service nova] Lock "7270fe83-39ff-430d-b026-b8a1c4ea6976-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.compute.manager [req-3d5ef13d-1bc1-478f-8f55-d56b3cee687f req-2954d7c7-aeb1-495b-b401-919bca1cf837 service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] No waiting events found dispatching network-vif-plugged-31000cf6-e614-4dd5-bab1-1e1a439cd8e7 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:26:09 user nova-compute[73917]: WARNING nova.compute.manager [req-3d5ef13d-1bc1-478f-8f55-d56b3cee687f req-2954d7c7-aeb1-495b-b401-919bca1cf837 service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Received unexpected event network-vif-plugged-31000cf6-e614-4dd5-bab1-1e1a439cd8e7 for instance with vm_state building and task_state spawning.
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077969.0962462, 7270fe83-39ff-430d-b026-b8a1c4ea6976 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:26:09 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] VM Resumed (Lifecycle Event)
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:26:09 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Instance spawned successfully.
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:26:09 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693077969.103984, 7270fe83-39ff-430d-b026-b8a1c4ea6976 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:26:09 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] VM Started (Lifecycle Event)
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:26:09 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:26:09 user nova-compute[73917]: INFO nova.compute.manager [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Took 6.64 seconds to spawn the instance on the hypervisor.
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:26:09 user nova-compute[73917]: INFO nova.compute.manager [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Took 7.57 seconds to build instance.
Aug 26 19:26:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] No VIF found with MAC fa:16:3e:84:4f:31, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-168fdde0-e7d7-4f6c-92b1-af2442892549 tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "7270fe83-39ff-430d-b026-b8a1c4ea6976" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.678s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-4cbb3faa-6778-4f64-9e50-862dc0301d79 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "18682407-e406-4f49-a1a0-28eae64b121d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.112s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:26:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:10 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:26:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:10 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:12 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:26:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94a0ea3-5230-453b-959c-5d7689c408a6/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94a0ea3-5230-453b-959c-5d7689c408a6/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94a0ea3-5230-453b-959c-5d7689c408a6/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94a0ea3-5230-453b-959c-5d7689c408a6/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:13 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:26:13 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:26:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=7579MB free_disk=25.064292907714844GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:26:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:26:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:26:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 94f8d4e7-f310-45df-a0ae-82e608ac0119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:26:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance df5c717a-62d8-444d-9968-ad682a31733c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:26:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c78c30ea-1190-44bc-bd78-b3655e251a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:26:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance a4487be3-7267-4ae1-8731-a6bdf49a6070 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:26:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c94a0ea3-5230-453b-959c-5d7689c408a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:26:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 18682407-e406-4f49-a1a0-28eae64b121d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:26:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fbc66439-479c-4818-a416-c3c64d49741d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:26:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 7270fe83-39ff-430d-b026-b8a1c4ea6976 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:26:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:26:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:26:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:13 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:26:13 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:26:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:26:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:26:14 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:26:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:26:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:26:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:26:24 user nova-compute[73917]: INFO nova.compute.manager [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Terminating instance
Aug 26 19:26:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:26:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-e5ab54c4-6683-4533-b011-175fb7d4f8c9 req-9408660a-7575-4425-8ebc-0ca0ff5df20b service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Received event network-vif-unplugged-2738a59b-9109-4fef-8868-920d458dfaa1 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:26:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e5ab54c4-6683-4533-b011-175fb7d4f8c9 req-9408660a-7575-4425-8ebc-0ca0ff5df20b service nova] Acquiring lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e5ab54c4-6683-4533-b011-175fb7d4f8c9 req-9408660a-7575-4425-8ebc-0ca0ff5df20b service nova] Lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:26:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e5ab54c4-6683-4533-b011-175fb7d4f8c9 req-9408660a-7575-4425-8ebc-0ca0ff5df20b service nova] Lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:26:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-e5ab54c4-6683-4533-b011-175fb7d4f8c9 req-9408660a-7575-4425-8ebc-0ca0ff5df20b service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] No waiting events found dispatching network-vif-unplugged-2738a59b-9109-4fef-8868-920d458dfaa1 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:26:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-e5ab54c4-6683-4533-b011-175fb7d4f8c9 req-9408660a-7575-4425-8ebc-0ca0ff5df20b service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Received event network-vif-unplugged-2738a59b-9109-4fef-8868-920d458dfaa1 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:26:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:25 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Instance destroyed successfully.
Aug 26 19:26:25 user nova-compute[73917]: DEBUG nova.objects.instance [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lazy-loading 'resources' on Instance uuid 1c12fdf0-17e7-438b-aa6c-729dd67676aa {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:26:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:07:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1976679095',display_name='tempest-ServerActionsTestOtherA-server-1976679095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1976679095',id=6,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoE8tZDc68JWUNde0nWnasqq1vYa5ON2YNQwHw+xO1EiolhKGRVVBiykxwLyvBezUmZpO4CsEARWWqkHIKpn0pTvCPDPPJIP+G7BbRXcHe4wp+29J3exWEnrrk3yPKzjg==',key_name='tempest-keypair-1254307896',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:07:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2e09fe7b38e4bb991bfaaf5b4ad357a',ramdisk_id='',reservation_id='r-zcmzv138',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2069094918',owner_user_name='tempest-ServerActionsTestOtherA-2069094918-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:07:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd1b7d3fe22c4b239cf03235866e17d4',uuid=1c12fdf0-17e7-438b-aa6c-729dd67676aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2738a59b-9109-4fef-8868-920d458dfaa1", "address": "fa:16:3e:e9:a2:a3", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2738a59b-91", "ovs_interfaceid": "2738a59b-9109-4fef-8868-920d458dfaa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:26:25 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converting VIF {"id": "2738a59b-9109-4fef-8868-920d458dfaa1", "address": "fa:16:3e:e9:a2:a3", "network": {"id": "690fbcf1-a89c-463a-9b4f-79bc8c18020d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-292934733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e09fe7b38e4bb991bfaaf5b4ad357a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2738a59b-91", "ovs_interfaceid": "2738a59b-9109-4fef-8868-920d458dfaa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:26:25 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:a2:a3,bridge_name='br-int',has_traffic_filtering=True,id=2738a59b-9109-4fef-8868-920d458dfaa1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2738a59b-91') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:26:25 user nova-compute[73917]: DEBUG os_vif [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:a2:a3,bridge_name='br-int',has_traffic_filtering=True,id=2738a59b-9109-4fef-8868-920d458dfaa1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2738a59b-91') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:26:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2738a59b-91, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:26:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:26:25 user nova-compute[73917]: INFO os_vif [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:a2:a3,bridge_name='br-int',has_traffic_filtering=True,id=2738a59b-9109-4fef-8868-920d458dfaa1,network=Network(690fbcf1-a89c-463a-9b4f-79bc8c18020d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2738a59b-91')
Aug 26 19:26:25 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Deleting instance files /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa_del
Aug 26 19:26:25 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Deletion of /opt/stack/data/nova/instances/1c12fdf0-17e7-438b-aa6c-729dd67676aa_del complete
Aug 26 19:26:25 user nova-compute[73917]: INFO nova.compute.manager [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 26 19:26:25 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:26:25 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:26:25 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:26:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:26 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:26:26 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Took 0.63 seconds to deallocate network for instance.
Aug 26 19:26:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-f5d410cb-c234-4827-84fa-6181b12c5098 req-2ca77d28-a92e-4fd2-93df-b516cf511c8c service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Received event network-vif-deleted-2738a59b-9109-4fef-8868-920d458dfaa1 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:26:26 user nova-compute[73917]: INFO nova.compute.manager [req-f5d410cb-c234-4827-84fa-6181b12c5098 req-2ca77d28-a92e-4fd2-93df-b516cf511c8c service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Neutron deleted interface 2738a59b-9109-4fef-8868-920d458dfaa1; detaching it from the instance and deleting it from the info cache
Aug 26 19:26:26 user nova-compute[73917]: DEBUG nova.network.neutron [req-f5d410cb-c234-4827-84fa-6181b12c5098 req-2ca77d28-a92e-4fd2-93df-b516cf511c8c service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:26:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-f5d410cb-c234-4827-84fa-6181b12c5098 req-2ca77d28-a92e-4fd2-93df-b516cf511c8c service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Detach interface failed, port_id=2738a59b-9109-4fef-8868-920d458dfaa1, reason: Instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:26:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:26:26 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:26:26 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:26:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:26:26 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Deleted allocations for instance 1c12fdf0-17e7-438b-aa6c-729dd67676aa
Aug 26 19:26:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-20ab593e-dfa1-438a-8bf5-0daafa26934f tempest-ServerActionsTestOtherA-2069094918 tempest-ServerActionsTestOtherA-2069094918-project-member] Lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.213s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:26:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-fca431c3-8917-45e2-b3df-8aeaed36828b req-aabb7ca8-d56a-45be-973c-47a5cf1b5672 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Received event network-vif-plugged-2738a59b-9109-4fef-8868-920d458dfaa1 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:26:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fca431c3-8917-45e2-b3df-8aeaed36828b req-aabb7ca8-d56a-45be-973c-47a5cf1b5672 service nova] Acquiring lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fca431c3-8917-45e2-b3df-8aeaed36828b req-aabb7ca8-d56a-45be-973c-47a5cf1b5672 service nova] Lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:26:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fca431c3-8917-45e2-b3df-8aeaed36828b req-aabb7ca8-d56a-45be-973c-47a5cf1b5672 service nova] Lock "1c12fdf0-17e7-438b-aa6c-729dd67676aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:26:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-fca431c3-8917-45e2-b3df-8aeaed36828b req-aabb7ca8-d56a-45be-973c-47a5cf1b5672 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] No waiting events found dispatching network-vif-plugged-2738a59b-9109-4fef-8868-920d458dfaa1 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:26:27 user nova-compute[73917]: WARNING nova.compute.manager [req-fca431c3-8917-45e2-b3df-8aeaed36828b req-aabb7ca8-d56a-45be-973c-47a5cf1b5672 service nova] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Received unexpected event network-vif-plugged-2738a59b-9109-4fef-8868-920d458dfaa1 for instance with vm_state deleted and task_state None.
Aug 26 19:26:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "c78c30ea-1190-44bc-bd78-b3655e251a35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:26:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "c78c30ea-1190-44bc-bd78-b3655e251a35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:26:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:26:35 user nova-compute[73917]: INFO nova.compute.manager [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Terminating instance
Aug 26 19:26:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:26:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-3ecd4423-3981-44ed-ba97-1e77902d1b13 req-1bc6afaa-7c4a-4342-b2a8-53ed8e1d1583 service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Received event network-vif-unplugged-d17ecc7e-21af-4f6a-a251-4a865473e86b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:26:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3ecd4423-3981-44ed-ba97-1e77902d1b13 req-1bc6afaa-7c4a-4342-b2a8-53ed8e1d1583 service nova] Acquiring lock "c78c30ea-1190-44bc-bd78-b3655e251a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3ecd4423-3981-44ed-ba97-1e77902d1b13 req-1bc6afaa-7c4a-4342-b2a8-53ed8e1d1583 service nova] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:26:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3ecd4423-3981-44ed-ba97-1e77902d1b13 req-1bc6afaa-7c4a-4342-b2a8-53ed8e1d1583 service nova] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:26:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-3ecd4423-3981-44ed-ba97-1e77902d1b13 req-1bc6afaa-7c4a-4342-b2a8-53ed8e1d1583 service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] No waiting events found dispatching network-vif-unplugged-d17ecc7e-21af-4f6a-a251-4a865473e86b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:26:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-3ecd4423-3981-44ed-ba97-1e77902d1b13 req-1bc6afaa-7c4a-4342-b2a8-53ed8e1d1583 service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Received event network-vif-unplugged-d17ecc7e-21af-4f6a-a251-4a865473e86b for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:26:36 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Instance destroyed successfully.
Aug 26 19:26:36 user nova-compute[73917]: DEBUG nova.objects.instance [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lazy-loading 'resources' on Instance uuid c78c30ea-1190-44bc-bd78-b3655e251a35 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:26:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-383778297',display_name='tempest-SnapshotDataIntegrityTests-server-383778297',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-383778297',id=29,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuv1mU9NVoBpVxj5EiVjaYvC4NCO9YI10DSjepFVEIfQvlDcx/upl6wK2Fesp6NWlaDAAKyhvMqPoqyYfBDr3Q9il34yGb738txzIzIVrkKd4WemX+502JyqPZaqQ/yYQ==',key_name='tempest-keypair-798292815',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:18:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29e26e61119446978d7bef2800e511f9',ramdisk_id='',reservation_id='r-gve30q4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1939202203',owner_user_name='tempest-SnapshotDataIntegrityTests-1939202203-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d72f2f6c9e04d938fc4272283d4e45a',uuid=c78c30ea-1190-44bc-bd78-b3655e251a35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "address": "fa:16:3e:97:c2:28", "network": {"id": "4e5dd15a-9c1d-489e-b732-db3ac6496ecf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885174960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e26e61119446978d7bef2800e511f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17ecc7e-21", "ovs_interfaceid": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:26:36 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Converting VIF {"id": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "address": "fa:16:3e:97:c2:28", "network": {"id": "4e5dd15a-9c1d-489e-b732-db3ac6496ecf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885174960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e26e61119446978d7bef2800e511f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd17ecc7e-21", "ovs_interfaceid": "d17ecc7e-21af-4f6a-a251-4a865473e86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:26:36 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:c2:28,bridge_name='br-int',has_traffic_filtering=True,id=d17ecc7e-21af-4f6a-a251-4a865473e86b,network=Network(4e5dd15a-9c1d-489e-b732-db3ac6496ecf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd17ecc7e-21') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:26:36 user nova-compute[73917]: DEBUG os_vif [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:c2:28,bridge_name='br-int',has_traffic_filtering=True,id=d17ecc7e-21af-4f6a-a251-4a865473e86b,network=Network(4e5dd15a-9c1d-489e-b732-db3ac6496ecf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd17ecc7e-21') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:26:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd17ecc7e-21, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:26:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:26:36 user nova-compute[73917]: INFO os_vif [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:c2:28,bridge_name='br-int',has_traffic_filtering=True,id=d17ecc7e-21af-4f6a-a251-4a865473e86b,network=Network(4e5dd15a-9c1d-489e-b732-db3ac6496ecf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd17ecc7e-21')
Aug 26 19:26:36 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Deleting instance files /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35_del
Aug 26 19:26:36 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Deletion of /opt/stack/data/nova/instances/c78c30ea-1190-44bc-bd78-b3655e251a35_del complete
Aug 26 19:26:36 user nova-compute[73917]: INFO nova.compute.manager [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 26 19:26:36 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:26:36 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:26:36 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:26:36 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:26:36 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Took 0.80 seconds to deallocate network for instance.
Aug 26 19:26:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:26:37 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:26:37 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:26:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:26:37 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Deleted allocations for instance c78c30ea-1190-44bc-bd78-b3655e251a35
Aug 26 19:26:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-53dce6ee-29b2-4301-9727-54738a48b275 tempest-SnapshotDataIntegrityTests-1939202203 tempest-SnapshotDataIntegrityTests-1939202203-project-member] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.235s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:26:37 user nova-compute[73917]: DEBUG nova.compute.manager [req-c72e7117-4cad-41f6-a19b-b1841d969c34 req-8dad0ddc-2e27-4f8e-b105-a34c036aea1d service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Received event network-vif-plugged-d17ecc7e-21af-4f6a-a251-4a865473e86b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:26:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c72e7117-4cad-41f6-a19b-b1841d969c34 req-8dad0ddc-2e27-4f8e-b105-a34c036aea1d service nova] Acquiring lock "c78c30ea-1190-44bc-bd78-b3655e251a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c72e7117-4cad-41f6-a19b-b1841d969c34 req-8dad0ddc-2e27-4f8e-b105-a34c036aea1d service nova] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:26:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c72e7117-4cad-41f6-a19b-b1841d969c34 req-8dad0ddc-2e27-4f8e-b105-a34c036aea1d service nova] Lock "c78c30ea-1190-44bc-bd78-b3655e251a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:26:37 user nova-compute[73917]: DEBUG nova.compute.manager [req-c72e7117-4cad-41f6-a19b-b1841d969c34 req-8dad0ddc-2e27-4f8e-b105-a34c036aea1d service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] No waiting events found dispatching network-vif-plugged-d17ecc7e-21af-4f6a-a251-4a865473e86b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:26:37 user nova-compute[73917]: WARNING nova.compute.manager [req-c72e7117-4cad-41f6-a19b-b1841d969c34 req-8dad0ddc-2e27-4f8e-b105-a34c036aea1d service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Received unexpected event network-vif-plugged-d17ecc7e-21af-4f6a-a251-4a865473e86b for instance with vm_state deleted and task_state None.
Aug 26 19:26:37 user nova-compute[73917]: DEBUG nova.compute.manager [req-c72e7117-4cad-41f6-a19b-b1841d969c34 req-8dad0ddc-2e27-4f8e-b105-a34c036aea1d service nova] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Received event network-vif-deleted-d17ecc7e-21af-4f6a-a251-4a865473e86b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:26:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:40 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077985.4389234, 1c12fdf0-17e7-438b-aa6c-729dd67676aa => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:26:40 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] VM Stopped (Lifecycle Event)
Aug 26 19:26:40 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2279a1b6-c418-454a-91fa-97c7fdc9bedb None None] [instance: 1c12fdf0-17e7-438b-aa6c-729dd67676aa] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:26:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:51 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693077996.0078647, c78c30ea-1190-44bc-bd78-b3655e251a35 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:26:51 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] VM Stopped (Lifecycle Event)
Aug 26 19:26:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-34b2448a-6c50-498f-a259-5e6575524bad None None] [instance: c78c30ea-1190-44bc-bd78-b3655e251a35] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:26:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:26:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:26:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:26:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:26:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:26:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:26:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "18682407-e406-4f49-a1a0-28eae64b121d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "18682407-e406-4f49-a1a0-28eae64b121d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:26:58 user nova-compute[73917]: INFO nova.compute.manager [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Detaching volume 2b3bb4f6-3775-4eee-93fc-f37b034ece2b
Aug 26 19:26:58 user nova-compute[73917]: INFO nova.virt.block_device [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Attempting to driver detach volume 2b3bb4f6-3775-4eee-93fc-f37b034ece2b from mountpoint /dev/vdb
Aug 26 19:26:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Attempting to detach device vdb from instance 18682407-e406-4f49-a1a0-28eae64b121d from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:26:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:26:58 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:26:58 user nova-compute[73917]:   <source dev="/dev/sdd"/>
Aug 26 19:26:58 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:26:58 user nova-compute[73917]:   <serial>2b3bb4f6-3775-4eee-93fc-f37b034ece2b</serial>
Aug 26 19:26:58 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:26:58 user nova-compute[73917]: </disk>
Aug 26 19:26:58 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:26:58 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Successfully detached device vdb from instance 18682407-e406-4f49-a1a0-28eae64b121d from the persistent domain config.
Aug 26 19:26:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 18682407-e406-4f49-a1a0-28eae64b121d from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:26:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:26:58 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:26:58 user nova-compute[73917]:   <source dev="/dev/sdd"/>
Aug 26 19:26:58 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:26:58 user nova-compute[73917]:   <serial>2b3bb4f6-3775-4eee-93fc-f37b034ece2b</serial>
Aug 26 19:26:58 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:26:58 user nova-compute[73917]: </disk>
Aug 26 19:26:58 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:26:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "18682407-e406-4f49-a1a0-28eae64b121d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693078019.2125964, 18682407-e406-4f49-a1a0-28eae64b121d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 18682407-e406-4f49-a1a0-28eae64b121d {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:26:59 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Successfully detached device vdb from instance 18682407-e406-4f49-a1a0-28eae64b121d from the live domain config.
Aug 26 19:26:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IiPqlBAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:26:59 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:26:59 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[883eedd3-3e54-43c9-9725-df28076a6010]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7424f8-6b91-43c5-be9a-b1c404893f09]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:26:59 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:26:59 user nova-compute[73917]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b (non-flash)
Aug 26 19:26:59 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:26:59 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:26:59 user nova-compute[73917]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b (non-flash)
Aug 26 19:26:59 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b9832f760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b'): ({'sdd'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Removing single pathed devices sdd {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d83fe4-e0c7-42b2-9c77-119ef9a6c693]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c87e107-75fb-47b9-80b3-e52f0ee0b60d]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Flushing IO for device /dev/sdd {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[be14b176-80ee-4676-af02-449388ab1747]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc2b241-daf9-47b9-84e8-5d71acc4af2e]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] SCSI volumes sdd have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efa3a51-a3d5-4bfe-b235-9c9543d92405]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0859637-03e2-4d5b-9e7d-a224e55dc3d8]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b, portal: 172.16.0.220,3260]
Aug 26 19:26:59 user nova-compute[73917]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b, portal: 172.16.0.220,3260] successful.
Aug 26 19:26:59 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c68cdaf-0a12-4d34-9637-3a4913bb3e7e]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] <== disconnect_volume: return (301ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:26:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:27:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:27:02 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:27:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:27:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-a4487be3-7267-4ae1-8731-a6bdf49a6070" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:27:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-a4487be3-7267-4ae1-8731-a6bdf49a6070" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:27:02 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:27:02 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Updating instance_info_cache with network_info: [{"id": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "address": "fa:16:3e:47:7a:17", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e5e2fc-f5", "ovs_interfaceid": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:27:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-a4487be3-7267-4ae1-8731-a6bdf49a6070" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:27:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:27:04 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:27:04 user nova-compute[73917]: DEBUG nova.objects.instance [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lazy-loading 'flavor' on Instance uuid 18682407-e406-4f49-a1a0-28eae64b121d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:27:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-df670250-1d65-4bea-9003-b24c1fcaa342 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "18682407-e406-4f49-a1a0-28eae64b121d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.233s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "18682407-e406-4f49-a1a0-28eae64b121d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 6.113s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "18682407-e406-4f49-a1a0-28eae64b121d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "18682407-e406-4f49-a1a0-28eae64b121d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "18682407-e406-4f49-a1a0-28eae64b121d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:04 user nova-compute[73917]: INFO nova.compute.manager [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Terminating instance
Aug 26 19:27:04 user nova-compute[73917]: DEBUG nova.compute.manager [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:27:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-154197fc-5be1-4186-9fe4-d3728364da7d req-4200ec04-4c89-47d3-8c91-e522b0fdca8c service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Received event network-vif-unplugged-29703ca1-fe7e-4164-8885-481fcb21887a {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-154197fc-5be1-4186-9fe4-d3728364da7d req-4200ec04-4c89-47d3-8c91-e522b0fdca8c service nova] Acquiring lock "18682407-e406-4f49-a1a0-28eae64b121d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-154197fc-5be1-4186-9fe4-d3728364da7d req-4200ec04-4c89-47d3-8c91-e522b0fdca8c service nova] Lock "18682407-e406-4f49-a1a0-28eae64b121d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-154197fc-5be1-4186-9fe4-d3728364da7d req-4200ec04-4c89-47d3-8c91-e522b0fdca8c service nova] Lock "18682407-e406-4f49-a1a0-28eae64b121d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-154197fc-5be1-4186-9fe4-d3728364da7d req-4200ec04-4c89-47d3-8c91-e522b0fdca8c service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] No waiting events found dispatching network-vif-unplugged-29703ca1-fe7e-4164-8885-481fcb21887a {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-154197fc-5be1-4186-9fe4-d3728364da7d req-4200ec04-4c89-47d3-8c91-e522b0fdca8c service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Received event network-vif-unplugged-29703ca1-fe7e-4164-8885-481fcb21887a for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:05 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Instance destroyed successfully.
Aug 26 19:27:05 user nova-compute[73917]: DEBUG nova.objects.instance [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lazy-loading 'resources' on Instance uuid 18682407-e406-4f49-a1a0-28eae64b121d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1456946171',display_name='tempest-VolumesSnapshotTestJSON-instance-1456946171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1456946171',id=36,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+kK1W+c9oeveSKbhViQBVWjAnDMAmczE6jvn2Hw8599J/1Ab0JWr1jeoL+NMTBFREwUwgpIRCBPXmgzuspUeHrLMw17UsgkxUpSeCGWlxeR6pfJDeUbx48SdiAcqnK6Q==',key_name='tempest-keypair-534024245',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:24:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02a44e229f9e4101bb1edf230efcf8bd',ramdisk_id='',reservation_id='r-0n3rov19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1190045200',owner_user_name='tempest-VolumesSnapshotTestJSON-1190045200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:24:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='714d650d67d74694b520329848fc88b7',uuid=18682407-e406-4f49-a1a0-28eae64b121d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29703ca1-fe7e-4164-8885-481fcb21887a", "address": "fa:16:3e:84:4f:31", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29703ca1-fe", "ovs_interfaceid": "29703ca1-fe7e-4164-8885-481fcb21887a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Converting VIF {"id": "29703ca1-fe7e-4164-8885-481fcb21887a", "address": "fa:16:3e:84:4f:31", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29703ca1-fe", "ovs_interfaceid": "29703ca1-fe7e-4164-8885-481fcb21887a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:4f:31,bridge_name='br-int',has_traffic_filtering=True,id=29703ca1-fe7e-4164-8885-481fcb21887a,network=Network(b47e702d-90fc-48c8-bdef-274729c534a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29703ca1-fe') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG os_vif [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:4f:31,bridge_name='br-int',has_traffic_filtering=True,id=29703ca1-fe7e-4164-8885-481fcb21887a,network=Network(b47e702d-90fc-48c8-bdef-274729c534a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29703ca1-fe') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29703ca1-fe, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:27:05 user nova-compute[73917]: INFO os_vif [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:4f:31,bridge_name='br-int',has_traffic_filtering=True,id=29703ca1-fe7e-4164-8885-481fcb21887a,network=Network(b47e702d-90fc-48c8-bdef-274729c534a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29703ca1-fe')
Aug 26 19:27:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IiPqlBAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:27:05 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:27:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b3bb4f6-3775-4eee-93fc-f37b034ece2b', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e353af-22c2-44ec-96d2-1243e06bd258]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cf57ed-5639-4f00-ab0f-71275a972b29]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:27:05 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:27:05 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:27:05 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:27:05 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b784cc670>, {}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Disconnecting from: [] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] <== disconnect_volume: return (55ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:27:05 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Deleting instance files /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d_del
Aug 26 19:27:05 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Deletion of /opt/stack/data/nova/instances/18682407-e406-4f49-a1a0-28eae64b121d_del complete
Aug 26 19:27:05 user nova-compute[73917]: INFO nova.compute.manager [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 26 19:27:05 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:27:05 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:27:06 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:27:06 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Took 1.04 seconds to deallocate network for instance.
Aug 26 19:27:06 user nova-compute[73917]: DEBUG nova.compute.manager [req-cdad3f07-e844-4079-8f80-4a959b0a7b32 req-3ac9aaa3-a68c-4c49-b18c-7a89bd2ccaa8 service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Received event network-vif-deleted-29703ca1-fe7e-4164-8885-481fcb21887a {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:27:06 user nova-compute[73917]: WARNING nova.volume.cinder [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Attachment 9f2ca00c-86af-40ad-9a67-6ab0b05ca494 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9f2ca00c-86af-40ad-9a67-6ab0b05ca494. (HTTP 404) (Request-ID: req-3b70c9f9-e1d8-4cea-90c7-8d47fe271e9f)
Aug 26 19:27:06 user nova-compute[73917]: INFO nova.compute.manager [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Took 0.03 seconds to detach 1 volumes for instance.
Aug 26 19:27:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:07 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:27:07 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:27:07 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:27:07 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:27:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:07 user nova-compute[73917]: DEBUG nova.compute.manager [req-18dd3a5d-b98f-4c13-ba57-990aba6e44d3 req-1ab7dc2f-8d81-4729-bb7c-d3348b9fa039 service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Received event network-vif-plugged-29703ca1-fe7e-4164-8885-481fcb21887a {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:27:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-18dd3a5d-b98f-4c13-ba57-990aba6e44d3 req-1ab7dc2f-8d81-4729-bb7c-d3348b9fa039 service nova] Acquiring lock "18682407-e406-4f49-a1a0-28eae64b121d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-18dd3a5d-b98f-4c13-ba57-990aba6e44d3 req-1ab7dc2f-8d81-4729-bb7c-d3348b9fa039 service nova] Lock "18682407-e406-4f49-a1a0-28eae64b121d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-18dd3a5d-b98f-4c13-ba57-990aba6e44d3 req-1ab7dc2f-8d81-4729-bb7c-d3348b9fa039 service nova] Lock "18682407-e406-4f49-a1a0-28eae64b121d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:07 user nova-compute[73917]: DEBUG nova.compute.manager [req-18dd3a5d-b98f-4c13-ba57-990aba6e44d3 req-1ab7dc2f-8d81-4729-bb7c-d3348b9fa039 service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] No waiting events found dispatching network-vif-plugged-29703ca1-fe7e-4164-8885-481fcb21887a {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:27:07 user nova-compute[73917]: WARNING nova.compute.manager [req-18dd3a5d-b98f-4c13-ba57-990aba6e44d3 req-1ab7dc2f-8d81-4729-bb7c-d3348b9fa039 service nova] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Received unexpected event network-vif-plugged-29703ca1-fe7e-4164-8885-481fcb21887a for instance with vm_state deleted and task_state None.
Aug 26 19:27:07 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Deleted allocations for instance 18682407-e406-4f49-a1a0-28eae64b121d
Aug 26 19:27:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-406a2476-f554-4c4b-88a1-dadfc887a178 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "18682407-e406-4f49-a1a0-28eae64b121d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.526s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:08 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "d30d366d-29cc-430b-ba31-bcbc08a364b7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:09 user nova-compute[73917]: INFO nova.compute.manager [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Unshelving
Aug 26 19:27:09 user nova-compute[73917]: INFO nova.virt.block_device [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Booting with volume c2a7ade3-b578-4feb-80e4-00b53c1d62ab at /dev/vdc
Aug 26 19:27:09 user nova-compute[73917]: DEBUG os_brick.utils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c453d90-06fd-475f-a0e4-6b3e2e0a17fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ccb6cd-eb33-4f7d-b044-b50abfb3137e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[769e606a-8168-4866-bc02-b9f68c19f806]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[23531930-4d93-4fa1-85e2-a4cb36cae17c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:27:09 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:27:09 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf84baa-7e29-4a20-bfa2-653c3df8a9f1]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG os_brick.utils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:27:09 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Updating existing volume attachment record: 92f29b55-f2b0-4843-9373-0b2331845b12 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:27:10 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:27:10 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:27:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:11 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:27:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:11 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:27:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:11 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:27:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:12 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:27:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94a0ea3-5230-453b-959c-5d7689c408a6/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94a0ea3-5230-453b-959c-5d7689c408a6/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94a0ea3-5230-453b-959c-5d7689c408a6/disk.rescue --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94a0ea3-5230-453b-959c-5d7689c408a6/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:13 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:27:13 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:27:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=7924MB free_disk=25.1080322265625GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:27:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 94f8d4e7-f310-45df-a0ae-82e608ac0119 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:27:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance df5c717a-62d8-444d-9968-ad682a31733c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:27:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance a4487be3-7267-4ae1-8731-a6bdf49a6070 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:27:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c94a0ea3-5230-453b-959c-5d7689c408a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:27:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fbc66439-479c-4818-a416-c3c64d49741d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:27:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 7270fe83-39ff-430d-b026-b8a1c4ea6976 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:27:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance d30d366d-29cc-430b-ba31-bcbc08a364b7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 19:27:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:27:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:27:14 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:27:14 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:27:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:27:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:27:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:20 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693078025.7113056, 18682407-e406-4f49-a1a0-28eae64b121d => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:27:20 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] VM Stopped (Lifecycle Event)
Aug 26 19:27:20 user nova-compute[73917]: DEBUG nova.compute.manager [None req-406d96b2-42ef-41c8-8ccb-8da053492c40 None None] [instance: 18682407-e406-4f49-a1a0-28eae64b121d] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:27:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:27:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:27:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:27:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:27:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG nova.compute.manager [req-a4bb9f05-4681-49ca-a17b-0cf4ea2eda5f req-a8a33263-8d0b-4e83-89f6-806fe3ac1b98 service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Received event network-changed-dcd0eceb-374a-46e1-92cd-5e5fcb947a75 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG nova.compute.manager [req-a4bb9f05-4681-49ca-a17b-0cf4ea2eda5f req-a8a33263-8d0b-4e83-89f6-806fe3ac1b98 service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Refreshing instance network info cache due to event network-changed-dcd0eceb-374a-46e1-92cd-5e5fcb947a75. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a4bb9f05-4681-49ca-a17b-0cf4ea2eda5f req-a8a33263-8d0b-4e83-89f6-806fe3ac1b98 service nova] Acquiring lock "refresh_cache-fbc66439-479c-4818-a416-c3c64d49741d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a4bb9f05-4681-49ca-a17b-0cf4ea2eda5f req-a8a33263-8d0b-4e83-89f6-806fe3ac1b98 service nova] Acquired lock "refresh_cache-fbc66439-479c-4818-a416-c3c64d49741d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG nova.network.neutron [req-a4bb9f05-4681-49ca-a17b-0cf4ea2eda5f req-a8a33263-8d0b-4e83-89f6-806fe3ac1b98 service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Refreshing network info cache for port dcd0eceb-374a-46e1-92cd-5e5fcb947a75 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "fbc66439-479c-4818-a416-c3c64d49741d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "fbc66439-479c-4818-a416-c3c64d49741d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG nova.objects.instance [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lazy-loading 'flavor' on Instance uuid fbc66439-479c-4818-a416-c3c64d49741d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "fbc66439-479c-4818-a416-c3c64d49741d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "fbc66439-479c-4818-a416-c3c64d49741d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "fbc66439-479c-4818-a416-c3c64d49741d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:28 user nova-compute[73917]: INFO nova.compute.manager [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Attaching volume 567c1a3a-889a-4efa-bb27-a565c7718aef to /dev/vdb
Aug 26 19:27:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG os_brick.utils [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b4cab1-a6c7-462e-bdb4-c9fd673afeaf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e574c6-922b-46a8-bd13-aa0186ee8292]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0476548a-3fe5-4a60-b56d-647afa3bf00f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG nova.network.neutron [req-a4bb9f05-4681-49ca-a17b-0cf4ea2eda5f req-a8a33263-8d0b-4e83-89f6-806fe3ac1b98 service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Updated VIF entry in instance network info cache for port dcd0eceb-374a-46e1-92cd-5e5fcb947a75. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG nova.network.neutron [req-a4bb9f05-4681-49ca-a17b-0cf4ea2eda5f req-a8a33263-8d0b-4e83-89f6-806fe3ac1b98 service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Updating instance_info_cache with network_info: [{"id": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "address": "fa:16:3e:92:aa:c8", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd0eceb-37", "ovs_interfaceid": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3606735f-c829-46f6-976b-48cb650248f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a4bb9f05-4681-49ca-a17b-0cf4ea2eda5f req-a8a33263-8d0b-4e83-89f6-806fe3ac1b98 service nova] Releasing lock "refresh_cache-fbc66439-479c-4818-a416-c3c64d49741d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:27:28 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:27:28 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f961acc-7902-430d-ac34-3d80288f3fc1]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG os_brick.utils [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:27:28 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Updating existing volume attachment record: 7a959af9-7599-4ae0-97ce-acf4fd4972c2 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:27:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:32 user nova-compute[73917]: DEBUG nova.objects.instance [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'pci_requests' on Instance uuid d30d366d-29cc-430b-ba31-bcbc08a364b7 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:27:32 user nova-compute[73917]: DEBUG nova.objects.instance [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'numa_topology' on Instance uuid d30d366d-29cc-430b-ba31-bcbc08a364b7 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:27:32 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:27:32 user nova-compute[73917]: INFO nova.compute.claims [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Claim successful on node user
Aug 26 19:27:33 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:27:33 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:27:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:33 user nova-compute[73917]: INFO nova.network.neutron [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Updating port 1f0ca324-9d6c-4696-a525-76d4ccc1df91 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 19:27:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:27:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquired lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:27:34 user nova-compute[73917]: DEBUG nova.network.neutron [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:27:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-d5f39d84-a5b2-4674-b095-27227425174a req-3385c726-8c2f-41c3-b57e-64d2568b3acb service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received event network-changed-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:27:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-d5f39d84-a5b2-4674-b095-27227425174a req-3385c726-8c2f-41c3-b57e-64d2568b3acb service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Refreshing instance network info cache due to event network-changed-1f0ca324-9d6c-4696-a525-76d4ccc1df91. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:27:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d5f39d84-a5b2-4674-b095-27227425174a req-3385c726-8c2f-41c3-b57e-64d2568b3acb service nova] Acquiring lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:27:35 user nova-compute[73917]: DEBUG nova.network.neutron [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Updating instance_info_cache with network_info: [{"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:27:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Releasing lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:27:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:27:35 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Creating image(s)
Aug 26 19:27:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "/opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "/opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "/opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:35 user nova-compute[73917]: DEBUG nova.objects.instance [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'trusted_certs' on Instance uuid d30d366d-29cc-430b-ba31-bcbc08a364b7 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:27:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d5f39d84-a5b2-4674-b095-27227425174a req-3385c726-8c2f-41c3-b57e-64d2568b3acb service nova] Acquired lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:27:35 user nova-compute[73917]: DEBUG nova.network.neutron [req-d5f39d84-a5b2-4674-b095-27227425174a req-3385c726-8c2f-41c3-b57e-64d2568b3acb service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Refreshing network info cache for port 1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:27:35 user nova-compute[73917]: DEBUG nova.objects.base [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Object Instance<d30d366d-29cc-430b-ba31-bcbc08a364b7> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:27:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "cbc888d70f98f24d319e3634d973c66baab75c53" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "cbc888d70f98f24d319e3634d973c66baab75c53" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc888d70f98f24d319e3634d973c66baab75c53.part --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc888d70f98f24d319e3634d973c66baab75c53.part --force-share --output=json" returned: 0 in 0.172s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:36 user nova-compute[73917]: DEBUG nova.virt.images [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] 68171b46-0d90-4244-af73-99ab801934c7 was qcow2, converting to raw {{(pid=73917) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 19:27:36 user nova-compute[73917]: DEBUG nova.privsep.utils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73917) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 19:27:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cbc888d70f98f24d319e3634d973c66baab75c53.part /opt/stack/data/nova/instances/_base/cbc888d70f98f24d319e3634d973c66baab75c53.converted {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cbc888d70f98f24d319e3634d973c66baab75c53.part /opt/stack/data/nova/instances/_base/cbc888d70f98f24d319e3634d973c66baab75c53.converted" returned: 0 in 0.236s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc888d70f98f24d319e3634d973c66baab75c53.converted --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:36 user nova-compute[73917]: DEBUG nova.network.neutron [req-d5f39d84-a5b2-4674-b095-27227425174a req-3385c726-8c2f-41c3-b57e-64d2568b3acb service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Updated VIF entry in instance network info cache for port 1f0ca324-9d6c-4696-a525-76d4ccc1df91. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:27:36 user nova-compute[73917]: DEBUG nova.network.neutron [req-d5f39d84-a5b2-4674-b095-27227425174a req-3385c726-8c2f-41c3-b57e-64d2568b3acb service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Updating instance_info_cache with network_info: [{"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:27:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d5f39d84-a5b2-4674-b095-27227425174a req-3385c726-8c2f-41c3-b57e-64d2568b3acb service nova] Releasing lock "refresh_cache-d30d366d-29cc-430b-ba31-bcbc08a364b7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:27:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc888d70f98f24d319e3634d973c66baab75c53.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "cbc888d70f98f24d319e3634d973c66baab75c53" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.578s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc888d70f98f24d319e3634d973c66baab75c53 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc888d70f98f24d319e3634d973c66baab75c53 --force-share --output=json" returned: 0 in 0.191s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "cbc888d70f98f24d319e3634d973c66baab75c53" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "cbc888d70f98f24d319e3634d973c66baab75c53" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc888d70f98f24d319e3634d973c66baab75c53 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc888d70f98f24d319e3634d973c66baab75c53 --force-share --output=json" returned: 0 in 0.178s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbc888d70f98f24d319e3634d973c66baab75c53,backing_fmt=raw /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbc888d70f98f24d319e3634d973c66baab75c53,backing_fmt=raw /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk 1073741824" returned: 0 in 0.048s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "cbc888d70f98f24d319e3634d973c66baab75c53" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc888d70f98f24d319e3634d973c66baab75c53 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc888d70f98f24d319e3634d973c66baab75c53 --force-share --output=json" returned: 0 in 0.172s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:37 user nova-compute[73917]: DEBUG nova.objects.instance [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'migration_context' on Instance uuid d30d366d-29cc-430b-ba31-bcbc08a364b7 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:27:37 user nova-compute[73917]: DEBUG nova.objects.base [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Object Instance<d30d366d-29cc-430b-ba31-bcbc08a364b7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:27:37 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Rebasing disk image.
Aug 26 19:27:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.186s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 -F raw /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:38 user nova-compute[73917]: INFO nova.compute.manager [None req-1a1837e8-1044-4639-8c58-9fe7e4e041c7 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Unrescuing
Aug 26 19:27:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a1837e8-1044-4639-8c58-9fe7e4e041c7 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "refresh_cache-c94a0ea3-5230-453b-959c-5d7689c408a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:27:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a1837e8-1044-4639-8c58-9fe7e4e041c7 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquired lock "refresh_cache-c94a0ea3-5230-453b-959c-5d7689c408a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:27:38 user nova-compute[73917]: DEBUG nova.network.neutron [None req-1a1837e8-1044-4639-8c58-9fe7e4e041c7 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:27:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:39 user nova-compute[73917]: DEBUG nova.network.neutron [None req-1a1837e8-1044-4639-8c58-9fe7e4e041c7 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Updating instance_info_cache with network_info: [{"id": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "address": "fa:16:3e:49:6c:5b", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d7c95e-7f", "ovs_interfaceid": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:27:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a1837e8-1044-4639-8c58-9fe7e4e041c7 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Releasing lock "refresh_cache-c94a0ea3-5230-453b-959c-5d7689c408a6" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:27:39 user nova-compute[73917]: DEBUG nova.objects.instance [None req-1a1837e8-1044-4639-8c58-9fe7e4e041c7 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'flavor' on Instance uuid c94a0ea3-5230-453b-959c-5d7689c408a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:27:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:39 user nova-compute[73917]: DEBUG nova.compute.manager [req-e5d2e9e8-39cc-46f2-8189-8aca505af73d req-a6c48938-2e8e-4663-9640-6111bf795139 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received event network-vif-unplugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:27:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e5d2e9e8-39cc-46f2-8189-8aca505af73d req-a6c48938-2e8e-4663-9640-6111bf795139 service nova] Acquiring lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e5d2e9e8-39cc-46f2-8189-8aca505af73d req-a6c48938-2e8e-4663-9640-6111bf795139 service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e5d2e9e8-39cc-46f2-8189-8aca505af73d req-a6c48938-2e8e-4663-9640-6111bf795139 service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:39 user nova-compute[73917]: DEBUG nova.compute.manager [req-e5d2e9e8-39cc-46f2-8189-8aca505af73d req-a6c48938-2e8e-4663-9640-6111bf795139 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] No waiting events found dispatching network-vif-unplugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:27:39 user nova-compute[73917]: WARNING nova.compute.manager [req-e5d2e9e8-39cc-46f2-8189-8aca505af73d req-a6c48938-2e8e-4663-9640-6111bf795139 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received unexpected event network-vif-unplugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:27:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 -F raw /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk" returned: 0 in 2.071s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Ensure instance console log exists: /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Start _get_guest_xml network_info=[{"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='96666a6ccb824ced9ada65d7d7c51607',container_format='bare',created_at=2023-08-26T19:25:17Z,direct_url=<?>,disk_format='qcow2',id=68171b46-0d90-4244-af73-99ab801934c7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-964308989-shelved',owner='96cf0ccd59944be6922b561ecddc7d5b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T19:25:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdXQSwZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'd30d366d-29cc-430b-ba31-bcbc08a364b7', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2a7ade3-b578-4feb-80e4-00b53c1d62ab', 'serial': 'c2a7ade3-b578-4feb-80e4-00b53c1d62ab'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'attachment_id': '92f29b55-f2b0-4843-9373-0b2331845b12', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:27:40 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:27:40 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:27:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:27:40 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Instance destroyed successfully.
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='96666a6ccb824ced9ada65d7d7c51607',container_format='bare',created_at=2023-08-26T19:25:17Z,direct_url=<?>,disk_format='qcow2',id=68171b46-0d90-4244-af73-99ab801934c7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-964308989-shelved',owner='96cf0ccd59944be6922b561ecddc7d5b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T19:25:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.objects.instance [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'vcpu_model' on Instance uuid d30d366d-29cc-430b-ba31-bcbc08a364b7 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.objects.base [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Object Instance<d30d366d-29cc-430b-ba31-bcbc08a364b7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdXQSwZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:27:40 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:27:40 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:27:40 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bcb4dc-5c7a-4a72-9e95-7a799f6af52c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:27:40 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70c37c2-edac-485e-8494-ac84be3ce465]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab] added
Aug 26 19:27:40 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4e44b3-53a9-4b3a-b684-eaf3d82da0be]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6353a9c2-7eba-4318-a4d7-688c54d0e86d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FdXQSwZA {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FdXQSwZA" returned: 0 in 0.039s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1128026-1d0d-42d9-baab-4d44ca84d5f6]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FdXQSwZA'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0413a0-79c9-4fb4-9599-6e9692031bfb]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5ceafc-f7d0-4f42-a876-df05794d791a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:27:40 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:27:40 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:27:40 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:27:40 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e9688d-1a9a-42e5-80af-297b33982501]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab, portal: 172.16.0.220,3260]
Aug 26 19:27:40 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab, portal: 172.16.0.220,3260] successful.
Aug 26 19:27:40 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b955801-f979-42c2-be19-17407fc36403]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4638e60f-0bb7-4be5-8997-dfc87148e91b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:27:40 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:27:40 user nova-compute[73917]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab (non-flash)
Aug 26 19:27:40 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:27:40 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:27:40 user nova-compute[73917]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab (non-flash)
Aug 26 19:27:40 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d95d42-b399-41fd-8353-f651ad59ad48]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:27:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdXQSwZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ciVqLfKg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:27:41 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:27:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23036326362376232', 'path': '/dev/sdd'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036326362376232', 'path': '/dev/sdd'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.571s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:27:41 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:27:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:27:41 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:27:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[665bc14c-9f84-4863-bde9-11f2c216593c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:27:41 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T19:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-964308989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-964308989',id=34,image_ref='68171b46-0d90-4244-af73-99ab801934c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-155698396',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:23:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='96cf0ccd59944be6922b561ecddc7d5b',ramdisk_id='',reservation_id='r-20m7bw3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1729132577',owner_user_name='tempest-AttachVolumeShelveTestJSON-1729132577-project-member',shelved_at='2023-08-26T19:25:20.952622',shelved_host='user',shelved_image_id='68171b46-0d90-4244-af73-99ab801934c7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:27:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860f7b92664e43d19c908f3bdb52d717',uuid=d30d366d-29cc-430b-ba31-bcbc08a364b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converting VIF {"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:8a:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f0ca324-9d6c-4696-a525-76d4ccc1df91,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0ca324-9d') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG nova.objects.instance [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'pci_devices' on Instance uuid d30d366d-29cc-430b-ba31-bcbc08a364b7 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1d2f98-7344-48a5-80b1-768f75244590]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef] added
Aug 26 19:27:41 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG nova.objects.base [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Object Instance<d30d366d-29cc-430b-ba31-bcbc08a364b7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:27:41 user nova-compute[73917]:   <uuid>d30d366d-29cc-430b-ba31-bcbc08a364b7</uuid>
Aug 26 19:27:41 user nova-compute[73917]:   <name>instance-00000022</name>
Aug 26 19:27:41 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:27:41 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:27:41 user nova-compute[73917]:   <metadata>
Aug 26 19:27:41 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:27:41 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:27:41 user nova-compute[73917]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-964308989</nova:name>
Aug 26 19:27:41 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:27:40</nova:creationTime>
Aug 26 19:27:41 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:27:41 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:27:41 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:27:41 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:27:41 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:27:41 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:27:41 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:27:41 user nova-compute[73917]:       <nova:owner>
Aug 26 19:27:41 user nova-compute[73917]:         <nova:user uuid="860f7b92664e43d19c908f3bdb52d717">tempest-AttachVolumeShelveTestJSON-1729132577-project-member</nova:user>
Aug 26 19:27:41 user nova-compute[73917]:         <nova:project uuid="96cf0ccd59944be6922b561ecddc7d5b">tempest-AttachVolumeShelveTestJSON-1729132577</nova:project>
Aug 26 19:27:41 user nova-compute[73917]:       </nova:owner>
Aug 26 19:27:41 user nova-compute[73917]:       <nova:root type="image" uuid="68171b46-0d90-4244-af73-99ab801934c7"/>
Aug 26 19:27:41 user nova-compute[73917]:       <nova:ports>
Aug 26 19:27:41 user nova-compute[73917]:         <nova:port uuid="1f0ca324-9d6c-4696-a525-76d4ccc1df91">
Aug 26 19:27:41 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 19:27:41 user nova-compute[73917]:         </nova:port>
Aug 26 19:27:41 user nova-compute[73917]:       </nova:ports>
Aug 26 19:27:41 user nova-compute[73917]:     </nova:instance>
Aug 26 19:27:41 user nova-compute[73917]:   </metadata>
Aug 26 19:27:41 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:27:41 user nova-compute[73917]:     <system>
Aug 26 19:27:41 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:27:41 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:27:41 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:27:41 user nova-compute[73917]:       <entry name="serial">d30d366d-29cc-430b-ba31-bcbc08a364b7</entry>
Aug 26 19:27:41 user nova-compute[73917]:       <entry name="uuid">d30d366d-29cc-430b-ba31-bcbc08a364b7</entry>
Aug 26 19:27:41 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:27:41 user nova-compute[73917]:     </system>
Aug 26 19:27:41 user nova-compute[73917]:   </sysinfo>
Aug 26 19:27:41 user nova-compute[73917]:   <os>
Aug 26 19:27:41 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:27:41 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:27:41 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:27:41 user nova-compute[73917]:   </os>
Aug 26 19:27:41 user nova-compute[73917]:   <features>
Aug 26 19:27:41 user nova-compute[73917]:     <acpi/>
Aug 26 19:27:41 user nova-compute[73917]:     <apic/>
Aug 26 19:27:41 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:27:41 user nova-compute[73917]:   </features>
Aug 26 19:27:41 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:27:41 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:27:41 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:27:41 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:27:41 user nova-compute[73917]:   </clock>
Aug 26 19:27:41 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:27:41 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:27:41 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:27:41 user nova-compute[73917]:   </cpu>
Aug 26 19:27:41 user nova-compute[73917]:   <devices>
Aug 26 19:27:41 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:27:41 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:27:41 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk"/>
Aug 26 19:27:41 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:27:41 user nova-compute[73917]:     </disk>
Aug 26 19:27:41 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:27:41 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:27:41 user nova-compute[73917]:       <source dev="/dev/sdd"/>
Aug 26 19:27:41 user nova-compute[73917]:       <target dev="vdc" bus="virtio"/>
Aug 26 19:27:41 user nova-compute[73917]:       <serial>c2a7ade3-b578-4feb-80e4-00b53c1d62ab</serial>
Aug 26 19:27:41 user nova-compute[73917]:     </disk>
Aug 26 19:27:41 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:27:41 user nova-compute[73917]:       <mac address="fa:16:3e:28:8a:f8"/>
Aug 26 19:27:41 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:27:41 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:27:41 user nova-compute[73917]:       <target dev="tap1f0ca324-9d"/>
Aug 26 19:27:41 user nova-compute[73917]:     </interface>
Aug 26 19:27:41 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:27:41 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/console.log" append="off"/>
Aug 26 19:27:41 user nova-compute[73917]:     </serial>
Aug 26 19:27:41 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:27:41 user nova-compute[73917]:     <video>
Aug 26 19:27:41 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:27:41 user nova-compute[73917]:     </video>
Aug 26 19:27:41 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:27:41 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:27:41 user nova-compute[73917]:     </rng>
Aug 26 19:27:41 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:27:41 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:27:41 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:27:41 user nova-compute[73917]:     </memballoon>
Aug 26 19:27:41 user nova-compute[73917]:   </devices>
Aug 26 19:27:41 user nova-compute[73917]: </domain>
Aug 26 19:27:41 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T19:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-964308989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-964308989',id=34,image_ref='68171b46-0d90-4244-af73-99ab801934c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-155698396',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:23:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='96cf0ccd59944be6922b561ecddc7d5b',ramdisk_id='',reservation_id='r-20m7bw3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1729132577',owner_user_name='tempest-AttachVolumeShelveTestJSON-1729132577-project-member',shelved_at='2023-08-26T19:25:20.952622',shelved_host='user',shelved_image_id='68171b46-0d90-4244-af73-99ab801934c7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:27:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860f7b92664e43d19c908f3bdb52d717',uuid=d30d366d-29cc-430b-ba31-bcbc08a364b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converting VIF {"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:8a:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f0ca324-9d6c-4696-a525-76d4ccc1df91,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0ca324-9d') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG os_vif [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:8a:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f0ca324-9d6c-4696-a525-76d4ccc1df91,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0ca324-9d') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f0ca324-9d, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f0ca324-9d, col_values=(('external_ids', {'iface-id': '1f0ca324-9d6c-4696-a525-76d4ccc1df91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:8a:f8', 'vm-uuid': 'd30d366d-29cc-430b-ba31-bcbc08a364b7'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cb4e31-2fb0-4a01-a7f4-322aafb93057]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG nova.compute.manager [req-00cd0048-a068-4625-8593-450553283f43 req-9e4ea68f-9a24-40c4-8d23-f1c12f3c2bb1 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-00cd0048-a068-4625-8593-450553283f43 req-9e4ea68f-9a24-40c4-8d23-f1c12f3c2bb1 service nova] Acquiring lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-00cd0048-a068-4625-8593-450553283f43 req-9e4ea68f-9a24-40c4-8d23-f1c12f3c2bb1 service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-00cd0048-a068-4625-8593-450553283f43 req-9e4ea68f-9a24-40c4-8d23-f1c12f3c2bb1 service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG nova.compute.manager [req-00cd0048-a068-4625-8593-450553283f43 req-9e4ea68f-9a24-40c4-8d23-f1c12f3c2bb1 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] No waiting events found dispatching network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:27:41 user nova-compute[73917]: WARNING nova.compute.manager [req-00cd0048-a068-4625-8593-450553283f43 req-9e4ea68f-9a24-40c4-8d23-f1c12f3c2bb1 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received unexpected event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:27:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:41 user nova-compute[73917]: INFO os_vif [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:8a:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f0ca324-9d6c-4696-a525-76d4ccc1df91,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0ca324-9d')
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a7d7c8-df4d-4a20-b2d9-ff7ad0055592]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ciVqLfKg {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ciVqLfKg" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[813ae2d2-4fd9-4ac7-946a-65ca50ba9ac3]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ciVqLfKg'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] No VIF found with MAC fa:16:3e:28:8a:f8, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd43feb7-84f6-4c24-b2cc-4e361855a274]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:27:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f66d68b-a210-45c1-8424-1d827ee7cc45]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:27:42 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:27:42 user nova-compute[73917]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab (non-flash)
Aug 26 19:27:42 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:27:42 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:27:42 user nova-compute[73917]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab (non-flash)
Aug 26 19:27:42 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[36033360-19eb-4ef4-9a04-7803e687f660]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef, portal: 172.16.0.220,3260]
Aug 26 19:27:42 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef, portal: 172.16.0.220,3260] successful.
Aug 26 19:27:42 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7e3e94-54bf-4102-8e4b-b0a4c475c917]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[640eec61-cfc6-41b9-8e1a-3073c7bde323]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:27:42 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:27:42 user nova-compute[73917]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab (non-flash)
Aug 26 19:27:42 user nova-compute[73917]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef (non-flash)
Aug 26 19:27:42 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:27:42 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:27:42 user nova-compute[73917]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab (non-flash)
Aug 26 19:27:42 user nova-compute[73917]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef (non-flash)
Aug 26 19:27:42 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea07eb55-5d50-4975-bca9-ee2e248ddb1c]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:27:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ciVqLfKg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:27:43 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:27:43 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] <== connect_volume: return (1971ms) {'type': 'block', 'scsi_wwn': '23434373733393464', 'path': '/dev/sde'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:27:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434373733393464', 'path': '/dev/sde'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:27:43 user nova-compute[73917]: DEBUG nova.objects.instance [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lazy-loading 'flavor' on Instance uuid fbc66439-479c-4818-a416-c3c64d49741d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:27:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:27:43 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:27:43 user nova-compute[73917]:   <source dev="/dev/sde"/>
Aug 26 19:27:43 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:27:43 user nova-compute[73917]:   <serial>567c1a3a-889a-4efa-bb27-a565c7718aef</serial>
Aug 26 19:27:43 user nova-compute[73917]: </disk>
Aug 26 19:27:43 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:27:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:44 user nova-compute[73917]: DEBUG nova.compute.manager [req-b9c4c9b4-4fe4-4947-8c4e-a86413334ab3 req-9b80b194-987f-4028-b3ff-afa873ba8dd2 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:27:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9c4c9b4-4fe4-4947-8c4e-a86413334ab3 req-9b80b194-987f-4028-b3ff-afa873ba8dd2 service nova] Acquiring lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9c4c9b4-4fe4-4947-8c4e-a86413334ab3 req-9b80b194-987f-4028-b3ff-afa873ba8dd2 service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9c4c9b4-4fe4-4947-8c4e-a86413334ab3 req-9b80b194-987f-4028-b3ff-afa873ba8dd2 service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:44 user nova-compute[73917]: DEBUG nova.compute.manager [req-b9c4c9b4-4fe4-4947-8c4e-a86413334ab3 req-9b80b194-987f-4028-b3ff-afa873ba8dd2 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] No waiting events found dispatching network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:27:44 user nova-compute[73917]: WARNING nova.compute.manager [req-b9c4c9b4-4fe4-4947-8c4e-a86413334ab3 req-9b80b194-987f-4028-b3ff-afa873ba8dd2 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received unexpected event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:27:44 user nova-compute[73917]: DEBUG nova.compute.manager [req-b9c4c9b4-4fe4-4947-8c4e-a86413334ab3 req-9b80b194-987f-4028-b3ff-afa873ba8dd2 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:27:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9c4c9b4-4fe4-4947-8c4e-a86413334ab3 req-9b80b194-987f-4028-b3ff-afa873ba8dd2 service nova] Acquiring lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9c4c9b4-4fe4-4947-8c4e-a86413334ab3 req-9b80b194-987f-4028-b3ff-afa873ba8dd2 service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9c4c9b4-4fe4-4947-8c4e-a86413334ab3 req-9b80b194-987f-4028-b3ff-afa873ba8dd2 service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:44 user nova-compute[73917]: DEBUG nova.compute.manager [req-b9c4c9b4-4fe4-4947-8c4e-a86413334ab3 req-9b80b194-987f-4028-b3ff-afa873ba8dd2 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] No waiting events found dispatching network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:27:44 user nova-compute[73917]: WARNING nova.compute.manager [req-b9c4c9b4-4fe4-4947-8c4e-a86413334ab3 req-9b80b194-987f-4028-b3ff-afa873ba8dd2 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received unexpected event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 for instance with vm_state rescued and task_state unrescuing.
Aug 26 19:27:44 user nova-compute[73917]: DEBUG nova.compute.manager [req-b9c4c9b4-4fe4-4947-8c4e-a86413334ab3 req-9b80b194-987f-4028-b3ff-afa873ba8dd2 service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received event network-vif-plugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:27:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9c4c9b4-4fe4-4947-8c4e-a86413334ab3 req-9b80b194-987f-4028-b3ff-afa873ba8dd2 service nova] Acquiring lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9c4c9b4-4fe4-4947-8c4e-a86413334ab3 req-9b80b194-987f-4028-b3ff-afa873ba8dd2 service nova] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9c4c9b4-4fe4-4947-8c4e-a86413334ab3 req-9b80b194-987f-4028-b3ff-afa873ba8dd2 service nova] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:44 user nova-compute[73917]: DEBUG nova.compute.manager [req-b9c4c9b4-4fe4-4947-8c4e-a86413334ab3 req-9b80b194-987f-4028-b3ff-afa873ba8dd2 service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] No waiting events found dispatching network-vif-plugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:27:44 user nova-compute[73917]: WARNING nova.compute.manager [req-b9c4c9b4-4fe4-4947-8c4e-a86413334ab3 req-9b80b194-987f-4028-b3ff-afa873ba8dd2 service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received unexpected event network-vif-plugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 19:27:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:27:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:27:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] No VIF found with MAC fa:16:3e:92:aa:c8, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:27:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-62fd015a-16da-4da3-b74c-4c9492e65d2b tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "fbc66439-479c-4818-a416-c3c64d49741d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.451s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:46 user nova-compute[73917]: DEBUG nova.compute.manager [req-345e28b0-d95f-4cca-8586-9694e98efcb5 req-7ea53c89-f03c-46fe-8ee5-786d182f010b service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received event network-vif-plugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:27:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-345e28b0-d95f-4cca-8586-9694e98efcb5 req-7ea53c89-f03c-46fe-8ee5-786d182f010b service nova] Acquiring lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-345e28b0-d95f-4cca-8586-9694e98efcb5 req-7ea53c89-f03c-46fe-8ee5-786d182f010b service nova] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-345e28b0-d95f-4cca-8586-9694e98efcb5 req-7ea53c89-f03c-46fe-8ee5-786d182f010b service nova] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:46 user nova-compute[73917]: DEBUG nova.compute.manager [req-345e28b0-d95f-4cca-8586-9694e98efcb5 req-7ea53c89-f03c-46fe-8ee5-786d182f010b service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] No waiting events found dispatching network-vif-plugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:27:46 user nova-compute[73917]: WARNING nova.compute.manager [req-345e28b0-d95f-4cca-8586-9694e98efcb5 req-7ea53c89-f03c-46fe-8ee5-786d182f010b service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received unexpected event network-vif-plugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 19:27:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Removed pending event for c94a0ea3-5230-453b-959c-5d7689c408a6 due to event {{(pid=73917) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 19:27:46 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078066.1486712, c94a0ea3-5230-453b-959c-5d7689c408a6 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:27:46 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] VM Resumed (Lifecycle Event)
Aug 26 19:27:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1a1837e8-1044-4639-8c58-9fe7e4e041c7 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:27:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:27:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:27:46 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 19:27:46 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078066.1528769, c94a0ea3-5230-453b-959c-5d7689c408a6 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:27:46 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] VM Started (Lifecycle Event)
Aug 26 19:27:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:27:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:27:46 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Instance spawned successfully.
Aug 26 19:27:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:27:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:27:46 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078066.2252574, d30d366d-29cc-430b-ba31-bcbc08a364b7 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:27:46 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] VM Resumed (Lifecycle Event)
Aug 26 19:27:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:27:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:27:46 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:27:46 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078066.2277105, d30d366d-29cc-430b-ba31-bcbc08a364b7 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:27:46 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] VM Started (Lifecycle Event)
Aug 26 19:27:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:27:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:27:46 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:27:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:27:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-712d6d41-bdde-4a33-b0b7-51457df6aa99 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 37.078s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "fbc66439-479c-4818-a416-c3c64d49741d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "fbc66439-479c-4818-a416-c3c64d49741d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:47 user nova-compute[73917]: INFO nova.compute.manager [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Detaching volume 567c1a3a-889a-4efa-bb27-a565c7718aef
Aug 26 19:27:47 user nova-compute[73917]: INFO nova.virt.block_device [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Attempting to driver detach volume 567c1a3a-889a-4efa-bb27-a565c7718aef from mountpoint /dev/vdb
Aug 26 19:27:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Attempting to detach device vdb from instance fbc66439-479c-4818-a416-c3c64d49741d from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:27:47 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:27:47 user nova-compute[73917]:   <source dev="/dev/sde"/>
Aug 26 19:27:47 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:27:47 user nova-compute[73917]:   <serial>567c1a3a-889a-4efa-bb27-a565c7718aef</serial>
Aug 26 19:27:47 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:27:47 user nova-compute[73917]: </disk>
Aug 26 19:27:47 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:27:47 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Successfully detached device vdb from instance fbc66439-479c-4818-a416-c3c64d49741d from the persistent domain config.
Aug 26 19:27:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fbc66439-479c-4818-a416-c3c64d49741d from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:27:47 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:27:47 user nova-compute[73917]:   <source dev="/dev/sde"/>
Aug 26 19:27:47 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:27:47 user nova-compute[73917]:   <serial>567c1a3a-889a-4efa-bb27-a565c7718aef</serial>
Aug 26 19:27:47 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:27:47 user nova-compute[73917]: </disk>
Aug 26 19:27:47 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693078067.7158682, fbc66439-479c-4818-a416-c3c64d49741d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fbc66439-479c-4818-a416-c3c64d49741d {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:27:47 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Successfully detached device vdb from instance fbc66439-479c-4818-a416-c3c64d49741d from the live domain config.
Aug 26 19:27:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ciVqLfKg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:27:47 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:27:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9c611b-dbaf-44d1-8dc6-e77fc9f136b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a852636d-b349-4378-aff7-f2690e562a60]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:27:47 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:27:47 user nova-compute[73917]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab (non-flash)
Aug 26 19:27:47 user nova-compute[73917]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef (non-flash)
Aug 26 19:27:47 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:27:47 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:27:47 user nova-compute[73917]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab (non-flash)
Aug 26 19:27:47 user nova-compute[73917]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef (non-flash)
Aug 26 19:27:47 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b983752d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef'): ({'sde'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Removing single pathed devices sde {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3e6bb8-9de2-4721-926f-31a944493f68]: (4, ('path checker states:\nup                  2\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2909f26e-b49c-4534-bd60-a171a031c771]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Flushing IO for device /dev/sde {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef18ac05-b660-4d0f-81d9-51c85945cc8f]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f115e59a-7b73-4ac9-9632-2c8e990adc87]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] SCSI volumes sde have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6e8661-833c-46c2-9cc6-d9f8ff548dfa]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7ca452-5ff1-4cd9-b66b-a08002588866]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef, portal: 172.16.0.220,3260]
Aug 26 19:27:48 user nova-compute[73917]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef, portal: 172.16.0.220,3260] successful.
Aug 26 19:27:48 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:27:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:27:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567c1a3a-889a-4efa-bb27-a565c7718aef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:27:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2ab4a4-91ff-42b3-bd17-98432db438dd]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:27:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:27:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:27:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] <== disconnect_volume: return (302ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:27:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:27:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:48 user nova-compute[73917]: DEBUG nova.objects.instance [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lazy-loading 'flavor' on Instance uuid fbc66439-479c-4818-a416-c3c64d49741d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:27:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3d2c4db5-492d-4ffb-b0f4-044d4a71a650 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "fbc66439-479c-4818-a416-c3c64d49741d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.903s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Acquiring lock "7270fe83-39ff-430d-b026-b8a1c4ea6976" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "7270fe83-39ff-430d-b026-b8a1c4ea6976" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Acquiring lock "7270fe83-39ff-430d-b026-b8a1c4ea6976-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "7270fe83-39ff-430d-b026-b8a1c4ea6976-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "7270fe83-39ff-430d-b026-b8a1c4ea6976-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:52 user nova-compute[73917]: INFO nova.compute.manager [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Terminating instance
Aug 26 19:27:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:27:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:52 user nova-compute[73917]: DEBUG nova.compute.manager [req-138a9c57-ac2e-46f3-8118-090479e42e23 req-2a9f31e3-5e40-4ad9-85c9-7c30ee402569 service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Received event network-vif-unplugged-31000cf6-e614-4dd5-bab1-1e1a439cd8e7 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:27:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-138a9c57-ac2e-46f3-8118-090479e42e23 req-2a9f31e3-5e40-4ad9-85c9-7c30ee402569 service nova] Acquiring lock "7270fe83-39ff-430d-b026-b8a1c4ea6976-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-138a9c57-ac2e-46f3-8118-090479e42e23 req-2a9f31e3-5e40-4ad9-85c9-7c30ee402569 service nova] Lock "7270fe83-39ff-430d-b026-b8a1c4ea6976-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-138a9c57-ac2e-46f3-8118-090479e42e23 req-2a9f31e3-5e40-4ad9-85c9-7c30ee402569 service nova] Lock "7270fe83-39ff-430d-b026-b8a1c4ea6976-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:52 user nova-compute[73917]: DEBUG nova.compute.manager [req-138a9c57-ac2e-46f3-8118-090479e42e23 req-2a9f31e3-5e40-4ad9-85c9-7c30ee402569 service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] No waiting events found dispatching network-vif-unplugged-31000cf6-e614-4dd5-bab1-1e1a439cd8e7 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:27:52 user nova-compute[73917]: DEBUG nova.compute.manager [req-138a9c57-ac2e-46f3-8118-090479e42e23 req-2a9f31e3-5e40-4ad9-85c9-7c30ee402569 service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Received event network-vif-unplugged-31000cf6-e614-4dd5-bab1-1e1a439cd8e7 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:27:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:53 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Instance destroyed successfully.
Aug 26 19:27:53 user nova-compute[73917]: DEBUG nova.objects.instance [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lazy-loading 'resources' on Instance uuid 7270fe83-39ff-430d-b026-b8a1c4ea6976 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:27:53 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:26:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-559723355',display_name='tempest-VolumesActionsTest-instance-559723355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-559723355',id=38,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:26:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd87078f3f3e47b687aacabf450e57c4',ramdisk_id='',reservation_id='r-w451qc4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1098860754',owner_user_name='tempest-VolumesActionsTest-1098860754-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:26:09Z,user_data=None,user_id='df632b88d11245bb9f3393d082e6527f',uuid=7270fe83-39ff-430d-b026-b8a1c4ea6976,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31000cf6-e614-4dd5-bab1-1e1a439cd8e7", "address": "fa:16:3e:74:19:dd", "network": {"id": "454de19a-252d-4f6b-95c4-5902bc4f0ba7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28701462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd87078f3f3e47b687aacabf450e57c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31000cf6-e6", "ovs_interfaceid": "31000cf6-e614-4dd5-bab1-1e1a439cd8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:27:53 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Converting VIF {"id": "31000cf6-e614-4dd5-bab1-1e1a439cd8e7", "address": "fa:16:3e:74:19:dd", "network": {"id": "454de19a-252d-4f6b-95c4-5902bc4f0ba7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28701462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd87078f3f3e47b687aacabf450e57c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31000cf6-e6", "ovs_interfaceid": "31000cf6-e614-4dd5-bab1-1e1a439cd8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:27:53 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:19:dd,bridge_name='br-int',has_traffic_filtering=True,id=31000cf6-e614-4dd5-bab1-1e1a439cd8e7,network=Network(454de19a-252d-4f6b-95c4-5902bc4f0ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31000cf6-e6') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:27:53 user nova-compute[73917]: DEBUG os_vif [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:19:dd,bridge_name='br-int',has_traffic_filtering=True,id=31000cf6-e614-4dd5-bab1-1e1a439cd8e7,network=Network(454de19a-252d-4f6b-95c4-5902bc4f0ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31000cf6-e6') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:27:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31000cf6-e6, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:27:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:53 user nova-compute[73917]: INFO os_vif [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:19:dd,bridge_name='br-int',has_traffic_filtering=True,id=31000cf6-e614-4dd5-bab1-1e1a439cd8e7,network=Network(454de19a-252d-4f6b-95c4-5902bc4f0ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31000cf6-e6')
Aug 26 19:27:53 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Deleting instance files /opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976_del
Aug 26 19:27:53 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Deletion of /opt/stack/data/nova/instances/7270fe83-39ff-430d-b026-b8a1c4ea6976_del complete
Aug 26 19:27:53 user nova-compute[73917]: INFO nova.compute.manager [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 26 19:27:53 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:27:53 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:27:53 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:27:53 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:27:53 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Took 0.54 seconds to deallocate network for instance.
Aug 26 19:27:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-fa1091c2-b7d6-44c4-873d-5d10d19a451f req-b39cb7cd-9c32-4c9c-847e-c9e84f9c2d98 service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Received event network-vif-deleted-31000cf6-e614-4dd5-bab1-1e1a439cd8e7 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:27:53 user nova-compute[73917]: INFO nova.compute.manager [req-fa1091c2-b7d6-44c4-873d-5d10d19a451f req-b39cb7cd-9c32-4c9c-847e-c9e84f9c2d98 service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Neutron deleted interface 31000cf6-e614-4dd5-bab1-1e1a439cd8e7; detaching it from the instance and deleting it from the info cache
Aug 26 19:27:53 user nova-compute[73917]: DEBUG nova.network.neutron [req-fa1091c2-b7d6-44c4-873d-5d10d19a451f req-b39cb7cd-9c32-4c9c-847e-c9e84f9c2d98 service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:27:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-fa1091c2-b7d6-44c4-873d-5d10d19a451f req-b39cb7cd-9c32-4c9c-847e-c9e84f9c2d98 service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Detach interface failed, port_id=31000cf6-e614-4dd5-bab1-1e1a439cd8e7, reason: Instance 7270fe83-39ff-430d-b026-b8a1c4ea6976 could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:27:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:54 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:27:54 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:27:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:54 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Deleted allocations for instance 7270fe83-39ff-430d-b026-b8a1c4ea6976
Aug 26 19:27:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-eecd5bfd-325d-425b-a3f4-a31073add65c tempest-VolumesActionsTest-1098860754 tempest-VolumesActionsTest-1098860754-project-member] Lock "7270fe83-39ff-430d-b026-b8a1c4ea6976" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.097s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:54 user nova-compute[73917]: DEBUG nova.compute.manager [req-88581a55-9d0b-4e58-ba60-5c6270d47b80 req-992f04a6-9677-44dd-932e-7ddeeb3a543a service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Received event network-vif-plugged-31000cf6-e614-4dd5-bab1-1e1a439cd8e7 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:27:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-88581a55-9d0b-4e58-ba60-5c6270d47b80 req-992f04a6-9677-44dd-932e-7ddeeb3a543a service nova] Acquiring lock "7270fe83-39ff-430d-b026-b8a1c4ea6976-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:27:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-88581a55-9d0b-4e58-ba60-5c6270d47b80 req-992f04a6-9677-44dd-932e-7ddeeb3a543a service nova] Lock "7270fe83-39ff-430d-b026-b8a1c4ea6976-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:27:54 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-88581a55-9d0b-4e58-ba60-5c6270d47b80 req-992f04a6-9677-44dd-932e-7ddeeb3a543a service nova] Lock "7270fe83-39ff-430d-b026-b8a1c4ea6976-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:27:54 user nova-compute[73917]: DEBUG nova.compute.manager [req-88581a55-9d0b-4e58-ba60-5c6270d47b80 req-992f04a6-9677-44dd-932e-7ddeeb3a543a service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] No waiting events found dispatching network-vif-plugged-31000cf6-e614-4dd5-bab1-1e1a439cd8e7 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:27:54 user nova-compute[73917]: WARNING nova.compute.manager [req-88581a55-9d0b-4e58-ba60-5c6270d47b80 req-992f04a6-9677-44dd-932e-7ddeeb3a543a service nova] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Received unexpected event network-vif-plugged-31000cf6-e614-4dd5-bab1-1e1a439cd8e7 for instance with vm_state deleted and task_state None.
Aug 26 19:27:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:27:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:05 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:28:05 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:28:05 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:28:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-94f8d4e7-f310-45df-a0ae-82e608ac0119" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:28:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-94f8d4e7-f310-45df-a0ae-82e608ac0119" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:28:05 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:28:05 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid 94f8d4e7-f310-45df-a0ae-82e608ac0119 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:28:05 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Updating instance_info_cache with network_info: [{"id": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "address": "fa:16:3e:45:49:40", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea31a0cf-61", "ovs_interfaceid": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:28:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-94f8d4e7-f310-45df-a0ae-82e608ac0119" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:28:05 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:28:05 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:28:05 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:28:06 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:28:06 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:28:06 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:28:06 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 19:28:06 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] There are 0 instances to clean {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 19:28:07 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:28:08 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693078073.1498168, 7270fe83-39ff-430d-b026-b8a1c4ea6976 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:28:08 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] VM Stopped (Lifecycle Event)
Aug 26 19:28:08 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ec20970b-4f65-414a-b5d8-0e9cd9f38cd8 None None] [instance: 7270fe83-39ff-430d-b026-b8a1c4ea6976] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:28:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:08 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:28:08 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:28:08 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73917) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 19:28:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:09 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:28:09 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:28:10 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:28:11 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:28:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:28:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:28:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:28:11 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:28:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:11 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:28:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:28:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:28:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:13 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:28:13 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:28:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8050MB free_disk=25.106815338134766GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:28:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:28:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:28:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 94f8d4e7-f310-45df-a0ae-82e608ac0119 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:28:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance df5c717a-62d8-444d-9968-ad682a31733c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:28:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance a4487be3-7267-4ae1-8731-a6bdf49a6070 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:28:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c94a0ea3-5230-453b-959c-5d7689c408a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:28:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fbc66439-479c-4818-a416-c3c64d49741d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:28:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance d30d366d-29cc-430b-ba31-bcbc08a364b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:28:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:28:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:28:13 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing inventories for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 19:28:13 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating ProviderTree inventory for provider d90ad23a-e063-4f0d-8341-c34e0141d16a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 19:28:13 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating inventory in ProviderTree for provider d90ad23a-e063-4f0d-8341-c34e0141d16a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 19:28:13 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing aggregate associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, aggregates: None {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 19:28:13 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing trait associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 19:28:14 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:28:14 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:28:14 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:28:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.799s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:28:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:28:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "2598d318-3080-4be3-a4f5-36b3f7d292b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:28:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "2598d318-3080-4be3-a4f5-36b3f7d292b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:28:28 user nova-compute[73917]: DEBUG nova.compute.manager [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:28:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:28:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:28:28 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:28:28 user nova-compute[73917]: INFO nova.compute.claims [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Claim successful on node user
Aug 26 19:28:29 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:28:29 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:28:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:28:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:28:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:28:29 user nova-compute[73917]: DEBUG nova.network.neutron [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:28:29 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:28:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:28:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:28:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:28:29 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Creating image(s)
Aug 26 19:28:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "/opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:28:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "/opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:28:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "/opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:28:29 user nova-compute[73917]: DEBUG nova.policy [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '714d650d67d74694b520329848fc88b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a44e229f9e4101bb1edf230efcf8bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:28:29 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:29 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.205s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:28:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:28:29 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:29 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.187s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:29 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0/disk 1073741824" returned: 0 in 0.051s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:28:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.170s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:30 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:28:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:30 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Cannot resize image /opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:28:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:28:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Ensure instance console log exists: /opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:28:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:28:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:28:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:28:30 user nova-compute[73917]: DEBUG nova.network.neutron [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Successfully created port: d99fa1fd-a7a0-4fbf-9b39-954d9be00027 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.network.neutron [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Successfully updated port: d99fa1fd-a7a0-4fbf-9b39-954d9be00027 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "refresh_cache-2598d318-3080-4be3-a4f5-36b3f7d292b0" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquired lock "refresh_cache-2598d318-3080-4be3-a4f5-36b3f7d292b0" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.network.neutron [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.network.neutron [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-cb2fe7c3-f198-447a-a6bf-cddaf100ee4c req-19e50689-2709-447c-a9a5-6c9f08eabc0e service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Received event network-changed-d99fa1fd-a7a0-4fbf-9b39-954d9be00027 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-cb2fe7c3-f198-447a-a6bf-cddaf100ee4c req-19e50689-2709-447c-a9a5-6c9f08eabc0e service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Refreshing instance network info cache due to event network-changed-d99fa1fd-a7a0-4fbf-9b39-954d9be00027. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cb2fe7c3-f198-447a-a6bf-cddaf100ee4c req-19e50689-2709-447c-a9a5-6c9f08eabc0e service nova] Acquiring lock "refresh_cache-2598d318-3080-4be3-a4f5-36b3f7d292b0" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.network.neutron [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Updating instance_info_cache with network_info: [{"id": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "address": "fa:16:3e:ac:7b:eb", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99fa1fd-a7", "ovs_interfaceid": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Releasing lock "refresh_cache-2598d318-3080-4be3-a4f5-36b3f7d292b0" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Instance network_info: |[{"id": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "address": "fa:16:3e:ac:7b:eb", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99fa1fd-a7", "ovs_interfaceid": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cb2fe7c3-f198-447a-a6bf-cddaf100ee4c req-19e50689-2709-447c-a9a5-6c9f08eabc0e service nova] Acquired lock "refresh_cache-2598d318-3080-4be3-a4f5-36b3f7d292b0" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.network.neutron [req-cb2fe7c3-f198-447a-a6bf-cddaf100ee4c req-19e50689-2709-447c-a9a5-6c9f08eabc0e service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Refreshing network info cache for port d99fa1fd-a7a0-4fbf-9b39-954d9be00027 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Start _get_guest_xml network_info=[{"id": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "address": "fa:16:3e:ac:7b:eb", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99fa1fd-a7", "ovs_interfaceid": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:28:31 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:28:31 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1342186890',display_name='tempest-VolumesSnapshotTestJSON-instance-1342186890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1342186890',id=39,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4Ifi6rBY9orjFbfIvVvCIefhAlGW8HG0Vp+dsu7nkSbbnxa+dplGoPrRYys/y5XoV7H6dvBxiyzA8ZIvfOat2x4aCBxSLHTzWkQGMOyEe+4HMFYyEu2yuV9U3FxW7jHw==',key_name='tempest-keypair-397506445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02a44e229f9e4101bb1edf230efcf8bd',ramdisk_id='',reservation_id='r-y0frzvku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1190045200',owner_user_name='tempest-VolumesSnapshotTestJSON-1190045200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:28:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='714d650d67d74694b520329848fc88b7',uuid=2598d318-3080-4be3-a4f5-36b3f7d292b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "address": "fa:16:3e:ac:7b:eb", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99fa1fd-a7", "ovs_interfaceid": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Converting VIF {"id": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "address": "fa:16:3e:ac:7b:eb", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99fa1fd-a7", "ovs_interfaceid": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:7b:eb,bridge_name='br-int',has_traffic_filtering=True,id=d99fa1fd-a7a0-4fbf-9b39-954d9be00027,network=Network(b47e702d-90fc-48c8-bdef-274729c534a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99fa1fd-a7') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.objects.instance [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lazy-loading 'pci_devices' on Instance uuid 2598d318-3080-4be3-a4f5-36b3f7d292b0 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:28:31 user nova-compute[73917]:   <uuid>2598d318-3080-4be3-a4f5-36b3f7d292b0</uuid>
Aug 26 19:28:31 user nova-compute[73917]:   <name>instance-00000027</name>
Aug 26 19:28:31 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:28:31 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:28:31 user nova-compute[73917]:   <metadata>
Aug 26 19:28:31 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:28:31 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:28:31 user nova-compute[73917]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1342186890</nova:name>
Aug 26 19:28:31 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:28:31</nova:creationTime>
Aug 26 19:28:31 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:28:31 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:28:31 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:28:31 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:28:31 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:28:31 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:28:31 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:28:31 user nova-compute[73917]:       <nova:owner>
Aug 26 19:28:31 user nova-compute[73917]:         <nova:user uuid="714d650d67d74694b520329848fc88b7">tempest-VolumesSnapshotTestJSON-1190045200-project-member</nova:user>
Aug 26 19:28:31 user nova-compute[73917]:         <nova:project uuid="02a44e229f9e4101bb1edf230efcf8bd">tempest-VolumesSnapshotTestJSON-1190045200</nova:project>
Aug 26 19:28:31 user nova-compute[73917]:       </nova:owner>
Aug 26 19:28:31 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:28:31 user nova-compute[73917]:       <nova:ports>
Aug 26 19:28:31 user nova-compute[73917]:         <nova:port uuid="d99fa1fd-a7a0-4fbf-9b39-954d9be00027">
Aug 26 19:28:31 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 19:28:31 user nova-compute[73917]:         </nova:port>
Aug 26 19:28:31 user nova-compute[73917]:       </nova:ports>
Aug 26 19:28:31 user nova-compute[73917]:     </nova:instance>
Aug 26 19:28:31 user nova-compute[73917]:   </metadata>
Aug 26 19:28:31 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:28:31 user nova-compute[73917]:     <system>
Aug 26 19:28:31 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:28:31 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:28:31 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:28:31 user nova-compute[73917]:       <entry name="serial">2598d318-3080-4be3-a4f5-36b3f7d292b0</entry>
Aug 26 19:28:31 user nova-compute[73917]:       <entry name="uuid">2598d318-3080-4be3-a4f5-36b3f7d292b0</entry>
Aug 26 19:28:31 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:28:31 user nova-compute[73917]:     </system>
Aug 26 19:28:31 user nova-compute[73917]:   </sysinfo>
Aug 26 19:28:31 user nova-compute[73917]:   <os>
Aug 26 19:28:31 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:28:31 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:28:31 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:28:31 user nova-compute[73917]:   </os>
Aug 26 19:28:31 user nova-compute[73917]:   <features>
Aug 26 19:28:31 user nova-compute[73917]:     <acpi/>
Aug 26 19:28:31 user nova-compute[73917]:     <apic/>
Aug 26 19:28:31 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:28:31 user nova-compute[73917]:   </features>
Aug 26 19:28:31 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:28:31 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:28:31 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:28:31 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:28:31 user nova-compute[73917]:   </clock>
Aug 26 19:28:31 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:28:31 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:28:31 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:28:31 user nova-compute[73917]:   </cpu>
Aug 26 19:28:31 user nova-compute[73917]:   <devices>
Aug 26 19:28:31 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:28:31 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:28:31 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0/disk"/>
Aug 26 19:28:31 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:28:31 user nova-compute[73917]:     </disk>
Aug 26 19:28:31 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:28:31 user nova-compute[73917]:       <mac address="fa:16:3e:ac:7b:eb"/>
Aug 26 19:28:31 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:28:31 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:28:31 user nova-compute[73917]:       <target dev="tapd99fa1fd-a7"/>
Aug 26 19:28:31 user nova-compute[73917]:     </interface>
Aug 26 19:28:31 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:28:31 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0/console.log" append="off"/>
Aug 26 19:28:31 user nova-compute[73917]:     </serial>
Aug 26 19:28:31 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:28:31 user nova-compute[73917]:     <video>
Aug 26 19:28:31 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:28:31 user nova-compute[73917]:     </video>
Aug 26 19:28:31 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:28:31 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:28:31 user nova-compute[73917]:     </rng>
Aug 26 19:28:31 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:28:31 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:28:31 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:28:31 user nova-compute[73917]:     </memballoon>
Aug 26 19:28:31 user nova-compute[73917]:   </devices>
Aug 26 19:28:31 user nova-compute[73917]: </domain>
Aug 26 19:28:31 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1342186890',display_name='tempest-VolumesSnapshotTestJSON-instance-1342186890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1342186890',id=39,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4Ifi6rBY9orjFbfIvVvCIefhAlGW8HG0Vp+dsu7nkSbbnxa+dplGoPrRYys/y5XoV7H6dvBxiyzA8ZIvfOat2x4aCBxSLHTzWkQGMOyEe+4HMFYyEu2yuV9U3FxW7jHw==',key_name='tempest-keypair-397506445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02a44e229f9e4101bb1edf230efcf8bd',ramdisk_id='',reservation_id='r-y0frzvku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1190045200',owner_user_name='tempest-VolumesSnapshotTestJSON-1190045200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:28:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='714d650d67d74694b520329848fc88b7',uuid=2598d318-3080-4be3-a4f5-36b3f7d292b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "address": "fa:16:3e:ac:7b:eb", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99fa1fd-a7", "ovs_interfaceid": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Converting VIF {"id": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "address": "fa:16:3e:ac:7b:eb", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99fa1fd-a7", "ovs_interfaceid": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:7b:eb,bridge_name='br-int',has_traffic_filtering=True,id=d99fa1fd-a7a0-4fbf-9b39-954d9be00027,network=Network(b47e702d-90fc-48c8-bdef-274729c534a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99fa1fd-a7') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG os_vif [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:7b:eb,bridge_name='br-int',has_traffic_filtering=True,id=d99fa1fd-a7a0-4fbf-9b39-954d9be00027,network=Network(b47e702d-90fc-48c8-bdef-274729c534a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99fa1fd-a7') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd99fa1fd-a7, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd99fa1fd-a7, col_values=(('external_ids', {'iface-id': 'd99fa1fd-a7a0-4fbf-9b39-954d9be00027', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:7b:eb', 'vm-uuid': '2598d318-3080-4be3-a4f5-36b3f7d292b0'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:31 user nova-compute[73917]: INFO os_vif [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:7b:eb,bridge_name='br-int',has_traffic_filtering=True,id=d99fa1fd-a7a0-4fbf-9b39-954d9be00027,network=Network(b47e702d-90fc-48c8-bdef-274729c534a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99fa1fd-a7')
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:28:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] No VIF found with MAC fa:16:3e:ac:7b:eb, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:28:32 user nova-compute[73917]: DEBUG nova.network.neutron [req-cb2fe7c3-f198-447a-a6bf-cddaf100ee4c req-19e50689-2709-447c-a9a5-6c9f08eabc0e service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Updated VIF entry in instance network info cache for port d99fa1fd-a7a0-4fbf-9b39-954d9be00027. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:28:32 user nova-compute[73917]: DEBUG nova.network.neutron [req-cb2fe7c3-f198-447a-a6bf-cddaf100ee4c req-19e50689-2709-447c-a9a5-6c9f08eabc0e service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Updating instance_info_cache with network_info: [{"id": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "address": "fa:16:3e:ac:7b:eb", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99fa1fd-a7", "ovs_interfaceid": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:28:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cb2fe7c3-f198-447a-a6bf-cddaf100ee4c req-19e50689-2709-447c-a9a5-6c9f08eabc0e service nova] Releasing lock "refresh_cache-2598d318-3080-4be3-a4f5-36b3f7d292b0" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:28:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-066e62c2-02b6-41f4-884e-460dbf94af13 req-3189f3d7-e6dd-4213-86bf-7e54b07e1ef6 service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Received event network-vif-plugged-d99fa1fd-a7a0-4fbf-9b39-954d9be00027 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:28:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-066e62c2-02b6-41f4-884e-460dbf94af13 req-3189f3d7-e6dd-4213-86bf-7e54b07e1ef6 service nova] Acquiring lock "2598d318-3080-4be3-a4f5-36b3f7d292b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:28:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-066e62c2-02b6-41f4-884e-460dbf94af13 req-3189f3d7-e6dd-4213-86bf-7e54b07e1ef6 service nova] Lock "2598d318-3080-4be3-a4f5-36b3f7d292b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:28:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-066e62c2-02b6-41f4-884e-460dbf94af13 req-3189f3d7-e6dd-4213-86bf-7e54b07e1ef6 service nova] Lock "2598d318-3080-4be3-a4f5-36b3f7d292b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:28:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-066e62c2-02b6-41f4-884e-460dbf94af13 req-3189f3d7-e6dd-4213-86bf-7e54b07e1ef6 service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] No waiting events found dispatching network-vif-plugged-d99fa1fd-a7a0-4fbf-9b39-954d9be00027 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:28:33 user nova-compute[73917]: WARNING nova.compute.manager [req-066e62c2-02b6-41f4-884e-460dbf94af13 req-3189f3d7-e6dd-4213-86bf-7e54b07e1ef6 service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Received unexpected event network-vif-plugged-d99fa1fd-a7a0-4fbf-9b39-954d9be00027 for instance with vm_state building and task_state spawning.
Aug 26 19:28:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:35 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078115.3793867, 2598d318-3080-4be3-a4f5-36b3f7d292b0 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:28:35 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] VM Resumed (Lifecycle Event)
Aug 26 19:28:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:28:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:28:35 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Instance spawned successfully.
Aug 26 19:28:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:28:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:28:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:28:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:28:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:28:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:28:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:28:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:28:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:28:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-7d2448e7-e168-4eb9-b58e-5b4bcff6d079 req-d6a017ce-6b19-4ead-acf1-58a3f62142ba service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Received event network-vif-plugged-d99fa1fd-a7a0-4fbf-9b39-954d9be00027 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:28:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-7d2448e7-e168-4eb9-b58e-5b4bcff6d079 req-d6a017ce-6b19-4ead-acf1-58a3f62142ba service nova] Acquiring lock "2598d318-3080-4be3-a4f5-36b3f7d292b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:28:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-7d2448e7-e168-4eb9-b58e-5b4bcff6d079 req-d6a017ce-6b19-4ead-acf1-58a3f62142ba service nova] Lock "2598d318-3080-4be3-a4f5-36b3f7d292b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:28:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-7d2448e7-e168-4eb9-b58e-5b4bcff6d079 req-d6a017ce-6b19-4ead-acf1-58a3f62142ba service nova] Lock "2598d318-3080-4be3-a4f5-36b3f7d292b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:28:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-7d2448e7-e168-4eb9-b58e-5b4bcff6d079 req-d6a017ce-6b19-4ead-acf1-58a3f62142ba service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] No waiting events found dispatching network-vif-plugged-d99fa1fd-a7a0-4fbf-9b39-954d9be00027 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:28:35 user nova-compute[73917]: WARNING nova.compute.manager [req-7d2448e7-e168-4eb9-b58e-5b4bcff6d079 req-d6a017ce-6b19-4ead-acf1-58a3f62142ba service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Received unexpected event network-vif-plugged-d99fa1fd-a7a0-4fbf-9b39-954d9be00027 for instance with vm_state building and task_state spawning.
Aug 26 19:28:35 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:28:35 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078115.3814332, 2598d318-3080-4be3-a4f5-36b3f7d292b0 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:28:35 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] VM Started (Lifecycle Event)
Aug 26 19:28:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:28:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:28:35 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:28:35 user nova-compute[73917]: INFO nova.compute.manager [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Took 5.98 seconds to spawn the instance on the hypervisor.
Aug 26 19:28:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:28:35 user nova-compute[73917]: INFO nova.compute.manager [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Took 6.65 seconds to build instance.
Aug 26 19:28:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-709644bd-d1d9-43c7-882e-14d61f0f7158 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "2598d318-3080-4be3-a4f5-36b3f7d292b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.744s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:28:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:47 user nova-compute[73917]: DEBUG nova.compute.manager [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:28:47 user nova-compute[73917]: INFO nova.compute.manager [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] instance snapshotting
Aug 26 19:28:47 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Beginning live snapshot process
Aug 26 19:28:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json -f qcow2 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json -f qcow2 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9o_45jni/33d4110309064e23826376984c762045.delta 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9o_45jni/33d4110309064e23826376984c762045.delta 1073741824" returned: 0 in 0.055s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:48 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 19:28:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:28:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] COPY block job progress, current cursor: 47644672 final cursor: 75563008 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:28:50 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73917) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 19:28:50 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 19:28:50 user nova-compute[73917]: DEBUG nova.privsep.utils [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73917) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 19:28:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9o_45jni/33d4110309064e23826376984c762045.delta /opt/stack/data/nova/instances/snapshots/tmp9o_45jni/33d4110309064e23826376984c762045 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9o_45jni/33d4110309064e23826376984c762045.delta /opt/stack/data/nova/instances/snapshots/tmp9o_45jni/33d4110309064e23826376984c762045" returned: 0 in 0.431s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:51 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Snapshot extracted, beginning image upload
Aug 26 19:28:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:28:53 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Snapshot image upload complete
Aug 26 19:28:53 user nova-compute[73917]: INFO nova.compute.manager [None req-e84c0962-2e19-4e6e-bcc2-e83f327ff3cd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Took 5.77 seconds to snapshot the instance on the hypervisor.
Aug 26 19:28:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "d3dba60d-88f1-473c-abb8-44d35e2b6964" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:28:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "d3dba60d-88f1-473c-abb8-44d35e2b6964" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:28:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:28:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:28:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:28:56 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:28:56 user nova-compute[73917]: INFO nova.compute.claims [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Claim successful on node user
Aug 26 19:28:56 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:28:56 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:28:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:28:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:28:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:28:56 user nova-compute[73917]: DEBUG nova.network.neutron [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:28:56 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:28:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:28:56 user nova-compute[73917]: DEBUG nova.policy [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22f87b69a0fb471f9ec5373b208d3abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e307e771e354caa99ff68b73b842743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:28:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:28:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:28:56 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Creating image(s)
Aug 26 19:28:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:28:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "/opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:28:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "/opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:28:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "443169b47763960834782dca0d9a58662f0bc9a3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:28:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "443169b47763960834782dca0d9a58662f0bc9a3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:28:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443169b47763960834782dca0d9a58662f0bc9a3.part --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:57 user nova-compute[73917]: DEBUG nova.network.neutron [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Successfully created port: 7221da13-0718-4966-b23a-69b49c853426 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:28:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443169b47763960834782dca0d9a58662f0bc9a3.part --force-share --output=json" returned: 0 in 0.201s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:57 user nova-compute[73917]: DEBUG nova.virt.images [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] 99786710-af44-44c9-90d0-0eaa01f98867 was qcow2, converting to raw {{(pid=73917) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 19:28:57 user nova-compute[73917]: DEBUG nova.privsep.utils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73917) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 19:28:57 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/443169b47763960834782dca0d9a58662f0bc9a3.part /opt/stack/data/nova/instances/_base/443169b47763960834782dca0d9a58662f0bc9a3.converted {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/443169b47763960834782dca0d9a58662f0bc9a3.part /opt/stack/data/nova/instances/_base/443169b47763960834782dca0d9a58662f0bc9a3.converted" returned: 0 in 0.253s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443169b47763960834782dca0d9a58662f0bc9a3.converted --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443169b47763960834782dca0d9a58662f0bc9a3.converted --force-share --output=json" returned: 0 in 0.234s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "443169b47763960834782dca0d9a58662f0bc9a3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.540s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443169b47763960834782dca0d9a58662f0bc9a3 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443169b47763960834782dca0d9a58662f0bc9a3 --force-share --output=json" returned: 0 in 0.175s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "443169b47763960834782dca0d9a58662f0bc9a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "443169b47763960834782dca0d9a58662f0bc9a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443169b47763960834782dca0d9a58662f0bc9a3 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG nova.network.neutron [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Successfully updated port: 7221da13-0718-4966-b23a-69b49c853426 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "refresh_cache-d3dba60d-88f1-473c-abb8-44d35e2b6964" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquired lock "refresh_cache-d3dba60d-88f1-473c-abb8-44d35e2b6964" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG nova.network.neutron [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG nova.compute.manager [req-44227aa6-68e3-44ae-9339-f8ee24b17a40 req-f64dbd64-adec-4556-9aec-a4dad235eb01 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Received event network-changed-7221da13-0718-4966-b23a-69b49c853426 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG nova.compute.manager [req-44227aa6-68e3-44ae-9339-f8ee24b17a40 req-f64dbd64-adec-4556-9aec-a4dad235eb01 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Refreshing instance network info cache due to event network-changed-7221da13-0718-4966-b23a-69b49c853426. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-44227aa6-68e3-44ae-9339-f8ee24b17a40 req-f64dbd64-adec-4556-9aec-a4dad235eb01 service nova] Acquiring lock "refresh_cache-d3dba60d-88f1-473c-abb8-44d35e2b6964" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443169b47763960834782dca0d9a58662f0bc9a3 --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443169b47763960834782dca0d9a58662f0bc9a3,backing_fmt=raw /opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG nova.network.neutron [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443169b47763960834782dca0d9a58662f0bc9a3,backing_fmt=raw /opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964/disk 1073741824" returned: 0 in 0.053s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "443169b47763960834782dca0d9a58662f0bc9a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443169b47763960834782dca0d9a58662f0bc9a3 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443169b47763960834782dca0d9a58662f0bc9a3 --force-share --output=json" returned: 0 in 0.173s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Ensure instance console log exists: /opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:28:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.network.neutron [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Updating instance_info_cache with network_info: [{"id": "7221da13-0718-4966-b23a-69b49c853426", "address": "fa:16:3e:bf:b3:2c", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221da13-07", "ovs_interfaceid": "7221da13-0718-4966-b23a-69b49c853426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Releasing lock "refresh_cache-d3dba60d-88f1-473c-abb8-44d35e2b6964" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Instance network_info: |[{"id": "7221da13-0718-4966-b23a-69b49c853426", "address": "fa:16:3e:bf:b3:2c", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221da13-07", "ovs_interfaceid": "7221da13-0718-4966-b23a-69b49c853426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-44227aa6-68e3-44ae-9339-f8ee24b17a40 req-f64dbd64-adec-4556-9aec-a4dad235eb01 service nova] Acquired lock "refresh_cache-d3dba60d-88f1-473c-abb8-44d35e2b6964" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.network.neutron [req-44227aa6-68e3-44ae-9339-f8ee24b17a40 req-f64dbd64-adec-4556-9aec-a4dad235eb01 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Refreshing network info cache for port 7221da13-0718-4966-b23a-69b49c853426 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Start _get_guest_xml network_info=[{"id": "7221da13-0718-4966-b23a-69b49c853426", "address": "fa:16:3e:bf:b3:2c", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221da13-07", "ovs_interfaceid": "7221da13-0718-4966-b23a-69b49c853426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='9ea5582b09dca7d17d8e3ae59186a2b4',container_format='bare',created_at=2023-08-26T19:28:48Z,direct_url=<?>,disk_format='qcow2',id=99786710-af44-44c9-90d0-0eaa01f98867,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-941916477',owner='4e307e771e354caa99ff68b73b842743',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T19:28:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '99786710-af44-44c9-90d0-0eaa01f98867'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:28:59 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:28:59 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9ea5582b09dca7d17d8e3ae59186a2b4',container_format='bare',created_at=2023-08-26T19:28:48Z,direct_url=<?>,disk_format='qcow2',id=99786710-af44-44c9-90d0-0eaa01f98867,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-941916477',owner='4e307e771e354caa99ff68b73b842743',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T19:28:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:28:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-67211559',display_name='tempest-TestStampPattern-server-67211559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-67211559',id=40,image_ref='99786710-af44-44c9-90d0-0eaa01f98867',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3qikrHaZv1b57+PYsAMrjbGE8666IZRULu8TbUkxpO21qNoIsGBqbZ/2lTZ8QJOtcHXsoQIRIproBK4xx57gBXc3m4j4E+STy5i75C4teNDHC5iYRzQB7oXEceIdSncQ==',key_name='tempest-TestStampPattern-235197864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e307e771e354caa99ff68b73b842743',ramdisk_id='',reservation_id='r-5z20wjer',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fbc66439-479c-4818-a416-c3c64d49741d',image_min_disk='1',image_min_ram='0',image_owner_id='4e307e771e354caa99ff68b73b842743',image_owner_project_name='tempest-TestStampPattern-432009003',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-432009003-project-member',image_user_id='22f87b69a0fb471f9ec5373b208d3abc',network_allocated='True',owner_project_name='tempest-TestStampPattern-432009003',owner_user_name='tempest-TestStampPattern-432009003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:28:57Z,user_data=None,user_id='22f87b69a0fb471f9ec5373b208d3abc',uuid=d3dba60d-88f1-473c-abb8-44d35e2b6964,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7221da13-0718-4966-b23a-69b49c853426", "address": "fa:16:3e:bf:b3:2c", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221da13-07", "ovs_interfaceid": "7221da13-0718-4966-b23a-69b49c853426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Converting VIF {"id": "7221da13-0718-4966-b23a-69b49c853426", "address": "fa:16:3e:bf:b3:2c", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221da13-07", "ovs_interfaceid": "7221da13-0718-4966-b23a-69b49c853426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b3:2c,bridge_name='br-int',has_traffic_filtering=True,id=7221da13-0718-4966-b23a-69b49c853426,network=Network(1cf7828d-2911-4253-bc82-d0fa6677f746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7221da13-07') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.objects.instance [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lazy-loading 'pci_devices' on Instance uuid d3dba60d-88f1-473c-abb8-44d35e2b6964 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:28:59 user nova-compute[73917]:   <uuid>d3dba60d-88f1-473c-abb8-44d35e2b6964</uuid>
Aug 26 19:28:59 user nova-compute[73917]:   <name>instance-00000028</name>
Aug 26 19:28:59 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:28:59 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:28:59 user nova-compute[73917]:   <metadata>
Aug 26 19:28:59 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:28:59 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:28:59 user nova-compute[73917]:       <nova:name>tempest-TestStampPattern-server-67211559</nova:name>
Aug 26 19:28:59 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:28:59</nova:creationTime>
Aug 26 19:28:59 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:28:59 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:28:59 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:28:59 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:28:59 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:28:59 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:28:59 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:28:59 user nova-compute[73917]:       <nova:owner>
Aug 26 19:28:59 user nova-compute[73917]:         <nova:user uuid="22f87b69a0fb471f9ec5373b208d3abc">tempest-TestStampPattern-432009003-project-member</nova:user>
Aug 26 19:28:59 user nova-compute[73917]:         <nova:project uuid="4e307e771e354caa99ff68b73b842743">tempest-TestStampPattern-432009003</nova:project>
Aug 26 19:28:59 user nova-compute[73917]:       </nova:owner>
Aug 26 19:28:59 user nova-compute[73917]:       <nova:root type="image" uuid="99786710-af44-44c9-90d0-0eaa01f98867"/>
Aug 26 19:28:59 user nova-compute[73917]:       <nova:ports>
Aug 26 19:28:59 user nova-compute[73917]:         <nova:port uuid="7221da13-0718-4966-b23a-69b49c853426">
Aug 26 19:28:59 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 19:28:59 user nova-compute[73917]:         </nova:port>
Aug 26 19:28:59 user nova-compute[73917]:       </nova:ports>
Aug 26 19:28:59 user nova-compute[73917]:     </nova:instance>
Aug 26 19:28:59 user nova-compute[73917]:   </metadata>
Aug 26 19:28:59 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:28:59 user nova-compute[73917]:     <system>
Aug 26 19:28:59 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:28:59 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:28:59 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:28:59 user nova-compute[73917]:       <entry name="serial">d3dba60d-88f1-473c-abb8-44d35e2b6964</entry>
Aug 26 19:28:59 user nova-compute[73917]:       <entry name="uuid">d3dba60d-88f1-473c-abb8-44d35e2b6964</entry>
Aug 26 19:28:59 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:28:59 user nova-compute[73917]:     </system>
Aug 26 19:28:59 user nova-compute[73917]:   </sysinfo>
Aug 26 19:28:59 user nova-compute[73917]:   <os>
Aug 26 19:28:59 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:28:59 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:28:59 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:28:59 user nova-compute[73917]:   </os>
Aug 26 19:28:59 user nova-compute[73917]:   <features>
Aug 26 19:28:59 user nova-compute[73917]:     <acpi/>
Aug 26 19:28:59 user nova-compute[73917]:     <apic/>
Aug 26 19:28:59 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:28:59 user nova-compute[73917]:   </features>
Aug 26 19:28:59 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:28:59 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:28:59 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:28:59 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:28:59 user nova-compute[73917]:   </clock>
Aug 26 19:28:59 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:28:59 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:28:59 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:28:59 user nova-compute[73917]:   </cpu>
Aug 26 19:28:59 user nova-compute[73917]:   <devices>
Aug 26 19:28:59 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:28:59 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:28:59 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964/disk"/>
Aug 26 19:28:59 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:28:59 user nova-compute[73917]:     </disk>
Aug 26 19:28:59 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:28:59 user nova-compute[73917]:       <mac address="fa:16:3e:bf:b3:2c"/>
Aug 26 19:28:59 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:28:59 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:28:59 user nova-compute[73917]:       <target dev="tap7221da13-07"/>
Aug 26 19:28:59 user nova-compute[73917]:     </interface>
Aug 26 19:28:59 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:28:59 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964/console.log" append="off"/>
Aug 26 19:28:59 user nova-compute[73917]:     </serial>
Aug 26 19:28:59 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:28:59 user nova-compute[73917]:     <video>
Aug 26 19:28:59 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:28:59 user nova-compute[73917]:     </video>
Aug 26 19:28:59 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:28:59 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:28:59 user nova-compute[73917]:     </rng>
Aug 26 19:28:59 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:28:59 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:28:59 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:28:59 user nova-compute[73917]:     </memballoon>
Aug 26 19:28:59 user nova-compute[73917]:   </devices>
Aug 26 19:28:59 user nova-compute[73917]: </domain>
Aug 26 19:28:59 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:28:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-67211559',display_name='tempest-TestStampPattern-server-67211559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-67211559',id=40,image_ref='99786710-af44-44c9-90d0-0eaa01f98867',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3qikrHaZv1b57+PYsAMrjbGE8666IZRULu8TbUkxpO21qNoIsGBqbZ/2lTZ8QJOtcHXsoQIRIproBK4xx57gBXc3m4j4E+STy5i75C4teNDHC5iYRzQB7oXEceIdSncQ==',key_name='tempest-TestStampPattern-235197864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e307e771e354caa99ff68b73b842743',ramdisk_id='',reservation_id='r-5z20wjer',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fbc66439-479c-4818-a416-c3c64d49741d',image_min_disk='1',image_min_ram='0',image_owner_id='4e307e771e354caa99ff68b73b842743',image_owner_project_name='tempest-TestStampPattern-432009003',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-432009003-project-member',image_user_id='22f87b69a0fb471f9ec5373b208d3abc',network_allocated='True',owner_project_name='tempest-TestStampPattern-432009003',owner_user_name='tempest-TestStampPattern-432009003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:28:57Z,user_data=None,user_id='22f87b69a0fb471f9ec5373b208d3abc',uuid=d3dba60d-88f1-473c-abb8-44d35e2b6964,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7221da13-0718-4966-b23a-69b49c853426", "address": "fa:16:3e:bf:b3:2c", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221da13-07", "ovs_interfaceid": "7221da13-0718-4966-b23a-69b49c853426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Converting VIF {"id": "7221da13-0718-4966-b23a-69b49c853426", "address": "fa:16:3e:bf:b3:2c", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221da13-07", "ovs_interfaceid": "7221da13-0718-4966-b23a-69b49c853426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b3:2c,bridge_name='br-int',has_traffic_filtering=True,id=7221da13-0718-4966-b23a-69b49c853426,network=Network(1cf7828d-2911-4253-bc82-d0fa6677f746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7221da13-07') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG os_vif [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b3:2c,bridge_name='br-int',has_traffic_filtering=True,id=7221da13-0718-4966-b23a-69b49c853426,network=Network(1cf7828d-2911-4253-bc82-d0fa6677f746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7221da13-07') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7221da13-07, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7221da13-07, col_values=(('external_ids', {'iface-id': '7221da13-0718-4966-b23a-69b49c853426', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:b3:2c', 'vm-uuid': 'd3dba60d-88f1-473c-abb8-44d35e2b6964'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:28:59 user nova-compute[73917]: INFO os_vif [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b3:2c,bridge_name='br-int',has_traffic_filtering=True,id=7221da13-0718-4966-b23a-69b49c853426,network=Network(1cf7828d-2911-4253-bc82-d0fa6677f746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7221da13-07')
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] No VIF found with MAC fa:16:3e:bf:b3:2c, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.network.neutron [req-44227aa6-68e3-44ae-9339-f8ee24b17a40 req-f64dbd64-adec-4556-9aec-a4dad235eb01 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Updated VIF entry in instance network info cache for port 7221da13-0718-4966-b23a-69b49c853426. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.network.neutron [req-44227aa6-68e3-44ae-9339-f8ee24b17a40 req-f64dbd64-adec-4556-9aec-a4dad235eb01 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Updating instance_info_cache with network_info: [{"id": "7221da13-0718-4966-b23a-69b49c853426", "address": "fa:16:3e:bf:b3:2c", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221da13-07", "ovs_interfaceid": "7221da13-0718-4966-b23a-69b49c853426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-44227aa6-68e3-44ae-9339-f8ee24b17a40 req-f64dbd64-adec-4556-9aec-a4dad235eb01 service nova] Releasing lock "refresh_cache-d3dba60d-88f1-473c-abb8-44d35e2b6964" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "d30d366d-29cc-430b-ba31-bcbc08a364b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:28:59 user nova-compute[73917]: INFO nova.compute.manager [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Detaching volume c2a7ade3-b578-4feb-80e4-00b53c1d62ab
Aug 26 19:28:59 user nova-compute[73917]: INFO nova.virt.block_device [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Attempting to driver detach volume c2a7ade3-b578-4feb-80e4-00b53c1d62ab from mountpoint /dev/vdc
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Attempting to detach device vdc from instance d30d366d-29cc-430b-ba31-bcbc08a364b7 from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:28:59 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:28:59 user nova-compute[73917]:   <source dev="/dev/sdd"/>
Aug 26 19:28:59 user nova-compute[73917]:   <target dev="vdc" bus="virtio"/>
Aug 26 19:28:59 user nova-compute[73917]:   <serial>c2a7ade3-b578-4feb-80e4-00b53c1d62ab</serial>
Aug 26 19:28:59 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 19:28:59 user nova-compute[73917]: </disk>
Aug 26 19:28:59 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:28:59 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Successfully detached device vdc from instance d30d366d-29cc-430b-ba31-bcbc08a364b7 from the persistent domain config.
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d30d366d-29cc-430b-ba31-bcbc08a364b7 from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:28:59 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:28:59 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:28:59 user nova-compute[73917]:   <source dev="/dev/sdd"/>
Aug 26 19:28:59 user nova-compute[73917]:   <target dev="vdc" bus="virtio"/>
Aug 26 19:28:59 user nova-compute[73917]:   <serial>c2a7ade3-b578-4feb-80e4-00b53c1d62ab</serial>
Aug 26 19:28:59 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 19:28:59 user nova-compute[73917]: </disk>
Aug 26 19:28:59 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693078140.2510288, d30d366d-29cc-430b-ba31-bcbc08a364b7 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d30d366d-29cc-430b-ba31-bcbc08a364b7 {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:29:00 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Successfully detached device vdc from instance d30d366d-29cc-430b-ba31-bcbc08a364b7 from the live domain config.
Aug 26 19:29:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdXQSwZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:29:00 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:29:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb93cc94-bedd-4134-9b99-384727492e41]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18f4dbf2-28de-40d9-b017-ad67cf667d35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dcdf53-f649-4214-b1ee-0e8b2fd753a0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f4dbf2-28de-40d9-b017-ad67cf667d35 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:29:00 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:29:00 user nova-compute[73917]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab (non-flash)
Aug 26 19:29:00 user nova-compute[73917]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f4dbf2-28de-40d9-b017-ad67cf667d35 (non-flash)
Aug 26 19:29:00 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:29:00 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:29:00 user nova-compute[73917]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab (non-flash)
Aug 26 19:29:00 user nova-compute[73917]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f4dbf2-28de-40d9-b017-ad67cf667d35 (non-flash)
Aug 26 19:29:00 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b78479ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab'): ({'sdd'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Removing single pathed devices sdd {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6f0087-2db8-46aa-8ebf-2d0e47a007cf]: (4, ('path checker states:\nup                  2\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a275c6-ddb9-4963-970c-430caf421e6b]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Flushing IO for device /dev/sdd {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1e24ad-2774-4232-b831-7cbd54dda195]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e019db65-3957-446f-bc3f-19a7a7050f76]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] SCSI volumes sdd have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb3e560-ad8f-4464-a801-a16decd56521]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[159777b1-85bc-42f1-8411-3feb6d7a52dd]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab, portal: 172.16.0.220,3260]
Aug 26 19:29:00 user nova-compute[73917]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab, portal: 172.16.0.220,3260] successful.
Aug 26 19:29:00 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a7ade3-b578-4feb-80e4-00b53c1d62ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[703e2eb2-6116-4f8c-a2fb-f7962b0a32c9]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] <== disconnect_volume: return (297ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:01 user nova-compute[73917]: DEBUG nova.compute.manager [req-6d2f1bdd-5b55-404f-961e-361b9a4f8eee req-55d631bb-f07b-4d5b-8f8b-a02919b76e09 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Received event network-vif-plugged-7221da13-0718-4966-b23a-69b49c853426 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:29:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d2f1bdd-5b55-404f-961e-361b9a4f8eee req-55d631bb-f07b-4d5b-8f8b-a02919b76e09 service nova] Acquiring lock "d3dba60d-88f1-473c-abb8-44d35e2b6964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d2f1bdd-5b55-404f-961e-361b9a4f8eee req-55d631bb-f07b-4d5b-8f8b-a02919b76e09 service nova] Lock "d3dba60d-88f1-473c-abb8-44d35e2b6964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d2f1bdd-5b55-404f-961e-361b9a4f8eee req-55d631bb-f07b-4d5b-8f8b-a02919b76e09 service nova] Lock "d3dba60d-88f1-473c-abb8-44d35e2b6964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:01 user nova-compute[73917]: DEBUG nova.compute.manager [req-6d2f1bdd-5b55-404f-961e-361b9a4f8eee req-55d631bb-f07b-4d5b-8f8b-a02919b76e09 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] No waiting events found dispatching network-vif-plugged-7221da13-0718-4966-b23a-69b49c853426 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:29:01 user nova-compute[73917]: WARNING nova.compute.manager [req-6d2f1bdd-5b55-404f-961e-361b9a4f8eee req-55d631bb-f07b-4d5b-8f8b-a02919b76e09 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Received unexpected event network-vif-plugged-7221da13-0718-4966-b23a-69b49c853426 for instance with vm_state building and task_state spawning.
Aug 26 19:29:01 user nova-compute[73917]: DEBUG nova.objects.instance [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'flavor' on Instance uuid d30d366d-29cc-430b-ba31-bcbc08a364b7 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:29:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1764a61b-7b73-46cf-b4a6-7f5fc2502ff2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.845s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:03 user nova-compute[73917]: DEBUG nova.compute.manager [req-319f07b2-c89d-446d-a392-f04236b5f07c req-3725f14e-4aed-4c27-b27e-9fef36e95746 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Received event network-vif-plugged-7221da13-0718-4966-b23a-69b49c853426 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:29:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-319f07b2-c89d-446d-a392-f04236b5f07c req-3725f14e-4aed-4c27-b27e-9fef36e95746 service nova] Acquiring lock "d3dba60d-88f1-473c-abb8-44d35e2b6964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-319f07b2-c89d-446d-a392-f04236b5f07c req-3725f14e-4aed-4c27-b27e-9fef36e95746 service nova] Lock "d3dba60d-88f1-473c-abb8-44d35e2b6964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-319f07b2-c89d-446d-a392-f04236b5f07c req-3725f14e-4aed-4c27-b27e-9fef36e95746 service nova] Lock "d3dba60d-88f1-473c-abb8-44d35e2b6964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:03 user nova-compute[73917]: DEBUG nova.compute.manager [req-319f07b2-c89d-446d-a392-f04236b5f07c req-3725f14e-4aed-4c27-b27e-9fef36e95746 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] No waiting events found dispatching network-vif-plugged-7221da13-0718-4966-b23a-69b49c853426 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:29:03 user nova-compute[73917]: WARNING nova.compute.manager [req-319f07b2-c89d-446d-a392-f04236b5f07c req-3725f14e-4aed-4c27-b27e-9fef36e95746 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Received unexpected event network-vif-plugged-7221da13-0718-4966-b23a-69b49c853426 for instance with vm_state building and task_state spawning.
Aug 26 19:29:03 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078143.6254241, d3dba60d-88f1-473c-abb8-44d35e2b6964 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:29:03 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] VM Resumed (Lifecycle Event)
Aug 26 19:29:03 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:29:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:29:03 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Instance spawned successfully.
Aug 26 19:29:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:29:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:29:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:29:03 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:29:03 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:29:03 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:29:03 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078143.6306074, d3dba60d-88f1-473c-abb8-44d35e2b6964 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:29:03 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] VM Started (Lifecycle Event)
Aug 26 19:29:03 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:29:03 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:29:03 user nova-compute[73917]: INFO nova.compute.manager [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Took 7.02 seconds to spawn the instance on the hypervisor.
Aug 26 19:29:03 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:29:03 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:29:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:03 user nova-compute[73917]: INFO nova.compute.manager [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Took 7.86 seconds to build instance.
Aug 26 19:29:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9b99632f-e4b0-4aec-abe3-42e9c6e269fd tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "d3dba60d-88f1-473c-abb8-44d35e2b6964" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.021s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:09 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:29:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:29:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-df5c717a-62d8-444d-9968-ad682a31733c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:29:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-df5c717a-62d8-444d-9968-ad682a31733c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:29:09 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:29:09 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Updating instance_info_cache with network_info: [{"id": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "address": "fa:16:3e:ca:39:fd", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79ade91-3e", "ovs_interfaceid": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:29:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-df5c717a-62d8-444d-9968-ad682a31733c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:29:10 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:29:10 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:29:10 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:29:10 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:29:10 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:29:10 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:29:10 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:29:10 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:29:12 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:29:12 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:29:12 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:29:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:12 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:29:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.424s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:29:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:29:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:16 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:29:16 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:29:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=7783MB free_disk=24.08551788330078GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:29:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 94f8d4e7-f310-45df-a0ae-82e608ac0119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:29:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance df5c717a-62d8-444d-9968-ad682a31733c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:29:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance a4487be3-7267-4ae1-8731-a6bdf49a6070 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:29:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance c94a0ea3-5230-453b-959c-5d7689c408a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:29:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fbc66439-479c-4818-a416-c3c64d49741d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:29:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance d30d366d-29cc-430b-ba31-bcbc08a364b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:29:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 2598d318-3080-4be3-a4f5-36b3f7d292b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:29:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance d3dba60d-88f1-473c-abb8-44d35e2b6964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:29:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:29:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:29:16 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:29:16 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:29:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:29:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.554s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:29:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "c94a0ea3-5230-453b-959c-5d7689c408a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:30 user nova-compute[73917]: INFO nova.compute.manager [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Terminating instance
Aug 26 19:29:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:29:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-92284492-0680-424f-90e0-3364fe9ec720 req-f610971a-6216-4b2c-8281-954b68ae9327 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received event network-vif-unplugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-92284492-0680-424f-90e0-3364fe9ec720 req-f610971a-6216-4b2c-8281-954b68ae9327 service nova] Acquiring lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-92284492-0680-424f-90e0-3364fe9ec720 req-f610971a-6216-4b2c-8281-954b68ae9327 service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-92284492-0680-424f-90e0-3364fe9ec720 req-f610971a-6216-4b2c-8281-954b68ae9327 service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-92284492-0680-424f-90e0-3364fe9ec720 req-f610971a-6216-4b2c-8281-954b68ae9327 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] No waiting events found dispatching network-vif-unplugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-92284492-0680-424f-90e0-3364fe9ec720 req-f610971a-6216-4b2c-8281-954b68ae9327 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received event network-vif-unplugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:31 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Instance destroyed successfully.
Aug 26 19:29:31 user nova-compute[73917]: DEBUG nova.objects.instance [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'resources' on Instance uuid c94a0ea3-5230-453b-959c-5d7689c408a6 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:23:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-111348542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-111348542',id=35,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:25:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68229e3ed72a45fa8c2c9a33780479ce',ramdisk_id='',reservation_id='r-3pi0cwrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:27:46Z,user_data=None,user_id='e056c4ed5a18427a8fd1eaa6a3a795c0',uuid=c94a0ea3-5230-453b-959c-5d7689c408a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "address": "fa:16:3e:49:6c:5b", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d7c95e-7f", "ovs_interfaceid": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converting VIF {"id": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "address": "fa:16:3e:49:6c:5b", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d7c95e-7f", "ovs_interfaceid": "07d7c95e-7fc7-4390-9b2d-000e93a3c889", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:6c:5b,bridge_name='br-int',has_traffic_filtering=True,id=07d7c95e-7fc7-4390-9b2d-000e93a3c889,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d7c95e-7f') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG os_vif [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:6c:5b,bridge_name='br-int',has_traffic_filtering=True,id=07d7c95e-7fc7-4390-9b2d-000e93a3c889,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d7c95e-7f') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07d7c95e-7f, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:29:31 user nova-compute[73917]: INFO os_vif [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:6c:5b,bridge_name='br-int',has_traffic_filtering=True,id=07d7c95e-7fc7-4390-9b2d-000e93a3c889,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d7c95e-7f')
Aug 26 19:29:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkAzYZFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:29:31 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:29:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b2f19c-d113-4a18-a516-94f50845c7d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdba6c6-92ac-4255-b0f8-4459c1b1c844]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:29:31 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:29:31 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:29:31 user nova-compute[73917]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 (non-flash)
Aug 26 19:29:31 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6ba8094af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1'): ({'sdc'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Removing single pathed devices sdc {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca507761-393e-4265-9911-28cf7dc17f03]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9815a6d0-a612-411f-9571-c4da106e629c]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Flushing IO for device /dev/sdc {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[68524fab-1dfa-47d6-9357-ecee0799704b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a7f553-8deb-4d1b-816f-802979980b74]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOfe775b37-ea1fb1fdfa74602e', '/dev/disk/by-id/scsi-26561316662316664', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fe775b37') {{(pid=85467) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b418ce4-df18-4f2c-9fb6-301a805b0c0b]: (4, None) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cac7989-4cfa-4a29-ab5b-9af0a3d50eba]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[085e1c8c-1977-434e-8c12-7dedb70d696b]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1, portal: 172.16.0.220,3260]
Aug 26 19:29:31 user nova-compute[73917]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1, portal: 172.16.0.220,3260] successful.
Aug 26 19:29:31 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66bbdc9d-8da4-4b8b-bce8-71881d15aff1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1453d37-1927-4374-91cf-e2bcd7e67ee0]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] <== disconnect_volume: return (368ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:29:31 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Deleting instance files /opt/stack/data/nova/instances/c94a0ea3-5230-453b-959c-5d7689c408a6_del
Aug 26 19:29:31 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Deletion of /opt/stack/data/nova/instances/c94a0ea3-5230-453b-959c-5d7689c408a6_del complete
Aug 26 19:29:31 user nova-compute[73917]: INFO nova.compute.manager [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Took 1.39 seconds to destroy the instance on the hypervisor.
Aug 26 19:29:31 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:29:31 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:29:32 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:29:32 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Took 0.61 seconds to deallocate network for instance.
Aug 26 19:29:32 user nova-compute[73917]: DEBUG nova.compute.manager [req-71d3766b-e5b7-401e-b621-7408b9719ffc req-de8528d0-7e00-4c4a-882a-1734b02eaf3c service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received event network-vif-deleted-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:29:32 user nova-compute[73917]: INFO nova.compute.manager [req-71d3766b-e5b7-401e-b621-7408b9719ffc req-de8528d0-7e00-4c4a-882a-1734b02eaf3c service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Neutron deleted interface 07d7c95e-7fc7-4390-9b2d-000e93a3c889; detaching it from the instance and deleting it from the info cache
Aug 26 19:29:32 user nova-compute[73917]: DEBUG nova.network.neutron [req-71d3766b-e5b7-401e-b621-7408b9719ffc req-de8528d0-7e00-4c4a-882a-1734b02eaf3c service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:29:32 user nova-compute[73917]: DEBUG nova.compute.manager [req-71d3766b-e5b7-401e-b621-7408b9719ffc req-de8528d0-7e00-4c4a-882a-1734b02eaf3c service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Detach interface failed, port_id=07d7c95e-7fc7-4390-9b2d-000e93a3c889, reason: Instance c94a0ea3-5230-453b-959c-5d7689c408a6 could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:29:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-b57bc243-d2aa-4d1d-a0bb-8441b2429f9c req-92cd7203-5e50-4fda-8ad6-2f404a2e3da4 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:29:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b57bc243-d2aa-4d1d-a0bb-8441b2429f9c req-92cd7203-5e50-4fda-8ad6-2f404a2e3da4 service nova] Acquiring lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b57bc243-d2aa-4d1d-a0bb-8441b2429f9c req-92cd7203-5e50-4fda-8ad6-2f404a2e3da4 service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b57bc243-d2aa-4d1d-a0bb-8441b2429f9c req-92cd7203-5e50-4fda-8ad6-2f404a2e3da4 service nova] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-b57bc243-d2aa-4d1d-a0bb-8441b2429f9c req-92cd7203-5e50-4fda-8ad6-2f404a2e3da4 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] No waiting events found dispatching network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:29:33 user nova-compute[73917]: WARNING nova.compute.manager [req-b57bc243-d2aa-4d1d-a0bb-8441b2429f9c req-92cd7203-5e50-4fda-8ad6-2f404a2e3da4 service nova] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Received unexpected event network-vif-plugged-07d7c95e-7fc7-4390-9b2d-000e93a3c889 for instance with vm_state active and task_state deleting.
Aug 26 19:29:33 user nova-compute[73917]: INFO nova.compute.manager [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Took 0.78 seconds to detach 1 volumes for instance.
Aug 26 19:29:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:33 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:29:33 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:29:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:33 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Deleted allocations for instance c94a0ea3-5230-453b-959c-5d7689c408a6
Aug 26 19:29:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5b31774e-d341-48d6-8cc0-396ba4bb87f2 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "c94a0ea3-5230-453b-959c-5d7689c408a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.243s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:46 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693078171.266742, c94a0ea3-5230-453b-959c-5d7689c408a6 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:29:46 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] VM Stopped (Lifecycle Event)
Aug 26 19:29:46 user nova-compute[73917]: DEBUG nova.compute.manager [None req-565d9f5b-d082-43a8-b627-1afaac65f9f7 None None] [instance: c94a0ea3-5230-453b-959c-5d7689c408a6] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:29:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:48 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:29:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:29:48 user nova-compute[73917]: INFO nova.compute.claims [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Claim successful on node user
Aug 26 19:29:49 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:29:49 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:29:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:29:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:29:49 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:29:49 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:29:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:29:49 user nova-compute[73917]: DEBUG nova.policy [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00d8fe7c07284b06985746a92c11f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c87f2fad4648bf90baef68e16d6a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:29:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:29:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:29:49 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Creating image(s)
Aug 26 19:29:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "/opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "/opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "/opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "b1fedbf48dd65aa173b8f7c7389cc1f3639f996f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "b1fedbf48dd65aa173b8f7c7389cc1f3639f996f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f.part --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f.part --force-share --output=json" returned: 0 in 0.175s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:49 user nova-compute[73917]: DEBUG nova.virt.images [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] f67140e5-e503-4aed-830e-32289bf444d2 was qcow2, converting to raw {{(pid=73917) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 19:29:49 user nova-compute[73917]: DEBUG nova.privsep.utils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73917) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f.part /opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f.converted {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Successfully created port: 511b289f-3048-493d-b658-e31546805791 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "d30d366d-29cc-430b-ba31-bcbc08a364b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:50 user nova-compute[73917]: INFO nova.compute.manager [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Terminating instance
Aug 26 19:29:50 user nova-compute[73917]: DEBUG nova.compute.manager [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f.part /opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f.converted" returned: 0 in 0.215s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f.converted --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "b1fedbf48dd65aa173b8f7c7389cc1f3639f996f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.975s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG nova.compute.manager [req-b77fb13f-6d79-4f5f-bea8-3f9d36026e91 req-24ec0d10-5bd8-4e52-9834-d44d97866830 service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received event network-vif-unplugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b77fb13f-6d79-4f5f-bea8-3f9d36026e91 req-24ec0d10-5bd8-4e52-9834-d44d97866830 service nova] Acquiring lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b77fb13f-6d79-4f5f-bea8-3f9d36026e91 req-24ec0d10-5bd8-4e52-9834-d44d97866830 service nova] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b77fb13f-6d79-4f5f-bea8-3f9d36026e91 req-24ec0d10-5bd8-4e52-9834-d44d97866830 service nova] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG nova.compute.manager [req-b77fb13f-6d79-4f5f-bea8-3f9d36026e91 req-24ec0d10-5bd8-4e52-9834-d44d97866830 service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] No waiting events found dispatching network-vif-unplugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG nova.compute.manager [req-b77fb13f-6d79-4f5f-bea8-3f9d36026e91 req-24ec0d10-5bd8-4e52-9834-d44d97866830 service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received event network-vif-unplugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f --force-share --output=json" returned: 0 in 0.201s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "b1fedbf48dd65aa173b8f7c7389cc1f3639f996f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "b1fedbf48dd65aa173b8f7c7389cc1f3639f996f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f --force-share --output=json" returned: 0 in 0.196s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f,backing_fmt=raw /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f,backing_fmt=raw /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk 1073741824" returned: 0 in 0.049s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "b1fedbf48dd65aa173b8f7c7389cc1f3639f996f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:50 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:51 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Instance destroyed successfully.
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.objects.instance [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'resources' on Instance uuid d30d366d-29cc-430b-ba31-bcbc08a364b7 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T19:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-964308989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-964308989',id=34,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5d2onuE0v30gwQ4jEufsRWsMY9TbeRWCKYhMnLNiMI80L3e0eEOgGqkVXeCPKdIjnmHflpdmV0MEYeorM+PucSxkA0rIt+i+3QFAvGXmJiVZo59qiKSMAVCLwSImOgXQ==',key_name='tempest-keypair-155698396',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:27:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96cf0ccd59944be6922b561ecddc7d5b',ramdisk_id='',reservation_id='r-20m7bw3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1729132577',owner_user_name='tempest-AttachVolumeShelveTestJSON-1729132577-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:27:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860f7b92664e43d19c908f3bdb52d717',uuid=d30d366d-29cc-430b-ba31-bcbc08a364b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converting VIF {"id": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "address": "fa:16:3e:28:8a:f8", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0ca324-9d", "ovs_interfaceid": "1f0ca324-9d6c-4696-a525-76d4ccc1df91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:8a:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f0ca324-9d6c-4696-a525-76d4ccc1df91,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0ca324-9d') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG os_vif [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:8a:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f0ca324-9d6c-4696-a525-76d4ccc1df91,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0ca324-9d') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f0ca324-9d, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:29:51 user nova-compute[73917]: INFO os_vif [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:8a:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f0ca324-9d6c-4696-a525-76d4ccc1df91,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0ca324-9d')
Aug 26 19:29:51 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Deleting instance files /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7_del
Aug 26 19:29:51 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Deletion of /opt/stack/data/nova/instances/d30d366d-29cc-430b-ba31-bcbc08a364b7_del complete
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Successfully updated port: 511b289f-3048-493d-b658-e31546805791 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f --force-share --output=json" returned: 0 in 0.186s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-1a4c2265-7d2e-4bbb-839c-1ba433569c98 req-99b6ab8c-442f-4b09-91b5-9ca4abbd4abd service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received event network-changed-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-1a4c2265-7d2e-4bbb-839c-1ba433569c98 req-99b6ab8c-442f-4b09-91b5-9ca4abbd4abd service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Refreshing instance network info cache due to event network-changed-511b289f-3048-493d-b658-e31546805791. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1a4c2265-7d2e-4bbb-839c-1ba433569c98 req-99b6ab8c-442f-4b09-91b5-9ca4abbd4abd service nova] Acquiring lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1a4c2265-7d2e-4bbb-839c-1ba433569c98 req-99b6ab8c-442f-4b09-91b5-9ca4abbd4abd service nova] Acquired lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.network.neutron [req-1a4c2265-7d2e-4bbb-839c-1ba433569c98 req-99b6ab8c-442f-4b09-91b5-9ca4abbd4abd service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Refreshing network info cache for port 511b289f-3048-493d-b658-e31546805791 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:29:51 user nova-compute[73917]: INFO nova.compute.manager [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 26 19:29:51 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.network.neutron [req-1a4c2265-7d2e-4bbb-839c-1ba433569c98 req-99b6ab8c-442f-4b09-91b5-9ca4abbd4abd service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Cannot resize image /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Ensure instance console log exists: /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.network.neutron [req-1a4c2265-7d2e-4bbb-839c-1ba433569c98 req-99b6ab8c-442f-4b09-91b5-9ca4abbd4abd service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1a4c2265-7d2e-4bbb-839c-1ba433569c98 req-99b6ab8c-442f-4b09-91b5-9ca4abbd4abd service nova] Releasing lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquired lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.network.neutron [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Updating instance_info_cache with network_info: [{"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Releasing lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Instance network_info: |[{"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Start _get_guest_xml network_info=[{"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:29:46Z,direct_url=<?>,disk_format='qcow2',id=f67140e5-e503-4aed-830e-32289bf444d2,min_disk=0,min_ram=0,name='tempest-scenario-img--927622697',owner='70c87f2fad4648bf90baef68e16d6a5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:29:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': 'f67140e5-e503-4aed-830e-32289bf444d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:29:51 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:29:51 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:29:46Z,direct_url=<?>,disk_format='qcow2',id=f67140e5-e503-4aed-830e-32289bf444d2,min_disk=0,min_ram=0,name='tempest-scenario-img--927622697',owner='70c87f2fad4648bf90baef68e16d6a5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:29:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-830005725',display_name='tempest-TestMinimumBasicScenario-server-830005725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-830005725',id=41,image_ref='f67140e5-e503-4aed-830e-32289bf444d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKIvXK+EFfAY8AbL9No26I8VkXN8H+s7RYjXU+kc/uU0ESbs6S2bOlZ3YqKLmR0KjWCcFGmGJECDyJn0N/OdkNO4xIFFra8Wly//jdVw7ylYCxB9DelSYujFH3w6qpR7w==',key_name='tempest-TestMinimumBasicScenario-2144509393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70c87f2fad4648bf90baef68e16d6a5e',ramdisk_id='',reservation_id='r-fesjgsbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f67140e5-e503-4aed-830e-32289bf444d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1764501925',owner_user_name='tempest-TestMinimumBasicScenario-1764501925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:29:49Z,user_data=None,user_id='00d8fe7c07284b06985746a92c11f518',uuid=dfb9fa80-41e1-4c0f-a0da-89fa020581ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Converting VIF {"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:18:e2,bridge_name='br-int',has_traffic_filtering=True,id=511b289f-3048-493d-b658-e31546805791,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511b289f-30') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.objects.instance [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lazy-loading 'pci_devices' on Instance uuid dfb9fa80-41e1-4c0f-a0da-89fa020581ef {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:29:51 user nova-compute[73917]:   <uuid>dfb9fa80-41e1-4c0f-a0da-89fa020581ef</uuid>
Aug 26 19:29:51 user nova-compute[73917]:   <name>instance-00000029</name>
Aug 26 19:29:51 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:29:51 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:29:51 user nova-compute[73917]:   <metadata>
Aug 26 19:29:51 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:29:51 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:29:51 user nova-compute[73917]:       <nova:name>tempest-TestMinimumBasicScenario-server-830005725</nova:name>
Aug 26 19:29:51 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:29:51</nova:creationTime>
Aug 26 19:29:51 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:29:51 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:29:51 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:29:51 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:29:51 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:29:51 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:29:51 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:29:51 user nova-compute[73917]:       <nova:owner>
Aug 26 19:29:51 user nova-compute[73917]:         <nova:user uuid="00d8fe7c07284b06985746a92c11f518">tempest-TestMinimumBasicScenario-1764501925-project-member</nova:user>
Aug 26 19:29:51 user nova-compute[73917]:         <nova:project uuid="70c87f2fad4648bf90baef68e16d6a5e">tempest-TestMinimumBasicScenario-1764501925</nova:project>
Aug 26 19:29:51 user nova-compute[73917]:       </nova:owner>
Aug 26 19:29:51 user nova-compute[73917]:       <nova:root type="image" uuid="f67140e5-e503-4aed-830e-32289bf444d2"/>
Aug 26 19:29:51 user nova-compute[73917]:       <nova:ports>
Aug 26 19:29:51 user nova-compute[73917]:         <nova:port uuid="511b289f-3048-493d-b658-e31546805791">
Aug 26 19:29:51 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 19:29:51 user nova-compute[73917]:         </nova:port>
Aug 26 19:29:51 user nova-compute[73917]:       </nova:ports>
Aug 26 19:29:51 user nova-compute[73917]:     </nova:instance>
Aug 26 19:29:51 user nova-compute[73917]:   </metadata>
Aug 26 19:29:51 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:29:51 user nova-compute[73917]:     <system>
Aug 26 19:29:51 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:29:51 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:29:51 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:29:51 user nova-compute[73917]:       <entry name="serial">dfb9fa80-41e1-4c0f-a0da-89fa020581ef</entry>
Aug 26 19:29:51 user nova-compute[73917]:       <entry name="uuid">dfb9fa80-41e1-4c0f-a0da-89fa020581ef</entry>
Aug 26 19:29:51 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:29:51 user nova-compute[73917]:     </system>
Aug 26 19:29:51 user nova-compute[73917]:   </sysinfo>
Aug 26 19:29:51 user nova-compute[73917]:   <os>
Aug 26 19:29:51 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:29:51 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:29:51 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:29:51 user nova-compute[73917]:   </os>
Aug 26 19:29:51 user nova-compute[73917]:   <features>
Aug 26 19:29:51 user nova-compute[73917]:     <acpi/>
Aug 26 19:29:51 user nova-compute[73917]:     <apic/>
Aug 26 19:29:51 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:29:51 user nova-compute[73917]:   </features>
Aug 26 19:29:51 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:29:51 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:29:51 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:29:51 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:29:51 user nova-compute[73917]:   </clock>
Aug 26 19:29:51 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:29:51 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:29:51 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:29:51 user nova-compute[73917]:   </cpu>
Aug 26 19:29:51 user nova-compute[73917]:   <devices>
Aug 26 19:29:51 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:29:51 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:29:51 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk"/>
Aug 26 19:29:51 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:29:51 user nova-compute[73917]:     </disk>
Aug 26 19:29:51 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:29:51 user nova-compute[73917]:       <mac address="fa:16:3e:0c:18:e2"/>
Aug 26 19:29:51 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:29:51 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:29:51 user nova-compute[73917]:       <target dev="tap511b289f-30"/>
Aug 26 19:29:51 user nova-compute[73917]:     </interface>
Aug 26 19:29:51 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:29:51 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/console.log" append="off"/>
Aug 26 19:29:51 user nova-compute[73917]:     </serial>
Aug 26 19:29:51 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:29:51 user nova-compute[73917]:     <video>
Aug 26 19:29:51 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:29:51 user nova-compute[73917]:     </video>
Aug 26 19:29:51 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:29:51 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:29:51 user nova-compute[73917]:     </rng>
Aug 26 19:29:51 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:29:51 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:29:51 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:29:51 user nova-compute[73917]:     </memballoon>
Aug 26 19:29:51 user nova-compute[73917]:   </devices>
Aug 26 19:29:51 user nova-compute[73917]: </domain>
Aug 26 19:29:51 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-830005725',display_name='tempest-TestMinimumBasicScenario-server-830005725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-830005725',id=41,image_ref='f67140e5-e503-4aed-830e-32289bf444d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKIvXK+EFfAY8AbL9No26I8VkXN8H+s7RYjXU+kc/uU0ESbs6S2bOlZ3YqKLmR0KjWCcFGmGJECDyJn0N/OdkNO4xIFFra8Wly//jdVw7ylYCxB9DelSYujFH3w6qpR7w==',key_name='tempest-TestMinimumBasicScenario-2144509393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70c87f2fad4648bf90baef68e16d6a5e',ramdisk_id='',reservation_id='r-fesjgsbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f67140e5-e503-4aed-830e-32289bf444d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1764501925',owner_user_name='tempest-TestMinimumBasicScenario-1764501925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:29:49Z,user_data=None,user_id='00d8fe7c07284b06985746a92c11f518',uuid=dfb9fa80-41e1-4c0f-a0da-89fa020581ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Converting VIF {"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:18:e2,bridge_name='br-int',has_traffic_filtering=True,id=511b289f-3048-493d-b658-e31546805791,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511b289f-30') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG os_vif [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:18:e2,bridge_name='br-int',has_traffic_filtering=True,id=511b289f-3048-493d-b658-e31546805791,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511b289f-30') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap511b289f-30, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap511b289f-30, col_values=(('external_ids', {'iface-id': '511b289f-3048-493d-b658-e31546805791', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:18:e2', 'vm-uuid': 'dfb9fa80-41e1-4c0f-a0da-89fa020581ef'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:51 user nova-compute[73917]: INFO os_vif [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:18:e2,bridge_name='br-int',has_traffic_filtering=True,id=511b289f-3048-493d-b658-e31546805791,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511b289f-30')
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:29:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] No VIF found with MAC fa:16:3e:0c:18:e2, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:29:52 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:29:52 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Took 0.89 seconds to deallocate network for instance.
Aug 26 19:29:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:52 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:29:52 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:29:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:52 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Deleted allocations for instance d30d366d-29cc-430b-ba31-bcbc08a364b7
Aug 26 19:29:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-04bf1301-482e-4fef-a0cf-cc53c741a307 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.472s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:52 user nova-compute[73917]: DEBUG nova.compute.manager [req-187d9e1e-ad7f-4456-b7a3-dfbbedc233fe req-3af6c287-03f9-4e13-b521-be8acac5b90b service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received event network-vif-plugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:29:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-187d9e1e-ad7f-4456-b7a3-dfbbedc233fe req-3af6c287-03f9-4e13-b521-be8acac5b90b service nova] Acquiring lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-187d9e1e-ad7f-4456-b7a3-dfbbedc233fe req-3af6c287-03f9-4e13-b521-be8acac5b90b service nova] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-187d9e1e-ad7f-4456-b7a3-dfbbedc233fe req-3af6c287-03f9-4e13-b521-be8acac5b90b service nova] Lock "d30d366d-29cc-430b-ba31-bcbc08a364b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:52 user nova-compute[73917]: DEBUG nova.compute.manager [req-187d9e1e-ad7f-4456-b7a3-dfbbedc233fe req-3af6c287-03f9-4e13-b521-be8acac5b90b service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] No waiting events found dispatching network-vif-plugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:29:52 user nova-compute[73917]: WARNING nova.compute.manager [req-187d9e1e-ad7f-4456-b7a3-dfbbedc233fe req-3af6c287-03f9-4e13-b521-be8acac5b90b service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received unexpected event network-vif-plugged-1f0ca324-9d6c-4696-a525-76d4ccc1df91 for instance with vm_state deleted and task_state None.
Aug 26 19:29:52 user nova-compute[73917]: DEBUG nova.compute.manager [req-187d9e1e-ad7f-4456-b7a3-dfbbedc233fe req-3af6c287-03f9-4e13-b521-be8acac5b90b service nova] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Received event network-vif-deleted-1f0ca324-9d6c-4696-a525-76d4ccc1df91 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:29:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-1afa4541-f6a3-4fa5-be3f-0a78c032fedc req-3aef951a-27fd-49a5-84de-46dc48e8da1e service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received event network-vif-plugged-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:29:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1afa4541-f6a3-4fa5-be3f-0a78c032fedc req-3aef951a-27fd-49a5-84de-46dc48e8da1e service nova] Acquiring lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1afa4541-f6a3-4fa5-be3f-0a78c032fedc req-3aef951a-27fd-49a5-84de-46dc48e8da1e service nova] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1afa4541-f6a3-4fa5-be3f-0a78c032fedc req-3aef951a-27fd-49a5-84de-46dc48e8da1e service nova] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-1afa4541-f6a3-4fa5-be3f-0a78c032fedc req-3aef951a-27fd-49a5-84de-46dc48e8da1e service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] No waiting events found dispatching network-vif-plugged-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:29:53 user nova-compute[73917]: WARNING nova.compute.manager [req-1afa4541-f6a3-4fa5-be3f-0a78c032fedc req-3aef951a-27fd-49a5-84de-46dc48e8da1e service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received unexpected event network-vif-plugged-511b289f-3048-493d-b658-e31546805791 for instance with vm_state building and task_state spawning.
Aug 26 19:29:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:55 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078195.3111193, dfb9fa80-41e1-4c0f-a0da-89fa020581ef => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:29:55 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] VM Resumed (Lifecycle Event)
Aug 26 19:29:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:29:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:29:55 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Instance spawned successfully.
Aug 26 19:29:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:29:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:29:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:29:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:29:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:29:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:29:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:29:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:29:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:29:55 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:29:55 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078195.314548, dfb9fa80-41e1-4c0f-a0da-89fa020581ef => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:29:55 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] VM Started (Lifecycle Event)
Aug 26 19:29:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:29:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:29:55 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:29:55 user nova-compute[73917]: INFO nova.compute.manager [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 26 19:29:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:29:55 user nova-compute[73917]: INFO nova.compute.manager [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Took 6.66 seconds to build instance.
Aug 26 19:29:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-f6fab97f-254a-4e76-9f15-a51fe7c5f39d tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.758s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:55 user nova-compute[73917]: DEBUG nova.compute.manager [req-67b83836-a52c-463f-bc04-33b8119a90bd req-fc516c37-8834-416e-afa2-29bbac4635ad service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received event network-vif-plugged-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:29:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-67b83836-a52c-463f-bc04-33b8119a90bd req-fc516c37-8834-416e-afa2-29bbac4635ad service nova] Acquiring lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:29:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-67b83836-a52c-463f-bc04-33b8119a90bd req-fc516c37-8834-416e-afa2-29bbac4635ad service nova] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:29:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-67b83836-a52c-463f-bc04-33b8119a90bd req-fc516c37-8834-416e-afa2-29bbac4635ad service nova] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:29:55 user nova-compute[73917]: DEBUG nova.compute.manager [req-67b83836-a52c-463f-bc04-33b8119a90bd req-fc516c37-8834-416e-afa2-29bbac4635ad service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] No waiting events found dispatching network-vif-plugged-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:29:55 user nova-compute[73917]: WARNING nova.compute.manager [req-67b83836-a52c-463f-bc04-33b8119a90bd req-fc516c37-8834-416e-afa2-29bbac4635ad service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received unexpected event network-vif-plugged-511b289f-3048-493d-b658-e31546805791 for instance with vm_state active and task_state None.
Aug 26 19:29:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:29:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:06 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693078190.9983494, d30d366d-29cc-430b-ba31-bcbc08a364b7 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:30:06 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] VM Stopped (Lifecycle Event)
Aug 26 19:30:06 user nova-compute[73917]: DEBUG nova.compute.manager [None req-8ea85534-3e9b-49f9-88e9-cf4f79886b6a None None] [instance: d30d366d-29cc-430b-ba31-bcbc08a364b7] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:30:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:10 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:30:10 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:30:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-a4487be3-7267-4ae1-8731-a6bdf49a6070" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:30:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-a4487be3-7267-4ae1-8731-a6bdf49a6070" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:30:10 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:30:11 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Updating instance_info_cache with network_info: [{"id": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "address": "fa:16:3e:47:7a:17", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e5e2fc-f5", "ovs_interfaceid": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:30:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-a4487be3-7267-4ae1-8731-a6bdf49a6070" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:30:11 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:30:11 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:30:11 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:30:11 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:30:11 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:30:11 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:30:11 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:30:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:11 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:30:13 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:30:13 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:30:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:30:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:30:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:16 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:30:16 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:30:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=7871MB free_disk=24.84298324584961GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:30:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 94f8d4e7-f310-45df-a0ae-82e608ac0119 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:30:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance df5c717a-62d8-444d-9968-ad682a31733c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:30:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance a4487be3-7267-4ae1-8731-a6bdf49a6070 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:30:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fbc66439-479c-4818-a416-c3c64d49741d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:30:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 2598d318-3080-4be3-a4f5-36b3f7d292b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:30:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance d3dba60d-88f1-473c-abb8-44d35e2b6964 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:30:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance dfb9fa80-41e1-4c0f-a0da-89fa020581ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:30:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:30:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:30:16 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:30:16 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:30:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:30:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG nova.compute.manager [req-7c36333a-f2d8-49c8-a086-30504c85a6cf req-50a5e7f5-320e-47f5-af87-01cd4454eaee service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Received event network-changed-d99fa1fd-a7a0-4fbf-9b39-954d9be00027 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG nova.compute.manager [req-7c36333a-f2d8-49c8-a086-30504c85a6cf req-50a5e7f5-320e-47f5-af87-01cd4454eaee service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Refreshing instance network info cache due to event network-changed-d99fa1fd-a7a0-4fbf-9b39-954d9be00027. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-7c36333a-f2d8-49c8-a086-30504c85a6cf req-50a5e7f5-320e-47f5-af87-01cd4454eaee service nova] Acquiring lock "refresh_cache-2598d318-3080-4be3-a4f5-36b3f7d292b0" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-7c36333a-f2d8-49c8-a086-30504c85a6cf req-50a5e7f5-320e-47f5-af87-01cd4454eaee service nova] Acquired lock "refresh_cache-2598d318-3080-4be3-a4f5-36b3f7d292b0" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG nova.network.neutron [req-7c36333a-f2d8-49c8-a086-30504c85a6cf req-50a5e7f5-320e-47f5-af87-01cd4454eaee service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Refreshing network info cache for port d99fa1fd-a7a0-4fbf-9b39-954d9be00027 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "2598d318-3080-4be3-a4f5-36b3f7d292b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "2598d318-3080-4be3-a4f5-36b3f7d292b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG nova.objects.instance [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lazy-loading 'flavor' on Instance uuid 2598d318-3080-4be3-a4f5-36b3f7d292b0 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:30:20 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Ignoring supplied device name: /dev/vdb
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "2598d318-3080-4be3-a4f5-36b3f7d292b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "2598d318-3080-4be3-a4f5-36b3f7d292b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "2598d318-3080-4be3-a4f5-36b3f7d292b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:20 user nova-compute[73917]: INFO nova.compute.manager [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Attaching volume 79fa6c1f-c9e0-49b4-9d6a-0cb2832975da to /dev/vdb
Aug 26 19:30:20 user nova-compute[73917]: DEBUG os_brick.utils [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[30487f13-7f15-4cc9-b050-ff477de56a61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[973062c2-432a-4905-8d5c-71f6b031bb52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG nova.network.neutron [req-7c36333a-f2d8-49c8-a086-30504c85a6cf req-50a5e7f5-320e-47f5-af87-01cd4454eaee service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Updated VIF entry in instance network info cache for port d99fa1fd-a7a0-4fbf-9b39-954d9be00027. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG nova.network.neutron [req-7c36333a-f2d8-49c8-a086-30504c85a6cf req-50a5e7f5-320e-47f5-af87-01cd4454eaee service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Updating instance_info_cache with network_info: [{"id": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "address": "fa:16:3e:ac:7b:eb", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99fa1fd-a7", "ovs_interfaceid": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c04a68-6644-4497-8218-807213864ab9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d29a12-5812-436b-b968-888b1e395fb4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-7c36333a-f2d8-49c8-a086-30504c85a6cf req-50a5e7f5-320e-47f5-af87-01cd4454eaee service nova] Releasing lock "refresh_cache-2598d318-3080-4be3-a4f5-36b3f7d292b0" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:30:20 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:30:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[388a6ff3-707c-44d3-8f8a-d49a70902190]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG os_brick.utils [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:30:20 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Updating existing volume attachment record: 49e1a5f5-70ed-425f-848b-241cb2248277 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "a4487be3-7267-4ae1-8731-a6bdf49a6070" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "a4487be3-7267-4ae1-8731-a6bdf49a6070" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "a4487be3-7267-4ae1-8731-a6bdf49a6070-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "a4487be3-7267-4ae1-8731-a6bdf49a6070-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "a4487be3-7267-4ae1-8731-a6bdf49a6070-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:21 user nova-compute[73917]: INFO nova.compute.manager [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Terminating instance
Aug 26 19:30:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-be41308b-9ec2-4f2e-a7cf-efab470e420f req-25ab4a55-5096-4ba2-9359-7223815fc5b3 service nova] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Received event network-vif-unplugged-15e5e2fc-f53b-4490-8446-cdcdd5491a10 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-be41308b-9ec2-4f2e-a7cf-efab470e420f req-25ab4a55-5096-4ba2-9359-7223815fc5b3 service nova] Acquiring lock "a4487be3-7267-4ae1-8731-a6bdf49a6070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-be41308b-9ec2-4f2e-a7cf-efab470e420f req-25ab4a55-5096-4ba2-9359-7223815fc5b3 service nova] Lock "a4487be3-7267-4ae1-8731-a6bdf49a6070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-be41308b-9ec2-4f2e-a7cf-efab470e420f req-25ab4a55-5096-4ba2-9359-7223815fc5b3 service nova] Lock "a4487be3-7267-4ae1-8731-a6bdf49a6070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-be41308b-9ec2-4f2e-a7cf-efab470e420f req-25ab4a55-5096-4ba2-9359-7223815fc5b3 service nova] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] No waiting events found dispatching network-vif-unplugged-15e5e2fc-f53b-4490-8446-cdcdd5491a10 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-be41308b-9ec2-4f2e-a7cf-efab470e420f req-25ab4a55-5096-4ba2-9359-7223815fc5b3 service nova] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Received event network-vif-unplugged-15e5e2fc-f53b-4490-8446-cdcdd5491a10 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:21 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Instance destroyed successfully.
Aug 26 19:30:21 user nova-compute[73917]: DEBUG nova.objects.instance [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'resources' on Instance uuid a4487be3-7267-4ae1-8731-a6bdf49a6070 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-278722069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-278722069',id=32,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:21:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68229e3ed72a45fa8c2c9a33780479ce',ramdisk_id='',reservation_id='r-smsvfonw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:22:55Z,user_data=None,user_id='e056c4ed5a18427a8fd1eaa6a3a795c0',uuid=a4487be3-7267-4ae1-8731-a6bdf49a6070,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "address": "fa:16:3e:47:7a:17", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e5e2fc-f5", "ovs_interfaceid": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converting VIF {"id": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "address": "fa:16:3e:47:7a:17", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e5e2fc-f5", "ovs_interfaceid": "15e5e2fc-f53b-4490-8446-cdcdd5491a10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:7a:17,bridge_name='br-int',has_traffic_filtering=True,id=15e5e2fc-f53b-4490-8446-cdcdd5491a10,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e5e2fc-f5') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG os_vif [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:7a:17,bridge_name='br-int',has_traffic_filtering=True,id=15e5e2fc-f53b-4490-8446-cdcdd5491a10,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e5e2fc-f5') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15e5e2fc-f5, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:30:21 user nova-compute[73917]: INFO os_vif [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:7a:17,bridge_name='br-int',has_traffic_filtering=True,id=15e5e2fc-f53b-4490-8446-cdcdd5491a10,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e5e2fc-f5')
Aug 26 19:30:21 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Deleting instance files /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070_del
Aug 26 19:30:21 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Deletion of /opt/stack/data/nova/instances/a4487be3-7267-4ae1-8731-a6bdf49a6070_del complete
Aug 26 19:30:21 user nova-compute[73917]: INFO nova.compute.manager [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Took 0.77 seconds to destroy the instance on the hypervisor.
Aug 26 19:30:21 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:30:21 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:30:22 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:30:22 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Took 0.46 seconds to deallocate network for instance.
Aug 26 19:30:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:22 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:30:22 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:30:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:22 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Deleted allocations for instance a4487be3-7267-4ae1-8731-a6bdf49a6070
Aug 26 19:30:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cd7ba3e1-2b9a-48d9-ac3b-dee13dce9a85 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "a4487be3-7267-4ae1-8731-a6bdf49a6070" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.630s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-f4e923ef-8108-469f-a141-2e58c595ef79 req-a3d4ea35-e5a1-444b-95cb-c5cd4a2e4441 service nova] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Received event network-vif-plugged-15e5e2fc-f53b-4490-8446-cdcdd5491a10 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:30:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f4e923ef-8108-469f-a141-2e58c595ef79 req-a3d4ea35-e5a1-444b-95cb-c5cd4a2e4441 service nova] Acquiring lock "a4487be3-7267-4ae1-8731-a6bdf49a6070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f4e923ef-8108-469f-a141-2e58c595ef79 req-a3d4ea35-e5a1-444b-95cb-c5cd4a2e4441 service nova] Lock "a4487be3-7267-4ae1-8731-a6bdf49a6070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f4e923ef-8108-469f-a141-2e58c595ef79 req-a3d4ea35-e5a1-444b-95cb-c5cd4a2e4441 service nova] Lock "a4487be3-7267-4ae1-8731-a6bdf49a6070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-f4e923ef-8108-469f-a141-2e58c595ef79 req-a3d4ea35-e5a1-444b-95cb-c5cd4a2e4441 service nova] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] No waiting events found dispatching network-vif-plugged-15e5e2fc-f53b-4490-8446-cdcdd5491a10 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:30:23 user nova-compute[73917]: WARNING nova.compute.manager [req-f4e923ef-8108-469f-a141-2e58c595ef79 req-a3d4ea35-e5a1-444b-95cb-c5cd4a2e4441 service nova] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Received unexpected event network-vif-plugged-15e5e2fc-f53b-4490-8446-cdcdd5491a10 for instance with vm_state deleted and task_state None.
Aug 26 19:30:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-f4e923ef-8108-469f-a141-2e58c595ef79 req-a3d4ea35-e5a1-444b-95cb-c5cd4a2e4441 service nova] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Received event network-vif-deleted-15e5e2fc-f53b-4490-8446-cdcdd5491a10 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:30:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WmbKCwrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:30:32 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:30:32 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:30:32 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae2c78d-5cae-4330-aa5d-993ca95d2608]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:30:32 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e804e8b-8f49-45ca-aa7c-cc957db8e911]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da] added
Aug 26 19:30:32 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2acd079-b21b-4815-aad8-e0e1280c35e9]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68008a8-bf08-421a-8cf7-7a8411406c8f]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WmbKCwrP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WmbKCwrP" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4a8779-3951-476f-a7f6-df57afef30de]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WmbKCwrP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edfc401-2da4-41ec-913e-5407079b9707]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eea171b-b63e-4adb-a2b1-13f464be90a7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:30:32 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:30:32 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2834dd2-f49c-4832-a299-8e7bf3cb7853]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da, portal: 172.16.0.220,3260]
Aug 26 19:30:32 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da, portal: 172.16.0.220,3260] successful.
Aug 26 19:30:32 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c6f9ab-31d0-4c47-a3fc-692caf64eda2]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[556b3346-37c2-4384-ab8a-a323b0a828b1]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:30:32 user nova-compute[73917]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da (non-flash)
Aug 26 19:30:32 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:30:32 user nova-compute[73917]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da (non-flash)
Aug 26 19:30:32 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[57144d60-44b2-4729-b1a2-cc1f3c346224]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:32 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:30:33 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:30:33 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WmbKCwrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:30:33 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:30:33 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23538643934373433', 'path': '/dev/sdc'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:30:33 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538643934373433', 'path': '/dev/sdc'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:30:33 user nova-compute[73917]: DEBUG nova.objects.instance [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lazy-loading 'flavor' on Instance uuid 2598d318-3080-4be3-a4f5-36b3f7d292b0 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:30:33 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:30:33 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:30:33 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:30:33 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:30:33 user nova-compute[73917]:   <serial>79fa6c1f-c9e0-49b4-9d6a-0cb2832975da</serial>
Aug 26 19:30:33 user nova-compute[73917]: </disk>
Aug 26 19:30:33 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:30:33 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:30:33 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:30:33 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] No VIF found with MAC fa:16:3e:ac:7b:eb, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:30:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-3cc58850-f97c-4638-a8da-25b6562a7cb4 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "2598d318-3080-4be3-a4f5-36b3f7d292b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.218s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:36 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693078221.7811944, a4487be3-7267-4ae1-8731-a6bdf49a6070 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:30:36 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] VM Stopped (Lifecycle Event)
Aug 26 19:30:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-3185104a-be29-4639-a81a-f61a628813f4 None None] [instance: a4487be3-7267-4ae1-8731-a6bdf49a6070] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:30:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:44 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:30:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:44 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:30:44 user nova-compute[73917]: INFO nova.compute.claims [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Claim successful on node user
Aug 26 19:30:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG nova.network.neutron [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:30:45 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:30:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG nova.policy [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '860f7b92664e43d19c908f3bdb52d717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf0ccd59944be6922b561ecddc7d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:30:45 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Creating image(s)
Aug 26 19:30:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "/opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "/opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "/opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.191s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.171s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk 1073741824" returned: 0 in 0.062s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.169s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:30:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:46 user nova-compute[73917]: DEBUG nova.network.neutron [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Successfully created port: 2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:30:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:46 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Cannot resize image /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:30:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:30:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Ensure instance console log exists: /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:30:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.network.neutron [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Successfully updated port: 2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquired lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.network.neutron [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.compute.manager [req-ccde0942-1953-48d2-9f80-9a861490467c req-99824a8e-eec2-4f8a-a0de-2ba9c4b1c817 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received event network-changed-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.compute.manager [req-ccde0942-1953-48d2-9f80-9a861490467c req-99824a8e-eec2-4f8a-a0de-2ba9c4b1c817 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Refreshing instance network info cache due to event network-changed-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ccde0942-1953-48d2-9f80-9a861490467c req-99824a8e-eec2-4f8a-a0de-2ba9c4b1c817 service nova] Acquiring lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.network.neutron [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.network.neutron [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Updating instance_info_cache with network_info: [{"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Releasing lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Instance network_info: |[{"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ccde0942-1953-48d2-9f80-9a861490467c req-99824a8e-eec2-4f8a-a0de-2ba9c4b1c817 service nova] Acquired lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.network.neutron [req-ccde0942-1953-48d2-9f80-9a861490467c req-99824a8e-eec2-4f8a-a0de-2ba9c4b1c817 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Refreshing network info cache for port 2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Start _get_guest_xml network_info=[{"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:30:47 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:30:47 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1484928366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1484928366',id=42,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpGCGggJbEXbF0OVNJLJ7CgUM+t4zKuAo1hX+bjTVZOGWPRk+hqqRNql720cO1HVYFKJp8UEYPhGL0umPueNY4q/aihiXk5GFQMPZSa17qYaaT2B8zrQdoYGbYMPV/LfA==',key_name='tempest-keypair-1671593516',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96cf0ccd59944be6922b561ecddc7d5b',ramdisk_id='',reservation_id='r-zh03nzoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1729132577',owner_user_name='tempest-AttachVolumeShelveTestJSON-1729132577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:30:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860f7b92664e43d19c908f3bdb52d717',uuid=24e53fcd-f3ea-4f6a-a09c-83813f739a1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converting VIF {"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9a:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dcdc64c-d3c6-4e11-bc82-a4149510e4fb,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcdc64c-d3') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.objects.instance [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'pci_devices' on Instance uuid 24e53fcd-f3ea-4f6a-a09c-83813f739a1e {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:30:47 user nova-compute[73917]:   <uuid>24e53fcd-f3ea-4f6a-a09c-83813f739a1e</uuid>
Aug 26 19:30:47 user nova-compute[73917]:   <name>instance-0000002a</name>
Aug 26 19:30:47 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:30:47 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:30:47 user nova-compute[73917]:   <metadata>
Aug 26 19:30:47 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:30:47 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:30:47 user nova-compute[73917]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1484928366</nova:name>
Aug 26 19:30:47 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:30:47</nova:creationTime>
Aug 26 19:30:47 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:30:47 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:30:47 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:30:47 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:30:47 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:30:47 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:30:47 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:30:47 user nova-compute[73917]:       <nova:owner>
Aug 26 19:30:47 user nova-compute[73917]:         <nova:user uuid="860f7b92664e43d19c908f3bdb52d717">tempest-AttachVolumeShelveTestJSON-1729132577-project-member</nova:user>
Aug 26 19:30:47 user nova-compute[73917]:         <nova:project uuid="96cf0ccd59944be6922b561ecddc7d5b">tempest-AttachVolumeShelveTestJSON-1729132577</nova:project>
Aug 26 19:30:47 user nova-compute[73917]:       </nova:owner>
Aug 26 19:30:47 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:30:47 user nova-compute[73917]:       <nova:ports>
Aug 26 19:30:47 user nova-compute[73917]:         <nova:port uuid="2dcdc64c-d3c6-4e11-bc82-a4149510e4fb">
Aug 26 19:30:47 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 19:30:47 user nova-compute[73917]:         </nova:port>
Aug 26 19:30:47 user nova-compute[73917]:       </nova:ports>
Aug 26 19:30:47 user nova-compute[73917]:     </nova:instance>
Aug 26 19:30:47 user nova-compute[73917]:   </metadata>
Aug 26 19:30:47 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:30:47 user nova-compute[73917]:     <system>
Aug 26 19:30:47 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:30:47 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:30:47 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:30:47 user nova-compute[73917]:       <entry name="serial">24e53fcd-f3ea-4f6a-a09c-83813f739a1e</entry>
Aug 26 19:30:47 user nova-compute[73917]:       <entry name="uuid">24e53fcd-f3ea-4f6a-a09c-83813f739a1e</entry>
Aug 26 19:30:47 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:30:47 user nova-compute[73917]:     </system>
Aug 26 19:30:47 user nova-compute[73917]:   </sysinfo>
Aug 26 19:30:47 user nova-compute[73917]:   <os>
Aug 26 19:30:47 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:30:47 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:30:47 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:30:47 user nova-compute[73917]:   </os>
Aug 26 19:30:47 user nova-compute[73917]:   <features>
Aug 26 19:30:47 user nova-compute[73917]:     <acpi/>
Aug 26 19:30:47 user nova-compute[73917]:     <apic/>
Aug 26 19:30:47 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:30:47 user nova-compute[73917]:   </features>
Aug 26 19:30:47 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:30:47 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:30:47 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:30:47 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:30:47 user nova-compute[73917]:   </clock>
Aug 26 19:30:47 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:30:47 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:30:47 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:30:47 user nova-compute[73917]:   </cpu>
Aug 26 19:30:47 user nova-compute[73917]:   <devices>
Aug 26 19:30:47 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:30:47 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:30:47 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk"/>
Aug 26 19:30:47 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:30:47 user nova-compute[73917]:     </disk>
Aug 26 19:30:47 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:30:47 user nova-compute[73917]:       <mac address="fa:16:3e:b6:9a:f9"/>
Aug 26 19:30:47 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:30:47 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:30:47 user nova-compute[73917]:       <target dev="tap2dcdc64c-d3"/>
Aug 26 19:30:47 user nova-compute[73917]:     </interface>
Aug 26 19:30:47 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:30:47 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/console.log" append="off"/>
Aug 26 19:30:47 user nova-compute[73917]:     </serial>
Aug 26 19:30:47 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:30:47 user nova-compute[73917]:     <video>
Aug 26 19:30:47 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:30:47 user nova-compute[73917]:     </video>
Aug 26 19:30:47 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:30:47 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:30:47 user nova-compute[73917]:     </rng>
Aug 26 19:30:47 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:30:47 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:30:47 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:30:47 user nova-compute[73917]:     </memballoon>
Aug 26 19:30:47 user nova-compute[73917]:   </devices>
Aug 26 19:30:47 user nova-compute[73917]: </domain>
Aug 26 19:30:47 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1484928366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1484928366',id=42,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpGCGggJbEXbF0OVNJLJ7CgUM+t4zKuAo1hX+bjTVZOGWPRk+hqqRNql720cO1HVYFKJp8UEYPhGL0umPueNY4q/aihiXk5GFQMPZSa17qYaaT2B8zrQdoYGbYMPV/LfA==',key_name='tempest-keypair-1671593516',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96cf0ccd59944be6922b561ecddc7d5b',ramdisk_id='',reservation_id='r-zh03nzoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1729132577',owner_user_name='tempest-AttachVolumeShelveTestJSON-1729132577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:30:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860f7b92664e43d19c908f3bdb52d717',uuid=24e53fcd-f3ea-4f6a-a09c-83813f739a1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converting VIF {"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9a:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dcdc64c-d3c6-4e11-bc82-a4149510e4fb,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcdc64c-d3') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG os_vif [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9a:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dcdc64c-d3c6-4e11-bc82-a4149510e4fb,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcdc64c-d3') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dcdc64c-d3, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2dcdc64c-d3, col_values=(('external_ids', {'iface-id': '2dcdc64c-d3c6-4e11-bc82-a4149510e4fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:9a:f9', 'vm-uuid': '24e53fcd-f3ea-4f6a-a09c-83813f739a1e'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:47 user nova-compute[73917]: INFO os_vif [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9a:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dcdc64c-d3c6-4e11-bc82-a4149510e4fb,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcdc64c-d3')
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:30:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] No VIF found with MAC fa:16:3e:b6:9a:f9, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG nova.compute.manager [req-06659d0e-71a2-4ff2-8f0b-f6c38be6f5c5 req-ebdb1110-4d21-4947-ba34-e89c2ce2ec8e service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Received event network-changed-7221da13-0718-4966-b23a-69b49c853426 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG nova.compute.manager [req-06659d0e-71a2-4ff2-8f0b-f6c38be6f5c5 req-ebdb1110-4d21-4947-ba34-e89c2ce2ec8e service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Refreshing instance network info cache due to event network-changed-7221da13-0718-4966-b23a-69b49c853426. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-06659d0e-71a2-4ff2-8f0b-f6c38be6f5c5 req-ebdb1110-4d21-4947-ba34-e89c2ce2ec8e service nova] Acquiring lock "refresh_cache-d3dba60d-88f1-473c-abb8-44d35e2b6964" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-06659d0e-71a2-4ff2-8f0b-f6c38be6f5c5 req-ebdb1110-4d21-4947-ba34-e89c2ce2ec8e service nova] Acquired lock "refresh_cache-d3dba60d-88f1-473c-abb8-44d35e2b6964" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG nova.network.neutron [req-06659d0e-71a2-4ff2-8f0b-f6c38be6f5c5 req-ebdb1110-4d21-4947-ba34-e89c2ce2ec8e service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Refreshing network info cache for port 7221da13-0718-4966-b23a-69b49c853426 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Acquiring lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG nova.compute.manager [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG nova.network.neutron [req-ccde0942-1953-48d2-9f80-9a861490467c req-99824a8e-eec2-4f8a-a0de-2ba9c4b1c817 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Updated VIF entry in instance network info cache for port 2dcdc64c-d3c6-4e11-bc82-a4149510e4fb. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG nova.network.neutron [req-ccde0942-1953-48d2-9f80-9a861490467c req-99824a8e-eec2-4f8a-a0de-2ba9c4b1c817 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Updating instance_info_cache with network_info: [{"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ccde0942-1953-48d2-9f80-9a861490467c req-99824a8e-eec2-4f8a-a0de-2ba9c4b1c817 service nova] Releasing lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:30:48 user nova-compute[73917]: INFO nova.compute.claims [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Claim successful on node user
Aug 26 19:30:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "d3dba60d-88f1-473c-abb8-44d35e2b6964" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "d3dba60d-88f1-473c-abb8-44d35e2b6964" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG nova.objects.instance [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lazy-loading 'flavor' on Instance uuid d3dba60d-88f1-473c-abb8-44d35e2b6964 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG nova.network.neutron [req-06659d0e-71a2-4ff2-8f0b-f6c38be6f5c5 req-ebdb1110-4d21-4947-ba34-e89c2ce2ec8e service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Updated VIF entry in instance network info cache for port 7221da13-0718-4966-b23a-69b49c853426. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG nova.network.neutron [req-06659d0e-71a2-4ff2-8f0b-f6c38be6f5c5 req-ebdb1110-4d21-4947-ba34-e89c2ce2ec8e service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Updating instance_info_cache with network_info: [{"id": "7221da13-0718-4966-b23a-69b49c853426", "address": "fa:16:3e:bf:b3:2c", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221da13-07", "ovs_interfaceid": "7221da13-0718-4966-b23a-69b49c853426", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-06659d0e-71a2-4ff2-8f0b-f6c38be6f5c5 req-ebdb1110-4d21-4947-ba34-e89c2ce2ec8e service nova] Releasing lock "refresh_cache-d3dba60d-88f1-473c-abb8-44d35e2b6964" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "d3dba60d-88f1-473c-abb8-44d35e2b6964" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG nova.compute.manager [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG nova.compute.manager [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG nova.network.neutron [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:30:48 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:30:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "d3dba60d-88f1-473c-abb8-44d35e2b6964" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "d3dba60d-88f1-473c-abb8-44d35e2b6964" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:48 user nova-compute[73917]: INFO nova.compute.manager [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Attaching volume 31143ddc-4385-4e95-9d5c-151179279c11 to /dev/vdb
Aug 26 19:30:48 user nova-compute[73917]: DEBUG nova.compute.manager [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG nova.policy [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '170aaa5ea0234d4184ec34fe835100db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f8c3286fd14430b4ae5be87f712580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG os_brick.utils [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[56928325-f590-4950-9478-ece0e265f3a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fff8d8-2b92-4aae-bdb9-a474addc49ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:30:49 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Creating image(s)
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Acquiring lock "/opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "/opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "/opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cbc22c-1987-4b45-93db-302c5d9804cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[032bb384-217a-468f-b27b-db158aa0a558]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:30:49 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5e8e2d-e71e-45b5-877b-871f08f5c81d]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG os_brick.utils [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Updating existing volume attachment record: d204b42c-b1b0-4923-9b34-1f6346d4aa4a {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.214s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk 1073741824" returned: 0 in 0.077s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.209s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG nova.network.neutron [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Successfully created port: af81bab5-d822-4ef6-a0dd-a234f1143a95 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Cannot resize image /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Ensure instance console log exists: /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:50 user nova-compute[73917]: DEBUG nova.compute.manager [req-c8d67462-2d02-4531-8811-2cd9a9528844 req-bf97d020-a5d9-44e4-a18f-75cbad1fc2ad service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received event network-vif-plugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:30:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c8d67462-2d02-4531-8811-2cd9a9528844 req-bf97d020-a5d9-44e4-a18f-75cbad1fc2ad service nova] Acquiring lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c8d67462-2d02-4531-8811-2cd9a9528844 req-bf97d020-a5d9-44e4-a18f-75cbad1fc2ad service nova] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c8d67462-2d02-4531-8811-2cd9a9528844 req-bf97d020-a5d9-44e4-a18f-75cbad1fc2ad service nova] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:50 user nova-compute[73917]: DEBUG nova.compute.manager [req-c8d67462-2d02-4531-8811-2cd9a9528844 req-bf97d020-a5d9-44e4-a18f-75cbad1fc2ad service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] No waiting events found dispatching network-vif-plugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:30:50 user nova-compute[73917]: WARNING nova.compute.manager [req-c8d67462-2d02-4531-8811-2cd9a9528844 req-bf97d020-a5d9-44e4-a18f-75cbad1fc2ad service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received unexpected event network-vif-plugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb for instance with vm_state building and task_state spawning.
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.network.neutron [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Successfully updated port: af81bab5-d822-4ef6-a0dd-a234f1143a95 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Acquiring lock "refresh_cache-0aa9e505-caf3-45d1-96e5-3df233d05f0c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Acquired lock "refresh_cache-0aa9e505-caf3-45d1-96e5-3df233d05f0c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.network.neutron [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.network.neutron [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.network.neutron [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Updating instance_info_cache with network_info: [{"id": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "address": "fa:16:3e:2b:d7:c2", "network": {"id": "891da1fc-832f-40dc-8203-e34b109bd216", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2042761334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f8c3286fd14430b4ae5be87f712580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81bab5-d8", "ovs_interfaceid": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078251.438528, 24e53fcd-f3ea-4f6a-a09c-83813f739a1e => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:30:51 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] VM Resumed (Lifecycle Event)
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:30:51 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Instance spawned successfully.
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Releasing lock "refresh_cache-0aa9e505-caf3-45d1-96e5-3df233d05f0c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Instance network_info: |[{"id": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "address": "fa:16:3e:2b:d7:c2", "network": {"id": "891da1fc-832f-40dc-8203-e34b109bd216", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2042761334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f8c3286fd14430b4ae5be87f712580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81bab5-d8", "ovs_interfaceid": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Start _get_guest_xml network_info=[{"id": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "address": "fa:16:3e:2b:d7:c2", "network": {"id": "891da1fc-832f-40dc-8203-e34b109bd216", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2042761334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f8c3286fd14430b4ae5be87f712580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81bab5-d8", "ovs_interfaceid": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:30:51 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:30:51 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:30:51 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078251.4460843, 24e53fcd-f3ea-4f6a-a09c-83813f739a1e => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:30:51 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] VM Started (Lifecycle Event)
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:30:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-66812972',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-66812972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6681297',id=43,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDn1AUth23DmsKaAeg8QNuVU75Xlfuo0Oah/gGZN24Si+4rSxy75McFvouvUjc5AyYGgIIzkbhvA4nUAiTNA7uAqZ+PNLM5Sf3xmruXpBLpO8azvmkwJpyai7GOgD1mvg==',key_name='tempest-keypair-1991361779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04f8c3286fd14430b4ae5be87f712580',ramdisk_id='',reservation_id='r-7k5lrja0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-258390537',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:30:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='170aaa5ea0234d4184ec34fe835100db',uuid=0aa9e505-caf3-45d1-96e5-3df233d05f0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "address": "fa:16:3e:2b:d7:c2", "network": {"id": "891da1fc-832f-40dc-8203-e34b109bd216", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2042761334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f8c3286fd14430b4ae5be87f712580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81bab5-d8", "ovs_interfaceid": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Converting VIF {"id": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "address": "fa:16:3e:2b:d7:c2", "network": {"id": "891da1fc-832f-40dc-8203-e34b109bd216", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2042761334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f8c3286fd14430b4ae5be87f712580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81bab5-d8", "ovs_interfaceid": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:d7:c2,bridge_name='br-int',has_traffic_filtering=True,id=af81bab5-d822-4ef6-a0dd-a234f1143a95,network=Network(891da1fc-832f-40dc-8203-e34b109bd216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf81bab5-d8') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.objects.instance [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lazy-loading 'pci_devices' on Instance uuid 0aa9e505-caf3-45d1-96e5-3df233d05f0c {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:30:51 user nova-compute[73917]: INFO nova.compute.manager [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Took 6.24 seconds to spawn the instance on the hypervisor.
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:30:51 user nova-compute[73917]:   <uuid>0aa9e505-caf3-45d1-96e5-3df233d05f0c</uuid>
Aug 26 19:30:51 user nova-compute[73917]:   <name>instance-0000002b</name>
Aug 26 19:30:51 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:30:51 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:30:51 user nova-compute[73917]:   <metadata>
Aug 26 19:30:51 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:30:51 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:30:51 user nova-compute[73917]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-66812972</nova:name>
Aug 26 19:30:51 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:30:51</nova:creationTime>
Aug 26 19:30:51 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:30:51 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:30:51 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:30:51 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:30:51 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:30:51 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:30:51 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:30:51 user nova-compute[73917]:       <nova:owner>
Aug 26 19:30:51 user nova-compute[73917]:         <nova:user uuid="170aaa5ea0234d4184ec34fe835100db">tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member</nova:user>
Aug 26 19:30:51 user nova-compute[73917]:         <nova:project uuid="04f8c3286fd14430b4ae5be87f712580">tempest-TestServerVolumeAttachScenarioOldVersion-258390537</nova:project>
Aug 26 19:30:51 user nova-compute[73917]:       </nova:owner>
Aug 26 19:30:51 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:30:51 user nova-compute[73917]:       <nova:ports>
Aug 26 19:30:51 user nova-compute[73917]:         <nova:port uuid="af81bab5-d822-4ef6-a0dd-a234f1143a95">
Aug 26 19:30:51 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 19:30:51 user nova-compute[73917]:         </nova:port>
Aug 26 19:30:51 user nova-compute[73917]:       </nova:ports>
Aug 26 19:30:51 user nova-compute[73917]:     </nova:instance>
Aug 26 19:30:51 user nova-compute[73917]:   </metadata>
Aug 26 19:30:51 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:30:51 user nova-compute[73917]:     <system>
Aug 26 19:30:51 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:30:51 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:30:51 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:30:51 user nova-compute[73917]:       <entry name="serial">0aa9e505-caf3-45d1-96e5-3df233d05f0c</entry>
Aug 26 19:30:51 user nova-compute[73917]:       <entry name="uuid">0aa9e505-caf3-45d1-96e5-3df233d05f0c</entry>
Aug 26 19:30:51 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:30:51 user nova-compute[73917]:     </system>
Aug 26 19:30:51 user nova-compute[73917]:   </sysinfo>
Aug 26 19:30:51 user nova-compute[73917]:   <os>
Aug 26 19:30:51 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:30:51 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:30:51 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:30:51 user nova-compute[73917]:   </os>
Aug 26 19:30:51 user nova-compute[73917]:   <features>
Aug 26 19:30:51 user nova-compute[73917]:     <acpi/>
Aug 26 19:30:51 user nova-compute[73917]:     <apic/>
Aug 26 19:30:51 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:30:51 user nova-compute[73917]:   </features>
Aug 26 19:30:51 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:30:51 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:30:51 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:30:51 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:30:51 user nova-compute[73917]:   </clock>
Aug 26 19:30:51 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:30:51 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:30:51 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:30:51 user nova-compute[73917]:   </cpu>
Aug 26 19:30:51 user nova-compute[73917]:   <devices>
Aug 26 19:30:51 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:30:51 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:30:51 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk"/>
Aug 26 19:30:51 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:30:51 user nova-compute[73917]:     </disk>
Aug 26 19:30:51 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:30:51 user nova-compute[73917]:       <mac address="fa:16:3e:2b:d7:c2"/>
Aug 26 19:30:51 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:30:51 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:30:51 user nova-compute[73917]:       <target dev="tapaf81bab5-d8"/>
Aug 26 19:30:51 user nova-compute[73917]:     </interface>
Aug 26 19:30:51 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:30:51 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/console.log" append="off"/>
Aug 26 19:30:51 user nova-compute[73917]:     </serial>
Aug 26 19:30:51 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:30:51 user nova-compute[73917]:     <video>
Aug 26 19:30:51 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:30:51 user nova-compute[73917]:     </video>
Aug 26 19:30:51 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:30:51 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:30:51 user nova-compute[73917]:     </rng>
Aug 26 19:30:51 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:30:51 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:30:51 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:30:51 user nova-compute[73917]:     </memballoon>
Aug 26 19:30:51 user nova-compute[73917]:   </devices>
Aug 26 19:30:51 user nova-compute[73917]: </domain>
Aug 26 19:30:51 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:30:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-66812972',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-66812972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6681297',id=43,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDn1AUth23DmsKaAeg8QNuVU75Xlfuo0Oah/gGZN24Si+4rSxy75McFvouvUjc5AyYGgIIzkbhvA4nUAiTNA7uAqZ+PNLM5Sf3xmruXpBLpO8azvmkwJpyai7GOgD1mvg==',key_name='tempest-keypair-1991361779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04f8c3286fd14430b4ae5be87f712580',ramdisk_id='',reservation_id='r-7k5lrja0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-258390537',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:30:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='170aaa5ea0234d4184ec34fe835100db',uuid=0aa9e505-caf3-45d1-96e5-3df233d05f0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "address": "fa:16:3e:2b:d7:c2", "network": {"id": "891da1fc-832f-40dc-8203-e34b109bd216", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2042761334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f8c3286fd14430b4ae5be87f712580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81bab5-d8", "ovs_interfaceid": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Converting VIF {"id": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "address": "fa:16:3e:2b:d7:c2", "network": {"id": "891da1fc-832f-40dc-8203-e34b109bd216", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2042761334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f8c3286fd14430b4ae5be87f712580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81bab5-d8", "ovs_interfaceid": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:d7:c2,bridge_name='br-int',has_traffic_filtering=True,id=af81bab5-d822-4ef6-a0dd-a234f1143a95,network=Network(891da1fc-832f-40dc-8203-e34b109bd216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf81bab5-d8') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG os_vif [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:d7:c2,bridge_name='br-int',has_traffic_filtering=True,id=af81bab5-d822-4ef6-a0dd-a234f1143a95,network=Network(891da1fc-832f-40dc-8203-e34b109bd216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf81bab5-d8') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf81bab5-d8, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf81bab5-d8, col_values=(('external_ids', {'iface-id': 'af81bab5-d822-4ef6-a0dd-a234f1143a95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:d7:c2', 'vm-uuid': '0aa9e505-caf3-45d1-96e5-3df233d05f0c'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:51 user nova-compute[73917]: INFO os_vif [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:d7:c2,bridge_name='br-int',has_traffic_filtering=True,id=af81bab5-d822-4ef6-a0dd-a234f1143a95,network=Network(891da1fc-832f-40dc-8203-e34b109bd216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf81bab5-d8')
Aug 26 19:30:51 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:30:51 user nova-compute[73917]: INFO nova.compute.manager [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Took 6.94 seconds to build instance.
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] No VIF found with MAC fa:16:3e:2b:d7:c2, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:30:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5e205cf7-cbcf-4b80-a5bb-f316891442d5 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.048s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:52 user nova-compute[73917]: DEBUG nova.compute.manager [req-9da3a37b-ad3f-40c8-8289-16465a809e23 req-cb774bb5-1b8a-45e3-ada7-d94e17d2ecc9 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received event network-vif-plugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:30:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9da3a37b-ad3f-40c8-8289-16465a809e23 req-cb774bb5-1b8a-45e3-ada7-d94e17d2ecc9 service nova] Acquiring lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9da3a37b-ad3f-40c8-8289-16465a809e23 req-cb774bb5-1b8a-45e3-ada7-d94e17d2ecc9 service nova] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9da3a37b-ad3f-40c8-8289-16465a809e23 req-cb774bb5-1b8a-45e3-ada7-d94e17d2ecc9 service nova] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:52 user nova-compute[73917]: DEBUG nova.compute.manager [req-9da3a37b-ad3f-40c8-8289-16465a809e23 req-cb774bb5-1b8a-45e3-ada7-d94e17d2ecc9 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] No waiting events found dispatching network-vif-plugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:30:52 user nova-compute[73917]: WARNING nova.compute.manager [req-9da3a37b-ad3f-40c8-8289-16465a809e23 req-cb774bb5-1b8a-45e3-ada7-d94e17d2ecc9 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received unexpected event network-vif-plugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb for instance with vm_state active and task_state None.
Aug 26 19:30:52 user nova-compute[73917]: DEBUG nova.compute.manager [req-9da3a37b-ad3f-40c8-8289-16465a809e23 req-cb774bb5-1b8a-45e3-ada7-d94e17d2ecc9 service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Received event network-changed-af81bab5-d822-4ef6-a0dd-a234f1143a95 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:30:52 user nova-compute[73917]: DEBUG nova.compute.manager [req-9da3a37b-ad3f-40c8-8289-16465a809e23 req-cb774bb5-1b8a-45e3-ada7-d94e17d2ecc9 service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Refreshing instance network info cache due to event network-changed-af81bab5-d822-4ef6-a0dd-a234f1143a95. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:30:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9da3a37b-ad3f-40c8-8289-16465a809e23 req-cb774bb5-1b8a-45e3-ada7-d94e17d2ecc9 service nova] Acquiring lock "refresh_cache-0aa9e505-caf3-45d1-96e5-3df233d05f0c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:30:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9da3a37b-ad3f-40c8-8289-16465a809e23 req-cb774bb5-1b8a-45e3-ada7-d94e17d2ecc9 service nova] Acquired lock "refresh_cache-0aa9e505-caf3-45d1-96e5-3df233d05f0c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:30:52 user nova-compute[73917]: DEBUG nova.network.neutron [req-9da3a37b-ad3f-40c8-8289-16465a809e23 req-cb774bb5-1b8a-45e3-ada7-d94e17d2ecc9 service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Refreshing network info cache for port af81bab5-d822-4ef6-a0dd-a234f1143a95 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:30:52 user nova-compute[73917]: DEBUG nova.network.neutron [req-9da3a37b-ad3f-40c8-8289-16465a809e23 req-cb774bb5-1b8a-45e3-ada7-d94e17d2ecc9 service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Updated VIF entry in instance network info cache for port af81bab5-d822-4ef6-a0dd-a234f1143a95. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:30:52 user nova-compute[73917]: DEBUG nova.network.neutron [req-9da3a37b-ad3f-40c8-8289-16465a809e23 req-cb774bb5-1b8a-45e3-ada7-d94e17d2ecc9 service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Updating instance_info_cache with network_info: [{"id": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "address": "fa:16:3e:2b:d7:c2", "network": {"id": "891da1fc-832f-40dc-8203-e34b109bd216", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2042761334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f8c3286fd14430b4ae5be87f712580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81bab5-d8", "ovs_interfaceid": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:30:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9da3a37b-ad3f-40c8-8289-16465a809e23 req-cb774bb5-1b8a-45e3-ada7-d94e17d2ecc9 service nova] Releasing lock "refresh_cache-0aa9e505-caf3-45d1-96e5-3df233d05f0c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:30:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-cd3da763-5dd1-467c-854d-cab511557645 req-96591395-d587-4860-b8de-7526a9acebc6 service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Received event network-vif-plugged-af81bab5-d822-4ef6-a0dd-a234f1143a95 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:30:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cd3da763-5dd1-467c-854d-cab511557645 req-96591395-d587-4860-b8de-7526a9acebc6 service nova] Acquiring lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cd3da763-5dd1-467c-854d-cab511557645 req-96591395-d587-4860-b8de-7526a9acebc6 service nova] Lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cd3da763-5dd1-467c-854d-cab511557645 req-96591395-d587-4860-b8de-7526a9acebc6 service nova] Lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:53 user nova-compute[73917]: DEBUG nova.compute.manager [req-cd3da763-5dd1-467c-854d-cab511557645 req-96591395-d587-4860-b8de-7526a9acebc6 service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] No waiting events found dispatching network-vif-plugged-af81bab5-d822-4ef6-a0dd-a234f1143a95 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:30:53 user nova-compute[73917]: WARNING nova.compute.manager [req-cd3da763-5dd1-467c-854d-cab511557645 req-96591395-d587-4860-b8de-7526a9acebc6 service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Received unexpected event network-vif-plugged-af81bab5-d822-4ef6-a0dd-a234f1143a95 for instance with vm_state building and task_state spawning.
Aug 26 19:30:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:55 user nova-compute[73917]: DEBUG nova.compute.manager [req-f753a155-0296-4dae-9acd-1ab17800eeaf req-f539b50d-38e9-4089-975c-7481787bd399 service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Received event network-vif-plugged-af81bab5-d822-4ef6-a0dd-a234f1143a95 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:30:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f753a155-0296-4dae-9acd-1ab17800eeaf req-f539b50d-38e9-4089-975c-7481787bd399 service nova] Acquiring lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:30:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f753a155-0296-4dae-9acd-1ab17800eeaf req-f539b50d-38e9-4089-975c-7481787bd399 service nova] Lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:30:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f753a155-0296-4dae-9acd-1ab17800eeaf req-f539b50d-38e9-4089-975c-7481787bd399 service nova] Lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:55 user nova-compute[73917]: DEBUG nova.compute.manager [req-f753a155-0296-4dae-9acd-1ab17800eeaf req-f539b50d-38e9-4089-975c-7481787bd399 service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] No waiting events found dispatching network-vif-plugged-af81bab5-d822-4ef6-a0dd-a234f1143a95 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:30:55 user nova-compute[73917]: WARNING nova.compute.manager [req-f753a155-0296-4dae-9acd-1ab17800eeaf req-f539b50d-38e9-4089-975c-7481787bd399 service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Received unexpected event network-vif-plugged-af81bab5-d822-4ef6-a0dd-a234f1143a95 for instance with vm_state building and task_state spawning.
Aug 26 19:30:55 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078255.4708762, 0aa9e505-caf3-45d1-96e5-3df233d05f0c => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:30:55 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] VM Resumed (Lifecycle Event)
Aug 26 19:30:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:30:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:30:55 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Instance spawned successfully.
Aug 26 19:30:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:30:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:30:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:30:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:30:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:30:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:30:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:30:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:30:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:30:55 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:30:55 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078255.4718688, 0aa9e505-caf3-45d1-96e5-3df233d05f0c => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:30:55 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] VM Started (Lifecycle Event)
Aug 26 19:30:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:30:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:30:55 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:30:55 user nova-compute[73917]: INFO nova.compute.manager [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Took 6.61 seconds to spawn the instance on the hypervisor.
Aug 26 19:30:55 user nova-compute[73917]: DEBUG nova.compute.manager [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:30:55 user nova-compute[73917]: INFO nova.compute.manager [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Took 7.40 seconds to build instance.
Aug 26 19:30:55 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-34df8f17-77be-484c-a137-f88731acd7f9 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.623s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:30:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:30:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrwokucZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:31:01 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:31:01 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:31:01 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6194c7-7263-46cc-8f65-101540d0f56a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:31:01 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2621f3b1-05cf-4866-adc7-0ac5310028e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11] added
Aug 26 19:31:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40e06a3-27be-4e8c-83ae-ea1c46b34d22]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7870f24e-fbfd-4977-b551-e497ef6442bf]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QrwokucZ {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QrwokucZ" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[345fc284-230d-45cf-9176-48dc3c9dc8d5]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QrwokucZ'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0360706a-c477-4833-879e-fd57f651d508]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1402199c-3ab0-4c36-b16e-e05fd3febe70]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:31:01 user nova-compute[73917]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da (non-flash)
Aug 26 19:31:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:31:01 user nova-compute[73917]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da (non-flash)
Aug 26 19:31:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f070153-faa2-4ea5-bd52-3ad5511a0f6a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11, portal: 172.16.0.220,3260]
Aug 26 19:31:01 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11, portal: 172.16.0.220,3260] successful.
Aug 26 19:31:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[084595f1-c3e1-4da9-9a91-9739f2cfe24a]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad38c995-86bf-4a29-a579-1778ba8346ce]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:31:01 user nova-compute[73917]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da (non-flash)
Aug 26 19:31:01 user nova-compute[73917]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 (non-flash)
Aug 26 19:31:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:31:01 user nova-compute[73917]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da (non-flash)
Aug 26 19:31:01 user nova-compute[73917]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 (non-flash)
Aug 26 19:31:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c441b76-49d2-46ae-99b7-6fb52360bcec]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrwokucZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:31:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:31:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26130363936323239', 'path': '/dev/sdd'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:31:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130363936323239', 'path': '/dev/sdd'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:31:02 user nova-compute[73917]: DEBUG nova.objects.instance [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lazy-loading 'flavor' on Instance uuid d3dba60d-88f1-473c-abb8-44d35e2b6964 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:31:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:31:02 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:31:02 user nova-compute[73917]:   <source dev="/dev/sdd"/>
Aug 26 19:31:02 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:31:02 user nova-compute[73917]:   <serial>31143ddc-4385-4e95-9d5c-151179279c11</serial>
Aug 26 19:31:02 user nova-compute[73917]: </disk>
Aug 26 19:31:02 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:31:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:31:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:31:02 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] No VIF found with MAC fa:16:3e:bf:b3:2c, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:31:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2a07c41c-a48c-47ed-a167-8d7cd4470404 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "d3dba60d-88f1-473c-abb8-44d35e2b6964" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.359s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "d3dba60d-88f1-473c-abb8-44d35e2b6964" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "d3dba60d-88f1-473c-abb8-44d35e2b6964" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:05 user nova-compute[73917]: INFO nova.compute.manager [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Detaching volume 31143ddc-4385-4e95-9d5c-151179279c11
Aug 26 19:31:05 user nova-compute[73917]: INFO nova.virt.block_device [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Attempting to driver detach volume 31143ddc-4385-4e95-9d5c-151179279c11 from mountpoint /dev/vdb
Aug 26 19:31:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Attempting to detach device vdb from instance d3dba60d-88f1-473c-abb8-44d35e2b6964 from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:31:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:31:05 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:31:05 user nova-compute[73917]:   <source dev="/dev/sdd"/>
Aug 26 19:31:05 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:31:05 user nova-compute[73917]:   <serial>31143ddc-4385-4e95-9d5c-151179279c11</serial>
Aug 26 19:31:05 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:31:05 user nova-compute[73917]: </disk>
Aug 26 19:31:05 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:31:05 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Successfully detached device vdb from instance d3dba60d-88f1-473c-abb8-44d35e2b6964 from the persistent domain config.
Aug 26 19:31:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d3dba60d-88f1-473c-abb8-44d35e2b6964 from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:31:05 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:31:05 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:31:05 user nova-compute[73917]:   <source dev="/dev/sdd"/>
Aug 26 19:31:05 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:31:05 user nova-compute[73917]:   <serial>31143ddc-4385-4e95-9d5c-151179279c11</serial>
Aug 26 19:31:05 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:31:05 user nova-compute[73917]: </disk>
Aug 26 19:31:05 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693078266.1709309, d3dba60d-88f1-473c-abb8-44d35e2b6964 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d3dba60d-88f1-473c-abb8-44d35e2b6964 {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:31:06 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Successfully detached device vdb from instance d3dba60d-88f1-473c-abb8-44d35e2b6964 from the live domain config.
Aug 26 19:31:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrwokucZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:31:06 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:31:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b33cd23-3687-4072-a17e-393dce823ad1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[676b4f53-492b-4c42-af2c-c5f998ba8fe5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:31:06 user nova-compute[73917]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da (non-flash)
Aug 26 19:31:06 user nova-compute[73917]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 (non-flash)
Aug 26 19:31:06 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:31:06 user nova-compute[73917]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da (non-flash)
Aug 26 19:31:06 user nova-compute[73917]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 (non-flash)
Aug 26 19:31:06 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b785644c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11'): ({'sdd'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Removing single pathed devices sdd {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af46504-3a59-47fe-b600-88193ce2ef73]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ddfd80-feb4-42d4-bb68-09614842e69e]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Flushing IO for device /dev/sdd {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[238701cf-7e70-43e2-9dbd-481d1ea6b0e2]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1375d7c-bc3a-424e-adad-2fc936d0cabc]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] SCSI volumes sdd have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c6d56d-8417-440d-9122-b478c3d937a6]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcfb51f-ca10-4077-b676-adf4fda5df1b]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11, portal: 172.16.0.220,3260]
Aug 26 19:31:06 user nova-compute[73917]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11, portal: 172.16.0.220,3260] successful.
Aug 26 19:31:06 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31143ddc-4385-4e95-9d5c-151179279c11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e932db19-d6a7-4b6e-8d79-cf7f09ab2509]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] <== disconnect_volume: return (292ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:31:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:09 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:31:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:31:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-fbc66439-479c-4818-a416-c3c64d49741d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:31:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-fbc66439-479c-4818-a416-c3c64d49741d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:31:09 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:31:10 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Updating instance_info_cache with network_info: [{"id": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "address": "fa:16:3e:92:aa:c8", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd0eceb-37", "ovs_interfaceid": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:31:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-fbc66439-479c-4818-a416-c3c64d49741d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:31:10 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:31:10 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:31:10 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:31:10 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:31:10 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:31:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "df5c717a-62d8-444d-9968-ad682a31733c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "df5c717a-62d8-444d-9968-ad682a31733c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "df5c717a-62d8-444d-9968-ad682a31733c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:11 user nova-compute[73917]: INFO nova.compute.manager [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Terminating instance
Aug 26 19:31:11 user nova-compute[73917]: DEBUG nova.compute.manager [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:31:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:11 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG nova.compute.manager [req-2edacf14-87d8-40fd-b6b5-1e0d843ad05c req-74dade7a-a95e-4069-8254-a61ebb1ee5c8 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received event network-vif-unplugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2edacf14-87d8-40fd-b6b5-1e0d843ad05c req-74dade7a-a95e-4069-8254-a61ebb1ee5c8 service nova] Acquiring lock "df5c717a-62d8-444d-9968-ad682a31733c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2edacf14-87d8-40fd-b6b5-1e0d843ad05c req-74dade7a-a95e-4069-8254-a61ebb1ee5c8 service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2edacf14-87d8-40fd-b6b5-1e0d843ad05c req-74dade7a-a95e-4069-8254-a61ebb1ee5c8 service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG nova.compute.manager [req-2edacf14-87d8-40fd-b6b5-1e0d843ad05c req-74dade7a-a95e-4069-8254-a61ebb1ee5c8 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] No waiting events found dispatching network-vif-unplugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG nova.compute.manager [req-2edacf14-87d8-40fd-b6b5-1e0d843ad05c req-74dade7a-a95e-4069-8254-a61ebb1ee5c8 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received event network-vif-unplugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:12 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Instance destroyed successfully.
Aug 26 19:31:12 user nova-compute[73917]: DEBUG nova.objects.instance [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'resources' on Instance uuid df5c717a-62d8-444d-9968-ad682a31733c {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1063003833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1063003833',id=23,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68229e3ed72a45fa8c2c9a33780479ce',ramdisk_id='',reservation_id='r-3l0cspu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:19:11Z,user_data=None,user_id='e056c4ed5a18427a8fd1eaa6a3a795c0',uuid=df5c717a-62d8-444d-9968-ad682a31733c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "address": "fa:16:3e:ca:39:fd", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79ade91-3e", "ovs_interfaceid": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converting VIF {"id": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "address": "fa:16:3e:ca:39:fd", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79ade91-3e", "ovs_interfaceid": "b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:39:fd,bridge_name='br-int',has_traffic_filtering=True,id=b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb79ade91-3e') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG os_vif [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:39:fd,bridge_name='br-int',has_traffic_filtering=True,id=b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb79ade91-3e') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb79ade91-3e, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:31:12 user nova-compute[73917]: INFO os_vif [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:39:fd,bridge_name='br-int',has_traffic_filtering=True,id=b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb79ade91-3e')
Aug 26 19:31:12 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igCIsrHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:31:12 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:31:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ea24c2-2243-4ac2-be24-efb184e33983]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5a5032-7ff0-44a7-8c60-ff75a6cf6247]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:31:12 user nova-compute[73917]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da (non-flash)
Aug 26 19:31:12 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 (non-flash)
Aug 26 19:31:12 user nova-compute[73917]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da (non-flash)
Aug 26 19:31:12 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b985d9000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8'): ({'sdb'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Removing single pathed devices sdb {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[72613c25-918f-4ff9-84c6-e49d85a6fdfa]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a5b35c-ac7f-4a44-bffa-ea591691fbcd]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Flushing IO for device /dev/sdb {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d117703c-38a2-402b-9254-33355a3f0f78]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4967446c-4bde-4e03-9025-f9bdc609cfb7]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5fbd99-6fbd-46c3-ad6b-689df12692c5]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a2d7b1-7d90-4418-b46f-1de5e37ca712]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8, portal: 172.16.0.220,3260]
Aug 26 19:31:12 user nova-compute[73917]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8, portal: 172.16.0.220,3260] successful.
Aug 26 19:31:12 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc63fd3-8c17-4e2d-ae82-765e4ab5e5e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c93d266-8c07-4c38-9002-69c63bc481ef]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] <== disconnect_volume: return (295ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:31:12 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:31:12 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Deleting instance files /opt/stack/data/nova/instances/df5c717a-62d8-444d-9968-ad682a31733c_del
Aug 26 19:31:12 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Deletion of /opt/stack/data/nova/instances/df5c717a-62d8-444d-9968-ad682a31733c_del complete
Aug 26 19:31:13 user nova-compute[73917]: DEBUG nova.objects.instance [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lazy-loading 'flavor' on Instance uuid d3dba60d-88f1-473c-abb8-44d35e2b6964 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "2598d318-3080-4be3-a4f5-36b3f7d292b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "2598d318-3080-4be3-a4f5-36b3f7d292b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:13 user nova-compute[73917]: INFO nova.compute.manager [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: df5c717a-62d8-444d-9968-ad682a31733c] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:31:13 user nova-compute[73917]: INFO nova.compute.manager [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Detaching volume 79fa6c1f-c9e0-49b4-9d6a-0cb2832975da
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-447fd18f-5617-42d7-ad9a-ee50c92913b1 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "d3dba60d-88f1-473c-abb8-44d35e2b6964" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.623s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:13 user nova-compute[73917]: INFO nova.virt.block_device [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Attempting to driver detach volume 79fa6c1f-c9e0-49b4-9d6a-0cb2832975da from mountpoint /dev/vdb
Aug 26 19:31:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Attempting to detach device vdb from instance 2598d318-3080-4be3-a4f5-36b3f7d292b0 from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:31:13 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:31:13 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:31:13 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:31:13 user nova-compute[73917]:   <serial>79fa6c1f-c9e0-49b4-9d6a-0cb2832975da</serial>
Aug 26 19:31:13 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:31:13 user nova-compute[73917]: </disk>
Aug 26 19:31:13 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:31:13 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Successfully detached device vdb from instance 2598d318-3080-4be3-a4f5-36b3f7d292b0 from the persistent domain config.
Aug 26 19:31:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2598d318-3080-4be3-a4f5-36b3f7d292b0 from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:31:13 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:31:13 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:31:13 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:31:13 user nova-compute[73917]:   <serial>79fa6c1f-c9e0-49b4-9d6a-0cb2832975da</serial>
Aug 26 19:31:13 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:31:13 user nova-compute[73917]: </disk>
Aug 26 19:31:13 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "2598d318-3080-4be3-a4f5-36b3f7d292b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693078273.5909443, 2598d318-3080-4be3-a4f5-36b3f7d292b0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2598d318-3080-4be3-a4f5-36b3f7d292b0 {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:31:13 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Successfully detached device vdb from instance 2598d318-3080-4be3-a4f5-36b3f7d292b0 from the live domain config.
Aug 26 19:31:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WmbKCwrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:31:13 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:31:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[705d9df1-1735-462f-8277-bda0a24607a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e122ba4-9b04-45d2-af97-99233bbe6636]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da (non-flash)
Aug 26 19:31:13 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da (non-flash)
Aug 26 19:31:13 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6bb51bc5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da'): ({'sdc'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Removing single pathed devices sdc {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa3a323-d8f5-4de1-a50d-6df23c45ec3b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[887f6a23-b5c2-4174-bb53-ca8315965be6]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Flushing IO for device /dev/sdc {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4096e0-c4a6-4fd0-82f5-97f6343a8964]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[467fc4e3-ffe9-476c-a760-684a0bbd3453]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-48171310-e11a-434c-a97e-61f0aa724146 req-022d1b4a-5005-4643-965f-0cdd6cebc8b7 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received event network-vif-deleted-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:31:13 user nova-compute[73917]: INFO nova.compute.manager [req-48171310-e11a-434c-a97e-61f0aa724146 req-022d1b4a-5005-4643-965f-0cdd6cebc8b7 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Neutron deleted interface b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e; detaching it from the instance and deleting it from the info cache
Aug 26 19:31:13 user nova-compute[73917]: DEBUG nova.network.neutron [req-48171310-e11a-434c-a97e-61f0aa724146 req-022d1b4a-5005-4643-965f-0cdd6cebc8b7 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8d1194-2281-43cc-9e19-ae00027abf51]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:13 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Took 0.74 seconds to deallocate network for instance.
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-48171310-e11a-434c-a97e-61f0aa724146 req-022d1b4a-5005-4643-965f-0cdd6cebc8b7 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Detach interface failed, port_id=b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e, reason: Instance df5c717a-62d8-444d-9968-ad682a31733c could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce5fd97-c83f-40f9-ac07-a806e08529dc]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da, portal: 172.16.0.220,3260]
Aug 26 19:31:13 user nova-compute[73917]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da, portal: 172.16.0.220,3260] successful.
Aug 26 19:31:13 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e46118-2fac-4e7d-8466-b9ac25e6eb89]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] <== disconnect_volume: return (290ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG nova.compute.manager [req-3a794d18-feae-475c-9b33-e575daa5bac7 req-98c876b1-9deb-41af-b2ee-59631b6243e7 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received event network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a794d18-feae-475c-9b33-e575daa5bac7 req-98c876b1-9deb-41af-b2ee-59631b6243e7 service nova] Acquiring lock "df5c717a-62d8-444d-9968-ad682a31733c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a794d18-feae-475c-9b33-e575daa5bac7 req-98c876b1-9deb-41af-b2ee-59631b6243e7 service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-3a794d18-feae-475c-9b33-e575daa5bac7 req-98c876b1-9deb-41af-b2ee-59631b6243e7 service nova] Lock "df5c717a-62d8-444d-9968-ad682a31733c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG nova.compute.manager [req-3a794d18-feae-475c-9b33-e575daa5bac7 req-98c876b1-9deb-41af-b2ee-59631b6243e7 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] No waiting events found dispatching network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:31:14 user nova-compute[73917]: WARNING nova.compute.manager [req-3a794d18-feae-475c-9b33-e575daa5bac7 req-98c876b1-9deb-41af-b2ee-59631b6243e7 service nova] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Received unexpected event network-vif-plugged-b79ade91-3e3b-4cbf-a643-6c9ca4a0a40e for instance with vm_state active and task_state deleting.
Aug 26 19:31:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG nova.objects.instance [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lazy-loading 'flavor' on Instance uuid 2598d318-3080-4be3-a4f5-36b3f7d292b0 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:31:14 user nova-compute[73917]: INFO nova.compute.manager [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Took 0.90 seconds to detach 1 volumes for instance.
Aug 26 19:31:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a783122e-31b5-43eb-bfd3-87604b005b92 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "2598d318-3080-4be3-a4f5-36b3f7d292b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.721s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "2598d318-3080-4be3-a4f5-36b3f7d292b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.622s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "2598d318-3080-4be3-a4f5-36b3f7d292b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "2598d318-3080-4be3-a4f5-36b3f7d292b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "2598d318-3080-4be3-a4f5-36b3f7d292b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:14 user nova-compute[73917]: INFO nova.compute.manager [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Terminating instance
Aug 26 19:31:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:15 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Deleted allocations for instance df5c717a-62d8-444d-9968-ad682a31733c
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-29ada7eb-ec86-4f27-9331-71f5c03a5d03 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "df5c717a-62d8-444d-9968-ad682a31733c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.501s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:15 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Instance destroyed successfully.
Aug 26 19:31:15 user nova-compute[73917]: DEBUG nova.objects.instance [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lazy-loading 'resources' on Instance uuid 2598d318-3080-4be3-a4f5-36b3f7d292b0 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1342186890',display_name='tempest-VolumesSnapshotTestJSON-instance-1342186890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1342186890',id=39,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4Ifi6rBY9orjFbfIvVvCIefhAlGW8HG0Vp+dsu7nkSbbnxa+dplGoPrRYys/y5XoV7H6dvBxiyzA8ZIvfOat2x4aCBxSLHTzWkQGMOyEe+4HMFYyEu2yuV9U3FxW7jHw==',key_name='tempest-keypair-397506445',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:28:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02a44e229f9e4101bb1edf230efcf8bd',ramdisk_id='',reservation_id='r-y0frzvku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1190045200',owner_user_name='tempest-VolumesSnapshotTestJSON-1190045200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:28:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='714d650d67d74694b520329848fc88b7',uuid=2598d318-3080-4be3-a4f5-36b3f7d292b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "address": "fa:16:3e:ac:7b:eb", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99fa1fd-a7", "ovs_interfaceid": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Converting VIF {"id": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "address": "fa:16:3e:ac:7b:eb", "network": {"id": "b47e702d-90fc-48c8-bdef-274729c534a6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-999126952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02a44e229f9e4101bb1edf230efcf8bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99fa1fd-a7", "ovs_interfaceid": "d99fa1fd-a7a0-4fbf-9b39-954d9be00027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:7b:eb,bridge_name='br-int',has_traffic_filtering=True,id=d99fa1fd-a7a0-4fbf-9b39-954d9be00027,network=Network(b47e702d-90fc-48c8-bdef-274729c534a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99fa1fd-a7') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG os_vif [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:7b:eb,bridge_name='br-int',has_traffic_filtering=True,id=d99fa1fd-a7a0-4fbf-9b39-954d9be00027,network=Network(b47e702d-90fc-48c8-bdef-274729c534a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99fa1fd-a7') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd99fa1fd-a7, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:31:15 user nova-compute[73917]: INFO os_vif [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:7b:eb,bridge_name='br-int',has_traffic_filtering=True,id=d99fa1fd-a7a0-4fbf-9b39-954d9be00027,network=Network(b47e702d-90fc-48c8-bdef-274729c534a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99fa1fd-a7')
Aug 26 19:31:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WmbKCwrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:31:15 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:31:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79fa6c1f-c9e0-49b4-9d6a-0cb2832975da', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca1de61-91d8-4c4f-a354-d3541b48fd0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:15 user nova-compute[73917]: WARNING os_brick.initiator.connectors.iscsi [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 26 19:31:15 user nova-compute[73917]: 
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[777ddb4e-5e59-41e4-980b-e4203c40da8f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 19:31:15 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 19:31:15 user nova-compute[73917]:  {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:31:15 user nova-compute[73917]: WARNING os_brick.initiator.connectors.iscsi [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 19:31:15 user nova-compute[73917]: 
Aug 26 19:31:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b785676d0>, {}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Disconnecting from: [] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.044s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] <== disconnect_volume: return (45ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:31:15 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Deleting instance files /opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0_del
Aug 26 19:31:15 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Deletion of /opt/stack/data/nova/instances/2598d318-3080-4be3-a4f5-36b3f7d292b0_del complete
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-6dfca765-6b82-47d0-b238-18b9443cad25 req-f395701a-589d-431f-998b-a51ad7cbfab1 service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Received event network-vif-unplugged-d99fa1fd-a7a0-4fbf-9b39-954d9be00027 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6dfca765-6b82-47d0-b238-18b9443cad25 req-f395701a-589d-431f-998b-a51ad7cbfab1 service nova] Acquiring lock "2598d318-3080-4be3-a4f5-36b3f7d292b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6dfca765-6b82-47d0-b238-18b9443cad25 req-f395701a-589d-431f-998b-a51ad7cbfab1 service nova] Lock "2598d318-3080-4be3-a4f5-36b3f7d292b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6dfca765-6b82-47d0-b238-18b9443cad25 req-f395701a-589d-431f-998b-a51ad7cbfab1 service nova] Lock "2598d318-3080-4be3-a4f5-36b3f7d292b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-6dfca765-6b82-47d0-b238-18b9443cad25 req-f395701a-589d-431f-998b-a51ad7cbfab1 service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] No waiting events found dispatching network-vif-unplugged-d99fa1fd-a7a0-4fbf-9b39-954d9be00027 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-6dfca765-6b82-47d0-b238-18b9443cad25 req-f395701a-589d-431f-998b-a51ad7cbfab1 service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Received event network-vif-unplugged-d99fa1fd-a7a0-4fbf-9b39-954d9be00027 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-6dfca765-6b82-47d0-b238-18b9443cad25 req-f395701a-589d-431f-998b-a51ad7cbfab1 service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Received event network-vif-plugged-d99fa1fd-a7a0-4fbf-9b39-954d9be00027 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6dfca765-6b82-47d0-b238-18b9443cad25 req-f395701a-589d-431f-998b-a51ad7cbfab1 service nova] Acquiring lock "2598d318-3080-4be3-a4f5-36b3f7d292b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6dfca765-6b82-47d0-b238-18b9443cad25 req-f395701a-589d-431f-998b-a51ad7cbfab1 service nova] Lock "2598d318-3080-4be3-a4f5-36b3f7d292b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6dfca765-6b82-47d0-b238-18b9443cad25 req-f395701a-589d-431f-998b-a51ad7cbfab1 service nova] Lock "2598d318-3080-4be3-a4f5-36b3f7d292b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-6dfca765-6b82-47d0-b238-18b9443cad25 req-f395701a-589d-431f-998b-a51ad7cbfab1 service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] No waiting events found dispatching network-vif-plugged-d99fa1fd-a7a0-4fbf-9b39-954d9be00027 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:31:15 user nova-compute[73917]: WARNING nova.compute.manager [req-6dfca765-6b82-47d0-b238-18b9443cad25 req-f395701a-589d-431f-998b-a51ad7cbfab1 service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Received unexpected event network-vif-plugged-d99fa1fd-a7a0-4fbf-9b39-954d9be00027 for instance with vm_state active and task_state deleting.
Aug 26 19:31:15 user nova-compute[73917]: INFO nova.compute.manager [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:16 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Error from libvirt while getting description of instance-00000027: [Error Code 42] Domain not found: no domain with matching uuid '2598d318-3080-4be3-a4f5-36b3f7d292b0' (instance-00000027): libvirt.libvirtError: Domain not found: no domain with matching uuid '2598d318-3080-4be3-a4f5-36b3f7d292b0' (instance-00000027)
Aug 26 19:31:16 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:31:16 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:31:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=7749MB free_disk=24.900466918945312GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:31:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 94f8d4e7-f310-45df-a0ae-82e608ac0119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:31:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fbc66439-479c-4818-a416-c3c64d49741d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:31:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 2598d318-3080-4be3-a4f5-36b3f7d292b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:31:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance d3dba60d-88f1-473c-abb8-44d35e2b6964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:31:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance dfb9fa80-41e1-4c0f-a0da-89fa020581ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:31:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 24e53fcd-f3ea-4f6a-a09c-83813f739a1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:31:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 0aa9e505-caf3-45d1-96e5-3df233d05f0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:31:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:31:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:31:16 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:31:16 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Took 0.85 seconds to deallocate network for instance.
Aug 26 19:31:16 user nova-compute[73917]: WARNING nova.volume.cinder [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Attachment 49e1a5f5-70ed-425f-848b-241cb2248277 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 49e1a5f5-70ed-425f-848b-241cb2248277. (HTTP 404) (Request-ID: req-d42ca0f8-f2fa-490a-b341-40c87e746fe1)
Aug 26 19:31:16 user nova-compute[73917]: INFO nova.compute.manager [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Took 0.02 seconds to detach 1 volumes for instance.
Aug 26 19:31:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:16 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:31:16 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:31:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:31:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.093s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:17 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:31:17 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:31:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:17 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Deleted allocations for instance 2598d318-3080-4be3-a4f5-36b3f7d292b0
Aug 26 19:31:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-132ca58d-2047-474b-933b-9336139f4190 tempest-VolumesSnapshotTestJSON-1190045200 tempest-VolumesSnapshotTestJSON-1190045200-project-member] Lock "2598d318-3080-4be3-a4f5-36b3f7d292b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.421s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:17 user nova-compute[73917]: DEBUG nova.compute.manager [req-28e18288-4d35-4c24-a1fc-bbae5426f870 req-a718c029-3070-42bf-b7b3-32c3b49dc2b8 service nova] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Received event network-vif-deleted-d99fa1fd-a7a0-4fbf-9b39-954d9be00027 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:31:17 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:31:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:27 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693078272.6565962, df5c717a-62d8-444d-9968-ad682a31733c => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:31:27 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: df5c717a-62d8-444d-9968-ad682a31733c] VM Stopped (Lifecycle Event)
Aug 26 19:31:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-8ba063cc-d4d3-48b0-88d0-8d8b39888bdd None None] [instance: df5c717a-62d8-444d-9968-ad682a31733c] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:31:30 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693078275.602548, 2598d318-3080-4be3-a4f5-36b3f7d292b0 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:31:30 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] VM Stopped (Lifecycle Event)
Aug 26 19:31:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-8c14d441-a78d-4078-a7f2-771ba970f560 None None] [instance: 2598d318-3080-4be3-a4f5-36b3f7d292b0] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:31:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:31:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:31:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:31:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:31:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:31:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG nova.objects.instance [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lazy-loading 'flavor' on Instance uuid dfb9fa80-41e1-4c0f-a0da-89fa020581ef {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:44 user nova-compute[73917]: INFO nova.compute.manager [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Attaching volume 00048de6-d6f5-4110-a320-4050c20dff48 to /dev/vdb
Aug 26 19:31:44 user nova-compute[73917]: DEBUG os_brick.utils [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c52feb-6d54-47b7-ae74-569e245f86b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e7dfce-29ad-4716-b75b-290e452d7beb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c743db-073e-40ed-aafb-9901c42bb251]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73aa904-8fc7-4c67-8e81-23ab3a85639c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:31:44 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:31:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb2d013-0da4-44a0-b7b1-8d054e622268]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG os_brick.utils [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:31:44 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Updating existing volume attachment record: 40f84ee5-428e-4d3d-bc5c-e810e2489b74 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:31:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:31:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBeZEgwY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:31:55 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:31:55 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:31:55 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d128528-8389-4678-8fcd-373ca1602b79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:31:55 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7a895b-fa68-4264-8723-b8c82253011d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48] added
Aug 26 19:31:55 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c12dd8-f606-4af1-b067-008404f78694]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45eb8bd-08e3-4591-944b-46c80a519739]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yBeZEgwY {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yBeZEgwY" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[911671a7-2515-4d3e-9689-e94c01b48710]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yBeZEgwY'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad18455-741d-4f74-9671-0efcc26586b6]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2395b679-5727-4cea-8f70-4477901cd679]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 19:31:55 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 19:31:55 user nova-compute[73917]:  {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:31:55 user nova-compute[73917]: WARNING os_brick.initiator.connectors.iscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 19:31:55 user nova-compute[73917]: 
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3820814c-f7ab-4d6d-bf82-8fcff02293d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48, portal: 172.16.0.220,3260]
Aug 26 19:31:55 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48, portal: 172.16.0.220,3260] successful.
Aug 26 19:31:55 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.058s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e17306c-b33c-43b4-82f7-9e44d4eacfa2]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c2560e-87e4-4db3-a71e-86da186ec004]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)
Aug 26 19:31:55 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)
Aug 26 19:31:55 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[309b00a7-a0dd-4fb1-aad6-9438bef641b4]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:31:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG nova.compute.manager [req-742a5d31-a2c9-45ff-ade8-2498fc73cad2 req-d669c590-495c-423f-ae8e-3df03009da76 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Received event network-changed-7221da13-0718-4966-b23a-69b49c853426 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG nova.compute.manager [req-742a5d31-a2c9-45ff-ade8-2498fc73cad2 req-d669c590-495c-423f-ae8e-3df03009da76 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Refreshing instance network info cache due to event network-changed-7221da13-0718-4966-b23a-69b49c853426. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-742a5d31-a2c9-45ff-ade8-2498fc73cad2 req-d669c590-495c-423f-ae8e-3df03009da76 service nova] Acquiring lock "refresh_cache-d3dba60d-88f1-473c-abb8-44d35e2b6964" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-742a5d31-a2c9-45ff-ade8-2498fc73cad2 req-d669c590-495c-423f-ae8e-3df03009da76 service nova] Acquired lock "refresh_cache-d3dba60d-88f1-473c-abb8-44d35e2b6964" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG nova.network.neutron [req-742a5d31-a2c9-45ff-ade8-2498fc73cad2 req-d669c590-495c-423f-ae8e-3df03009da76 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Refreshing network info cache for port 7221da13-0718-4966-b23a-69b49c853426 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "d3dba60d-88f1-473c-abb8-44d35e2b6964" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "d3dba60d-88f1-473c-abb8-44d35e2b6964" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "d3dba60d-88f1-473c-abb8-44d35e2b6964-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "d3dba60d-88f1-473c-abb8-44d35e2b6964-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "d3dba60d-88f1-473c-abb8-44d35e2b6964-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:56 user nova-compute[73917]: INFO nova.compute.manager [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Terminating instance
Aug 26 19:31:56 user nova-compute[73917]: DEBUG nova.compute.manager [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBeZEgwY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26364616331663363', 'path': '/dev/sdb'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364616331663363', 'path': '/dev/sdb'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG nova.objects.instance [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lazy-loading 'flavor' on Instance uuid dfb9fa80-41e1-4c0f-a0da-89fa020581ef {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:31:56 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:31:56 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 19:31:56 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:31:56 user nova-compute[73917]:   <serial>00048de6-d6f5-4110-a320-4050c20dff48</serial>
Aug 26 19:31:56 user nova-compute[73917]: </disk>
Aug 26 19:31:56 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG nova.network.neutron [req-742a5d31-a2c9-45ff-ade8-2498fc73cad2 req-d669c590-495c-423f-ae8e-3df03009da76 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Updated VIF entry in instance network info cache for port 7221da13-0718-4966-b23a-69b49c853426. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG nova.network.neutron [req-742a5d31-a2c9-45ff-ade8-2498fc73cad2 req-d669c590-495c-423f-ae8e-3df03009da76 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Updating instance_info_cache with network_info: [{"id": "7221da13-0718-4966-b23a-69b49c853426", "address": "fa:16:3e:bf:b3:2c", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221da13-07", "ovs_interfaceid": "7221da13-0718-4966-b23a-69b49c853426", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:31:56 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-742a5d31-a2c9-45ff-ade8-2498fc73cad2 req-d669c590-495c-423f-ae8e-3df03009da76 service nova] Releasing lock "refresh_cache-d3dba60d-88f1-473c-abb8-44d35e2b6964" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:31:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:31:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:31:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] No VIF found with MAC fa:16:3e:0c:18:e2, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:31:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-547e3e6d-a2cd-4baa-b094-e491dd8b0829 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.719s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:57 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Instance destroyed successfully.
Aug 26 19:31:57 user nova-compute[73917]: DEBUG nova.objects.instance [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lazy-loading 'resources' on Instance uuid d3dba60d-88f1-473c-abb8-44d35e2b6964 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:31:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:28:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-67211559',display_name='tempest-TestStampPattern-server-67211559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-67211559',id=40,image_ref='99786710-af44-44c9-90d0-0eaa01f98867',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3qikrHaZv1b57+PYsAMrjbGE8666IZRULu8TbUkxpO21qNoIsGBqbZ/2lTZ8QJOtcHXsoQIRIproBK4xx57gBXc3m4j4E+STy5i75C4teNDHC5iYRzQB7oXEceIdSncQ==',key_name='tempest-TestStampPattern-235197864',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:29:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e307e771e354caa99ff68b73b842743',ramdisk_id='',reservation_id='r-5z20wjer',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fbc66439-479c-4818-a416-c3c64d49741d',image_min_disk='1',image_min_ram='0',image_owner_id='4e307e771e354caa99ff68b73b842743',image_owner_project_name='tempest-TestStampPattern-432009003',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-432009003-project-member',image_user_id='22f87b69a0fb471f9ec5373b208d3abc',owner_project_name='tempest-TestStampPattern-432009003',owner_user_name='tempest-TestStampPattern-432009003-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:29:04Z,user_data=None,user_id='22f87b69a0fb471f9ec5373b208d3abc',uuid=d3dba60d-88f1-473c-abb8-44d35e2b6964,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7221da13-0718-4966-b23a-69b49c853426", "address": "fa:16:3e:bf:b3:2c", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221da13-07", "ovs_interfaceid": "7221da13-0718-4966-b23a-69b49c853426", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:31:57 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Converting VIF {"id": "7221da13-0718-4966-b23a-69b49c853426", "address": "fa:16:3e:bf:b3:2c", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221da13-07", "ovs_interfaceid": "7221da13-0718-4966-b23a-69b49c853426", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:31:57 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:b3:2c,bridge_name='br-int',has_traffic_filtering=True,id=7221da13-0718-4966-b23a-69b49c853426,network=Network(1cf7828d-2911-4253-bc82-d0fa6677f746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7221da13-07') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:31:57 user nova-compute[73917]: DEBUG os_vif [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:b3:2c,bridge_name='br-int',has_traffic_filtering=True,id=7221da13-0718-4966-b23a-69b49c853426,network=Network(1cf7828d-2911-4253-bc82-d0fa6677f746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7221da13-07') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:31:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7221da13-07, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:31:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:31:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:31:57 user nova-compute[73917]: INFO os_vif [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:b3:2c,bridge_name='br-int',has_traffic_filtering=True,id=7221da13-0718-4966-b23a-69b49c853426,network=Network(1cf7828d-2911-4253-bc82-d0fa6677f746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7221da13-07')
Aug 26 19:31:57 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Deleting instance files /opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964_del
Aug 26 19:31:57 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Deletion of /opt/stack/data/nova/instances/d3dba60d-88f1-473c-abb8-44d35e2b6964_del complete
Aug 26 19:31:57 user nova-compute[73917]: INFO nova.compute.manager [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 26 19:31:57 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:31:57 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:31:57 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:31:57 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:31:57 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Took 0.49 seconds to deallocate network for instance.
Aug 26 19:31:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:58 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:31:58 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:31:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:58 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Deleted allocations for instance d3dba60d-88f1-473c-abb8-44d35e2b6964
Aug 26 19:31:58 user nova-compute[73917]: DEBUG nova.compute.manager [req-4100c7e9-ae9f-4262-96f9-8f6fb4401f8b req-75eeb20a-454a-4aea-8174-ca1db9d80749 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Received event network-vif-unplugged-7221da13-0718-4966-b23a-69b49c853426 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:31:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4100c7e9-ae9f-4262-96f9-8f6fb4401f8b req-75eeb20a-454a-4aea-8174-ca1db9d80749 service nova] Acquiring lock "d3dba60d-88f1-473c-abb8-44d35e2b6964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4100c7e9-ae9f-4262-96f9-8f6fb4401f8b req-75eeb20a-454a-4aea-8174-ca1db9d80749 service nova] Lock "d3dba60d-88f1-473c-abb8-44d35e2b6964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4100c7e9-ae9f-4262-96f9-8f6fb4401f8b req-75eeb20a-454a-4aea-8174-ca1db9d80749 service nova] Lock "d3dba60d-88f1-473c-abb8-44d35e2b6964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:58 user nova-compute[73917]: DEBUG nova.compute.manager [req-4100c7e9-ae9f-4262-96f9-8f6fb4401f8b req-75eeb20a-454a-4aea-8174-ca1db9d80749 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] No waiting events found dispatching network-vif-unplugged-7221da13-0718-4966-b23a-69b49c853426 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:31:58 user nova-compute[73917]: WARNING nova.compute.manager [req-4100c7e9-ae9f-4262-96f9-8f6fb4401f8b req-75eeb20a-454a-4aea-8174-ca1db9d80749 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Received unexpected event network-vif-unplugged-7221da13-0718-4966-b23a-69b49c853426 for instance with vm_state deleted and task_state None.
Aug 26 19:31:58 user nova-compute[73917]: DEBUG nova.compute.manager [req-4100c7e9-ae9f-4262-96f9-8f6fb4401f8b req-75eeb20a-454a-4aea-8174-ca1db9d80749 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Received event network-vif-plugged-7221da13-0718-4966-b23a-69b49c853426 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:31:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4100c7e9-ae9f-4262-96f9-8f6fb4401f8b req-75eeb20a-454a-4aea-8174-ca1db9d80749 service nova] Acquiring lock "d3dba60d-88f1-473c-abb8-44d35e2b6964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:31:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4100c7e9-ae9f-4262-96f9-8f6fb4401f8b req-75eeb20a-454a-4aea-8174-ca1db9d80749 service nova] Lock "d3dba60d-88f1-473c-abb8-44d35e2b6964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:31:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4100c7e9-ae9f-4262-96f9-8f6fb4401f8b req-75eeb20a-454a-4aea-8174-ca1db9d80749 service nova] Lock "d3dba60d-88f1-473c-abb8-44d35e2b6964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:31:58 user nova-compute[73917]: DEBUG nova.compute.manager [req-4100c7e9-ae9f-4262-96f9-8f6fb4401f8b req-75eeb20a-454a-4aea-8174-ca1db9d80749 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] No waiting events found dispatching network-vif-plugged-7221da13-0718-4966-b23a-69b49c853426 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:31:58 user nova-compute[73917]: WARNING nova.compute.manager [req-4100c7e9-ae9f-4262-96f9-8f6fb4401f8b req-75eeb20a-454a-4aea-8174-ca1db9d80749 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Received unexpected event network-vif-plugged-7221da13-0718-4966-b23a-69b49c853426 for instance with vm_state deleted and task_state None.
Aug 26 19:31:58 user nova-compute[73917]: DEBUG nova.compute.manager [req-4100c7e9-ae9f-4262-96f9-8f6fb4401f8b req-75eeb20a-454a-4aea-8174-ca1db9d80749 service nova] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Received event network-vif-deleted-7221da13-0718-4966-b23a-69b49c853426 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:31:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-89e4afd6-fd0e-4c82-9d62-e43ed130552d tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "d3dba60d-88f1-473c-abb8-44d35e2b6964" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.965s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:32:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "94f8d4e7-f310-45df-a0ae-82e608ac0119" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:32:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "94f8d4e7-f310-45df-a0ae-82e608ac0119" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:32:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "94f8d4e7-f310-45df-a0ae-82e608ac0119-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:32:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "94f8d4e7-f310-45df-a0ae-82e608ac0119-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:32:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "94f8d4e7-f310-45df-a0ae-82e608ac0119-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:32:02 user nova-compute[73917]: INFO nova.compute.manager [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Terminating instance
Aug 26 19:32:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:32:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:02 user nova-compute[73917]: DEBUG nova.compute.manager [req-e8bf5c2b-0535-44ab-afe1-cde6dccb9256 req-42fcb582-80f4-40c6-8d6d-9a63a76e9b98 service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Received event network-vif-unplugged-ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:32:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e8bf5c2b-0535-44ab-afe1-cde6dccb9256 req-42fcb582-80f4-40c6-8d6d-9a63a76e9b98 service nova] Acquiring lock "94f8d4e7-f310-45df-a0ae-82e608ac0119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:32:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e8bf5c2b-0535-44ab-afe1-cde6dccb9256 req-42fcb582-80f4-40c6-8d6d-9a63a76e9b98 service nova] Lock "94f8d4e7-f310-45df-a0ae-82e608ac0119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:32:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e8bf5c2b-0535-44ab-afe1-cde6dccb9256 req-42fcb582-80f4-40c6-8d6d-9a63a76e9b98 service nova] Lock "94f8d4e7-f310-45df-a0ae-82e608ac0119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:32:02 user nova-compute[73917]: DEBUG nova.compute.manager [req-e8bf5c2b-0535-44ab-afe1-cde6dccb9256 req-42fcb582-80f4-40c6-8d6d-9a63a76e9b98 service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] No waiting events found dispatching network-vif-unplugged-ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:32:02 user nova-compute[73917]: DEBUG nova.compute.manager [req-e8bf5c2b-0535-44ab-afe1-cde6dccb9256 req-42fcb582-80f4-40c6-8d6d-9a63a76e9b98 service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Received event network-vif-unplugged-ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:32:03 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Instance destroyed successfully.
Aug 26 19:32:03 user nova-compute[73917]: DEBUG nova.objects.instance [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lazy-loading 'resources' on Instance uuid 94f8d4e7-f310-45df-a0ae-82e608ac0119 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:32:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-37194563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-37194563',id=18,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:12:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68229e3ed72a45fa8c2c9a33780479ce',ramdisk_id='',reservation_id='r-bpu4l55f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:14:21Z,user_data=None,user_id='e056c4ed5a18427a8fd1eaa6a3a795c0',uuid=94f8d4e7-f310-45df-a0ae-82e608ac0119,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "address": "fa:16:3e:45:49:40", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea31a0cf-61", "ovs_interfaceid": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:32:03 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converting VIF {"id": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "address": "fa:16:3e:45:49:40", "network": {"id": "dc136f4c-ffc3-4135-ae94-551e2d90513b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-117440598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68229e3ed72a45fa8c2c9a33780479ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea31a0cf-61", "ovs_interfaceid": "ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:32:03 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:49:40,bridge_name='br-int',has_traffic_filtering=True,id=ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea31a0cf-61') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:32:03 user nova-compute[73917]: DEBUG os_vif [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:49:40,bridge_name='br-int',has_traffic_filtering=True,id=ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea31a0cf-61') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:32:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea31a0cf-61, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:32:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:32:03 user nova-compute[73917]: INFO os_vif [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:49:40,bridge_name='br-int',has_traffic_filtering=True,id=ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9,network=Network(dc136f4c-ffc3-4135-ae94-551e2d90513b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea31a0cf-61')
Aug 26 19:32:03 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Deleting instance files /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119_del
Aug 26 19:32:03 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Deletion of /opt/stack/data/nova/instances/94f8d4e7-f310-45df-a0ae-82e608ac0119_del complete
Aug 26 19:32:03 user nova-compute[73917]: INFO nova.compute.manager [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 26 19:32:03 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:32:03 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:32:03 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:32:04 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:32:04 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Took 0.58 seconds to deallocate network for instance.
Aug 26 19:32:04 user nova-compute[73917]: DEBUG nova.compute.manager [req-9066f127-da02-4854-b59c-058355d5b693 req-05343a1e-e9d8-4faa-8c9f-3b4c9d0a96d1 service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Received event network-vif-deleted-ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:32:04 user nova-compute[73917]: INFO nova.compute.manager [req-9066f127-da02-4854-b59c-058355d5b693 req-05343a1e-e9d8-4faa-8c9f-3b4c9d0a96d1 service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Neutron deleted interface ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9; detaching it from the instance and deleting it from the info cache
Aug 26 19:32:04 user nova-compute[73917]: DEBUG nova.network.neutron [req-9066f127-da02-4854-b59c-058355d5b693 req-05343a1e-e9d8-4faa-8c9f-3b4c9d0a96d1 service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:32:04 user nova-compute[73917]: DEBUG nova.compute.manager [req-9066f127-da02-4854-b59c-058355d5b693 req-05343a1e-e9d8-4faa-8c9f-3b4c9d0a96d1 service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Detach interface failed, port_id=ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9, reason: Instance 94f8d4e7-f310-45df-a0ae-82e608ac0119 could not be found. {{(pid=73917) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 19:32:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:32:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:32:04 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:32:04 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:32:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:32:04 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Deleted allocations for instance 94f8d4e7-f310-45df-a0ae-82e608ac0119
Aug 26 19:32:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cf4e6750-239b-49a4-a8ca-0aca7f9fdc63 tempest-ServerBootFromVolumeStableRescueTest-1067875450 tempest-ServerBootFromVolumeStableRescueTest-1067875450-project-member] Lock "94f8d4e7-f310-45df-a0ae-82e608ac0119" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.107s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:32:04 user nova-compute[73917]: DEBUG nova.compute.manager [req-55cb8689-a340-4cce-8151-ddedcca28901 req-1f129b59-4daf-4033-b53b-8fc2f9d2c986 service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Received event network-vif-plugged-ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:32:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-55cb8689-a340-4cce-8151-ddedcca28901 req-1f129b59-4daf-4033-b53b-8fc2f9d2c986 service nova] Acquiring lock "94f8d4e7-f310-45df-a0ae-82e608ac0119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:32:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-55cb8689-a340-4cce-8151-ddedcca28901 req-1f129b59-4daf-4033-b53b-8fc2f9d2c986 service nova] Lock "94f8d4e7-f310-45df-a0ae-82e608ac0119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:32:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-55cb8689-a340-4cce-8151-ddedcca28901 req-1f129b59-4daf-4033-b53b-8fc2f9d2c986 service nova] Lock "94f8d4e7-f310-45df-a0ae-82e608ac0119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:32:04 user nova-compute[73917]: DEBUG nova.compute.manager [req-55cb8689-a340-4cce-8151-ddedcca28901 req-1f129b59-4daf-4033-b53b-8fc2f9d2c986 service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] No waiting events found dispatching network-vif-plugged-ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:32:04 user nova-compute[73917]: WARNING nova.compute.manager [req-55cb8689-a340-4cce-8151-ddedcca28901 req-1f129b59-4daf-4033-b53b-8fc2f9d2c986 service nova] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Received unexpected event network-vif-plugged-ea31a0cf-61ba-4a5b-8a6b-b87a7dfd30b9 for instance with vm_state deleted and task_state None.
Aug 26 19:32:06 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:32:06 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:32:08 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:32:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:09 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:32:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:32:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Didn't find any instances for network info cache update. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 19:32:09 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:32:09 user nova-compute[73917]: DEBUG nova.compute.manager [req-7a6a60b3-30d1-4001-a060-df260d7f828c req-c4183710-4724-446b-8eeb-bc9a8b50d1e0 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received event network-changed-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:32:09 user nova-compute[73917]: DEBUG nova.compute.manager [req-7a6a60b3-30d1-4001-a060-df260d7f828c req-c4183710-4724-446b-8eeb-bc9a8b50d1e0 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Refreshing instance network info cache due to event network-changed-511b289f-3048-493d-b658-e31546805791. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:32:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-7a6a60b3-30d1-4001-a060-df260d7f828c req-c4183710-4724-446b-8eeb-bc9a8b50d1e0 service nova] Acquiring lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:32:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-7a6a60b3-30d1-4001-a060-df260d7f828c req-c4183710-4724-446b-8eeb-bc9a8b50d1e0 service nova] Acquired lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:32:09 user nova-compute[73917]: DEBUG nova.network.neutron [req-7a6a60b3-30d1-4001-a060-df260d7f828c req-c4183710-4724-446b-8eeb-bc9a8b50d1e0 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Refreshing network info cache for port 511b289f-3048-493d-b658-e31546805791 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:32:10 user nova-compute[73917]: DEBUG nova.network.neutron [req-7a6a60b3-30d1-4001-a060-df260d7f828c req-c4183710-4724-446b-8eeb-bc9a8b50d1e0 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Updated VIF entry in instance network info cache for port 511b289f-3048-493d-b658-e31546805791. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:32:10 user nova-compute[73917]: DEBUG nova.network.neutron [req-7a6a60b3-30d1-4001-a060-df260d7f828c req-c4183710-4724-446b-8eeb-bc9a8b50d1e0 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Updating instance_info_cache with network_info: [{"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:32:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-7a6a60b3-30d1-4001-a060-df260d7f828c req-c4183710-4724-446b-8eeb-bc9a8b50d1e0 service nova] Releasing lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:32:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-feff9f63-526a-43d3-8487-36235295a5f0 req-4abd17c3-5495-47ba-bae3-100eb5e77952 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received event network-changed-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:32:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-feff9f63-526a-43d3-8487-36235295a5f0 req-4abd17c3-5495-47ba-bae3-100eb5e77952 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Refreshing instance network info cache due to event network-changed-511b289f-3048-493d-b658-e31546805791. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:32:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-feff9f63-526a-43d3-8487-36235295a5f0 req-4abd17c3-5495-47ba-bae3-100eb5e77952 service nova] Acquiring lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:32:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-feff9f63-526a-43d3-8487-36235295a5f0 req-4abd17c3-5495-47ba-bae3-100eb5e77952 service nova] Acquired lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:32:11 user nova-compute[73917]: DEBUG nova.network.neutron [req-feff9f63-526a-43d3-8487-36235295a5f0 req-4abd17c3-5495-47ba-bae3-100eb5e77952 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Refreshing network info cache for port 511b289f-3048-493d-b658-e31546805791 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:32:12 user nova-compute[73917]: DEBUG nova.network.neutron [req-feff9f63-526a-43d3-8487-36235295a5f0 req-4abd17c3-5495-47ba-bae3-100eb5e77952 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Updated VIF entry in instance network info cache for port 511b289f-3048-493d-b658-e31546805791. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:32:12 user nova-compute[73917]: DEBUG nova.network.neutron [req-feff9f63-526a-43d3-8487-36235295a5f0 req-4abd17c3-5495-47ba-bae3-100eb5e77952 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Updating instance_info_cache with network_info: [{"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:32:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-feff9f63-526a-43d3-8487-36235295a5f0 req-4abd17c3-5495-47ba-bae3-100eb5e77952 service nova] Releasing lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:32:12 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:32:12 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693078317.3741179, d3dba60d-88f1-473c-abb8-44d35e2b6964 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:32:12 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] VM Stopped (Lifecycle Event)
Aug 26 19:32:12 user nova-compute[73917]: DEBUG nova.compute.manager [None req-0ea04750-c9ec-4cb6-97eb-d4f164a92e15 None None] [instance: d3dba60d-88f1-473c-abb8-44d35e2b6964] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:32:13 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:32:13 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:32:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:32:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:32:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:32:13 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:32:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:32:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:32:15 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:32:15 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:32:15 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8188MB free_disk=25.041702270507812GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:32:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:32:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:32:15 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance fbc66439-479c-4818-a416-c3c64d49741d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:32:15 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance dfb9fa80-41e1-4c0f-a0da-89fa020581ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:32:15 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 24e53fcd-f3ea-4f6a-a09c-83813f739a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:32:15 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 0aa9e505-caf3-45d1-96e5-3df233d05f0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:32:15 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:32:15 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:32:15 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:32:15 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:32:15 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:32:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:32:16 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:32:16 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:32:18 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693078323.2838957, 94f8d4e7-f310-45df-a0ae-82e608ac0119 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:32:18 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] VM Stopped (Lifecycle Event)
Aug 26 19:32:18 user nova-compute[73917]: DEBUG nova.compute.manager [None req-3384a538-086b-446d-93d5-88c747cfa755 None None] [instance: 94f8d4e7-f310-45df-a0ae-82e608ac0119] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:32:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:32:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:32:19 user nova-compute[73917]: INFO nova.compute.manager [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Rebooting instance
Aug 26 19:32:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:32:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquired lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:32:19 user nova-compute[73917]: DEBUG nova.network.neutron [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:32:19 user nova-compute[73917]: DEBUG nova.network.neutron [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Updating instance_info_cache with network_info: [{"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:32:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Releasing lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:32:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:32:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.compute.manager [req-ca0849ff-6d19-40bd-8859-fabf87028eef req-eb380746-4db3-4dec-9ef6-9d66ce88963a service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received event network-vif-unplugged-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ca0849ff-6d19-40bd-8859-fabf87028eef req-eb380746-4db3-4dec-9ef6-9d66ce88963a service nova] Acquiring lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ca0849ff-6d19-40bd-8859-fabf87028eef req-eb380746-4db3-4dec-9ef6-9d66ce88963a service nova] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ca0849ff-6d19-40bd-8859-fabf87028eef req-eb380746-4db3-4dec-9ef6-9d66ce88963a service nova] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.compute.manager [req-ca0849ff-6d19-40bd-8859-fabf87028eef req-eb380746-4db3-4dec-9ef6-9d66ce88963a service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] No waiting events found dispatching network-vif-unplugged-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:32:20 user nova-compute[73917]: WARNING nova.compute.manager [req-ca0849ff-6d19-40bd-8859-fabf87028eef req-eb380746-4db3-4dec-9ef6-9d66ce88963a service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received unexpected event network-vif-unplugged-511b289f-3048-493d-b658-e31546805791 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 19:32:20 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Instance destroyed successfully.
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.objects.instance [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lazy-loading 'resources' on Instance uuid dfb9fa80-41e1-4c0f-a0da-89fa020581ef {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-830005725',display_name='tempest-TestMinimumBasicScenario-server-830005725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-830005725',id=41,image_ref='f67140e5-e503-4aed-830e-32289bf444d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKIvXK+EFfAY8AbL9No26I8VkXN8H+s7RYjXU+kc/uU0ESbs6S2bOlZ3YqKLmR0KjWCcFGmGJECDyJn0N/OdkNO4xIFFra8Wly//jdVw7ylYCxB9DelSYujFH3w6qpR7w==',key_name='tempest-TestMinimumBasicScenario-2144509393',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70c87f2fad4648bf90baef68e16d6a5e',ramdisk_id='',reservation_id='r-fesjgsbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f67140e5-e503-4aed-830e-32289bf444d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1764501925',owner_user_name='tempest-TestMinimumBasicScenario-1764501925-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:32:20Z,user_data=None,user_id='00d8fe7c07284b06985746a92c11f518',uuid=dfb9fa80-41e1-4c0f-a0da-89fa020581ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Converting VIF {"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:18:e2,bridge_name='br-int',has_traffic_filtering=True,id=511b289f-3048-493d-b658-e31546805791,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511b289f-30') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_vif [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:18:e2,bridge_name='br-int',has_traffic_filtering=True,id=511b289f-3048-493d-b658-e31546805791,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511b289f-30') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap511b289f-30, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:32:20 user nova-compute[73917]: INFO os_vif [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:18:e2,bridge_name='br-int',has_traffic_filtering=True,id=511b289f-3048-493d-b658-e31546805791,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511b289f-30')
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBeZEgwY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:32:20 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe8bc05-a4e5-435a-bedd-780da227d7a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbefc69a-d5c2-474e-9e21-353d15aea3f3]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)
Aug 26 19:32:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)
Aug 26 19:32:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b78748430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48'): ({'sdb'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Removing single pathed devices sdb {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d91808-2c04-4824-9274-b9970c394474]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e38606-1e31-4e8a-b7ac-af576a13bff4]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Flushing IO for device /dev/sdb {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[65df5d09-125c-4eea-aea2-bee1e8fe4163]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9e87d3-1792-4fc4-8e8c-8fe8d6c2ffc8]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9954998a-97d8-43c3-86b2-57abfafcf389]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2980967d-9d54-4da0-99a7-63bcc97739cb]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48, portal: 172.16.0.220,3260]
Aug 26 19:32:20 user nova-compute[73917]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48, portal: 172.16.0.220,3260] successful.
Aug 26 19:32:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c7fb78-0038-4b07-9dac-8f6a0c2b3a84]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] <== disconnect_volume: return (259ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Start _get_guest_xml network_info=[{"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f67140e5-e503-4aed-830e-32289bf444d2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': 'f67140e5-e503-4aed-830e-32289bf444d2'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBeZEgwY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'dfb9fa80-41e1-4c0f-a0da-89fa020581ef', 'attached_at': '', 'detached_at': '', 'volume_id': '00048de6-d6f5-4110-a320-4050c20dff48', 'serial': '00048de6-d6f5-4110-a320-4050c20dff48'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '40f84ee5-428e-4d3d-bc5c-e810e2489b74', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:32:20 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:32:20 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f67140e5-e503-4aed-830e-32289bf444d2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.objects.instance [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lazy-loading 'vcpu_model' on Instance uuid dfb9fa80-41e1-4c0f-a0da-89fa020581ef {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.objects.base [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Object Instance<dfb9fa80-41e1-4c0f-a0da-89fa020581ef> lazy-loaded attributes: resources,vcpu_model {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBeZEgwY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:32:20 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:32:20 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:32:20 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6d69a4-5ea9-4e2e-a45c-9e729d68f249]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:32:20 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[000317ea-1ff5-4768-9cfe-4b2f24d4bc0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48] added
Aug 26 19:32:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef25e8ae-d463-46fc-8d4b-3b28d72e78ec]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf18cee-06f3-431f-9616-86136b852e5e]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yBeZEgwY {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yBeZEgwY" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf42b0e-eca8-4388-ae8e-7d6a209862ff]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yBeZEgwY'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f3cff3-5f78-4e18-8fbc-307b601c73c5]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebdbb65-9d8f-4205-8942-cfbca5bff26b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 19:32:20 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:32:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 19:32:20 user nova-compute[73917]:  {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:32:20 user nova-compute[73917]: WARNING os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 19:32:20 user nova-compute[73917]: 
Aug 26 19:32:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c36a85f-4069-4a63-b9dc-387adf4000e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48, portal: 172.16.0.220,3260]
Aug 26 19:32:21 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48, portal: 172.16.0.220,3260] successful.
Aug 26 19:32:21 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:32:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f36af77-1aec-4afe-ac2a-ade0d764772c]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:32:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[89194d64-12e9-4115-b2ec-310419fad51c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)
Aug 26 19:32:21 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:32:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)
Aug 26 19:32:21 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:32:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:32:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:32:21 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:32:21 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:32:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7819787-b02f-4252-860b-1a08690ed0b0]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:21 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-30b3af96-9faa-42eb-9137-1e7bf82d0e3c req-c26d46d4-e4f7-4931-8a42-77ec5bf447c8 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received event network-vif-plugged-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-30b3af96-9faa-42eb-9137-1e7bf82d0e3c req-c26d46d4-e4f7-4931-8a42-77ec5bf447c8 service nova] Acquiring lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-30b3af96-9faa-42eb-9137-1e7bf82d0e3c req-c26d46d4-e4f7-4931-8a42-77ec5bf447c8 service nova] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-30b3af96-9faa-42eb-9137-1e7bf82d0e3c req-c26d46d4-e4f7-4931-8a42-77ec5bf447c8 service nova] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-30b3af96-9faa-42eb-9137-1e7bf82d0e3c req-c26d46d4-e4f7-4931-8a42-77ec5bf447c8 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] No waiting events found dispatching network-vif-plugged-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:32:22 user nova-compute[73917]: WARNING nova.compute.manager [req-30b3af96-9faa-42eb-9137-1e7bf82d0e3c req-c26d46d4-e4f7-4931-8a42-77ec5bf447c8 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received unexpected event network-vif-plugged-511b289f-3048-493d-b658-e31546805791 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 19:32:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBeZEgwY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '26364616331663363', 'path': '/dev/sdb'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364616331663363', 'path': '/dev/sdb'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-830005725',display_name='tempest-TestMinimumBasicScenario-server-830005725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-830005725',id=41,image_ref='f67140e5-e503-4aed-830e-32289bf444d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKIvXK+EFfAY8AbL9No26I8VkXN8H+s7RYjXU+kc/uU0ESbs6S2bOlZ3YqKLmR0KjWCcFGmGJECDyJn0N/OdkNO4xIFFra8Wly//jdVw7ylYCxB9DelSYujFH3w6qpR7w==',key_name='tempest-TestMinimumBasicScenario-2144509393',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70c87f2fad4648bf90baef68e16d6a5e',ramdisk_id='',reservation_id='r-fesjgsbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f67140e5-e503-4aed-830e-32289bf444d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1764501925',owner_user_name='tempest-TestMinimumBasicScenario-1764501925-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:32:20Z,user_data=None,user_id='00d8fe7c07284b06985746a92c11f518',uuid=dfb9fa80-41e1-4c0f-a0da-89fa020581ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Converting VIF {"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:18:e2,bridge_name='br-int',has_traffic_filtering=True,id=511b289f-3048-493d-b658-e31546805791,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511b289f-30') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG nova.objects.instance [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lazy-loading 'pci_devices' on Instance uuid dfb9fa80-41e1-4c0f-a0da-89fa020581ef {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG nova.objects.base [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Object Instance<dfb9fa80-41e1-4c0f-a0da-89fa020581ef> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:32:22 user nova-compute[73917]:   <uuid>dfb9fa80-41e1-4c0f-a0da-89fa020581ef</uuid>
Aug 26 19:32:22 user nova-compute[73917]:   <name>instance-00000029</name>
Aug 26 19:32:22 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:32:22 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:32:22 user nova-compute[73917]:   <metadata>
Aug 26 19:32:22 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:32:22 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:32:22 user nova-compute[73917]:       <nova:name>tempest-TestMinimumBasicScenario-server-830005725</nova:name>
Aug 26 19:32:22 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:32:20</nova:creationTime>
Aug 26 19:32:22 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:32:22 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:32:22 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:32:22 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:32:22 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:32:22 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:32:22 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:32:22 user nova-compute[73917]:       <nova:owner>
Aug 26 19:32:22 user nova-compute[73917]:         <nova:user uuid="00d8fe7c07284b06985746a92c11f518">tempest-TestMinimumBasicScenario-1764501925-project-member</nova:user>
Aug 26 19:32:22 user nova-compute[73917]:         <nova:project uuid="70c87f2fad4648bf90baef68e16d6a5e">tempest-TestMinimumBasicScenario-1764501925</nova:project>
Aug 26 19:32:22 user nova-compute[73917]:       </nova:owner>
Aug 26 19:32:22 user nova-compute[73917]:       <nova:root type="image" uuid="f67140e5-e503-4aed-830e-32289bf444d2"/>
Aug 26 19:32:22 user nova-compute[73917]:       <nova:ports>
Aug 26 19:32:22 user nova-compute[73917]:         <nova:port uuid="511b289f-3048-493d-b658-e31546805791">
Aug 26 19:32:22 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 19:32:22 user nova-compute[73917]:         </nova:port>
Aug 26 19:32:22 user nova-compute[73917]:       </nova:ports>
Aug 26 19:32:22 user nova-compute[73917]:     </nova:instance>
Aug 26 19:32:22 user nova-compute[73917]:   </metadata>
Aug 26 19:32:22 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:32:22 user nova-compute[73917]:     <system>
Aug 26 19:32:22 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:32:22 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:32:22 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:32:22 user nova-compute[73917]:       <entry name="serial">dfb9fa80-41e1-4c0f-a0da-89fa020581ef</entry>
Aug 26 19:32:22 user nova-compute[73917]:       <entry name="uuid">dfb9fa80-41e1-4c0f-a0da-89fa020581ef</entry>
Aug 26 19:32:22 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:32:22 user nova-compute[73917]:     </system>
Aug 26 19:32:22 user nova-compute[73917]:   </sysinfo>
Aug 26 19:32:22 user nova-compute[73917]:   <os>
Aug 26 19:32:22 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:32:22 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:32:22 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:32:22 user nova-compute[73917]:   </os>
Aug 26 19:32:22 user nova-compute[73917]:   <features>
Aug 26 19:32:22 user nova-compute[73917]:     <acpi/>
Aug 26 19:32:22 user nova-compute[73917]:     <apic/>
Aug 26 19:32:22 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:32:22 user nova-compute[73917]:   </features>
Aug 26 19:32:22 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:32:22 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:32:22 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:32:22 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:32:22 user nova-compute[73917]:   </clock>
Aug 26 19:32:22 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:32:22 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:32:22 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:32:22 user nova-compute[73917]:   </cpu>
Aug 26 19:32:22 user nova-compute[73917]:   <devices>
Aug 26 19:32:22 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:32:22 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:32:22 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk"/>
Aug 26 19:32:22 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:32:22 user nova-compute[73917]:     </disk>
Aug 26 19:32:22 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:32:22 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:32:22 user nova-compute[73917]:       <source dev="/dev/sdb"/>
Aug 26 19:32:22 user nova-compute[73917]:       <target dev="vdb" bus="virtio"/>
Aug 26 19:32:22 user nova-compute[73917]:       <serial>00048de6-d6f5-4110-a320-4050c20dff48</serial>
Aug 26 19:32:22 user nova-compute[73917]:     </disk>
Aug 26 19:32:22 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:32:22 user nova-compute[73917]:       <mac address="fa:16:3e:0c:18:e2"/>
Aug 26 19:32:22 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:32:22 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:32:22 user nova-compute[73917]:       <target dev="tap511b289f-30"/>
Aug 26 19:32:22 user nova-compute[73917]:     </interface>
Aug 26 19:32:22 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:32:22 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/console.log" append="off"/>
Aug 26 19:32:22 user nova-compute[73917]:     </serial>
Aug 26 19:32:22 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:32:22 user nova-compute[73917]:     <video>
Aug 26 19:32:22 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:32:22 user nova-compute[73917]:     </video>
Aug 26 19:32:22 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:32:22 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:32:22 user nova-compute[73917]:     </rng>
Aug 26 19:32:22 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:32:22 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:32:22 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:32:22 user nova-compute[73917]:     </memballoon>
Aug 26 19:32:22 user nova-compute[73917]:   </devices>
Aug 26 19:32:22 user nova-compute[73917]: </domain>
Aug 26 19:32:22 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG nova.objects.instance [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lazy-loading 'trusted_certs' on Instance uuid dfb9fa80-41e1-4c0f-a0da-89fa020581ef {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG nova.objects.base [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Object Instance<dfb9fa80-41e1-4c0f-a0da-89fa020581ef> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f --force-share --output=json" returned: 0 in 0.176s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Cannot resize image /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG nova.objects.instance [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lazy-loading 'migration_context' on Instance uuid dfb9fa80-41e1-4c0f-a0da-89fa020581ef {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG nova.objects.base [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Object Instance<dfb9fa80-41e1-4c0f-a0da-89fa020581ef> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-830005725',display_name='tempest-TestMinimumBasicScenario-server-830005725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-830005725',id=41,image_ref='f67140e5-e503-4aed-830e-32289bf444d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKIvXK+EFfAY8AbL9No26I8VkXN8H+s7RYjXU+kc/uU0ESbs6S2bOlZ3YqKLmR0KjWCcFGmGJECDyJn0N/OdkNO4xIFFra8Wly//jdVw7ylYCxB9DelSYujFH3w6qpR7w==',key_name='tempest-TestMinimumBasicScenario-2144509393',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='70c87f2fad4648bf90baef68e16d6a5e',ramdisk_id='',reservation_id='r-fesjgsbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f67140e5-e503-4aed-830e-32289bf444d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1764501925',owner_user_name='tempest-TestMinimumBasicScenario-1764501925-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:32:20Z,user_data=None,user_id='00d8fe7c07284b06985746a92c11f518',uuid=dfb9fa80-41e1-4c0f-a0da-89fa020581ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Converting VIF {"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:18:e2,bridge_name='br-int',has_traffic_filtering=True,id=511b289f-3048-493d-b658-e31546805791,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511b289f-30') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG os_vif [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:18:e2,bridge_name='br-int',has_traffic_filtering=True,id=511b289f-3048-493d-b658-e31546805791,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511b289f-30') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap511b289f-30, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap511b289f-30, col_values=(('external_ids', {'iface-id': '511b289f-3048-493d-b658-e31546805791', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:18:e2', 'vm-uuid': 'dfb9fa80-41e1-4c0f-a0da-89fa020581ef'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:32:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:22 user nova-compute[73917]: INFO os_vif [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:18:e2,bridge_name='br-int',has_traffic_filtering=True,id=511b289f-3048-493d-b658-e31546805791,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511b289f-30')
Aug 26 19:32:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-18f6af21-b8b2-4040-b5e3-8c8f0323cb01 req-42514943-d014-4f34-885b-7ca73e8a1e62 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received event network-vif-plugged-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:32:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-18f6af21-b8b2-4040-b5e3-8c8f0323cb01 req-42514943-d014-4f34-885b-7ca73e8a1e62 service nova] Acquiring lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:32:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-18f6af21-b8b2-4040-b5e3-8c8f0323cb01 req-42514943-d014-4f34-885b-7ca73e8a1e62 service nova] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:32:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-18f6af21-b8b2-4040-b5e3-8c8f0323cb01 req-42514943-d014-4f34-885b-7ca73e8a1e62 service nova] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:32:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-18f6af21-b8b2-4040-b5e3-8c8f0323cb01 req-42514943-d014-4f34-885b-7ca73e8a1e62 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] No waiting events found dispatching network-vif-plugged-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:32:24 user nova-compute[73917]: WARNING nova.compute.manager [req-18f6af21-b8b2-4040-b5e3-8c8f0323cb01 req-42514943-d014-4f34-885b-7ca73e8a1e62 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received unexpected event network-vif-plugged-511b289f-3048-493d-b658-e31546805791 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 19:32:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Removed pending event for dfb9fa80-41e1-4c0f-a0da-89fa020581ef due to event {{(pid=73917) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 19:32:26 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078346.323734, dfb9fa80-41e1-4c0f-a0da-89fa020581ef => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:32:26 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] VM Resumed (Lifecycle Event)
Aug 26 19:32:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:32:26 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Instance rebooted successfully.
Aug 26 19:32:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:32:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:32:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:32:26 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 26 19:32:26 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078346.3284638, dfb9fa80-41e1-4c0f-a0da-89fa020581ef => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:32:26 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] VM Started (Lifecycle Event)
Aug 26 19:32:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:32:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:32:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-64a0a3e6-ee13-416c-95f7-790eba6a2df1 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.411s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:32:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-75b8f0ab-ba34-489d-82a2-489fe2487d17 req-5ba10f7f-b12e-476b-b3a9-a8251e36d07e service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received event network-vif-plugged-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:32:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-75b8f0ab-ba34-489d-82a2-489fe2487d17 req-5ba10f7f-b12e-476b-b3a9-a8251e36d07e service nova] Acquiring lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:32:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-75b8f0ab-ba34-489d-82a2-489fe2487d17 req-5ba10f7f-b12e-476b-b3a9-a8251e36d07e service nova] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:32:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-75b8f0ab-ba34-489d-82a2-489fe2487d17 req-5ba10f7f-b12e-476b-b3a9-a8251e36d07e service nova] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:32:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-75b8f0ab-ba34-489d-82a2-489fe2487d17 req-5ba10f7f-b12e-476b-b3a9-a8251e36d07e service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] No waiting events found dispatching network-vif-plugged-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:32:26 user nova-compute[73917]: WARNING nova.compute.manager [req-75b8f0ab-ba34-489d-82a2-489fe2487d17 req-5ba10f7f-b12e-476b-b3a9-a8251e36d07e service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received unexpected event network-vif-plugged-511b289f-3048-493d-b658-e31546805791 for instance with vm_state active and task_state None.
Aug 26 19:32:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-72b25963-da3e-4d96-9b1c-4700c1faa7e0 req-fe60115d-4640-43af-9206-516deba7cede service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received event network-changed-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:32:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-72b25963-da3e-4d96-9b1c-4700c1faa7e0 req-fe60115d-4640-43af-9206-516deba7cede service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Refreshing instance network info cache due to event network-changed-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:32:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-72b25963-da3e-4d96-9b1c-4700c1faa7e0 req-fe60115d-4640-43af-9206-516deba7cede service nova] Acquiring lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:32:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-72b25963-da3e-4d96-9b1c-4700c1faa7e0 req-fe60115d-4640-43af-9206-516deba7cede service nova] Acquired lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:32:35 user nova-compute[73917]: DEBUG nova.network.neutron [req-72b25963-da3e-4d96-9b1c-4700c1faa7e0 req-fe60115d-4640-43af-9206-516deba7cede service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Refreshing network info cache for port 2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:32:36 user nova-compute[73917]: DEBUG nova.network.neutron [req-72b25963-da3e-4d96-9b1c-4700c1faa7e0 req-fe60115d-4640-43af-9206-516deba7cede service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Updated VIF entry in instance network info cache for port 2dcdc64c-d3c6-4e11-bc82-a4149510e4fb. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:32:36 user nova-compute[73917]: DEBUG nova.network.neutron [req-72b25963-da3e-4d96-9b1c-4700c1faa7e0 req-fe60115d-4640-43af-9206-516deba7cede service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Updating instance_info_cache with network_info: [{"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:32:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-72b25963-da3e-4d96-9b1c-4700c1faa7e0 req-fe60115d-4640-43af-9206-516deba7cede service nova] Releasing lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:32:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:32:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:32:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:32:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:32:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:39 user nova-compute[73917]: DEBUG nova.compute.manager [req-861d66d2-873b-4631-af01-2a0c7a5251a7 req-31aa5d03-6922-4e67-8e8e-160e0d291e3e service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Received event network-changed-af81bab5-d822-4ef6-a0dd-a234f1143a95 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:32:39 user nova-compute[73917]: DEBUG nova.compute.manager [req-861d66d2-873b-4631-af01-2a0c7a5251a7 req-31aa5d03-6922-4e67-8e8e-160e0d291e3e service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Refreshing instance network info cache due to event network-changed-af81bab5-d822-4ef6-a0dd-a234f1143a95. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:32:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-861d66d2-873b-4631-af01-2a0c7a5251a7 req-31aa5d03-6922-4e67-8e8e-160e0d291e3e service nova] Acquiring lock "refresh_cache-0aa9e505-caf3-45d1-96e5-3df233d05f0c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:32:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-861d66d2-873b-4631-af01-2a0c7a5251a7 req-31aa5d03-6922-4e67-8e8e-160e0d291e3e service nova] Acquired lock "refresh_cache-0aa9e505-caf3-45d1-96e5-3df233d05f0c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:32:39 user nova-compute[73917]: DEBUG nova.network.neutron [req-861d66d2-873b-4631-af01-2a0c7a5251a7 req-31aa5d03-6922-4e67-8e8e-160e0d291e3e service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Refreshing network info cache for port af81bab5-d822-4ef6-a0dd-a234f1143a95 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:32:39 user nova-compute[73917]: DEBUG nova.network.neutron [req-861d66d2-873b-4631-af01-2a0c7a5251a7 req-31aa5d03-6922-4e67-8e8e-160e0d291e3e service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Updated VIF entry in instance network info cache for port af81bab5-d822-4ef6-a0dd-a234f1143a95. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:32:39 user nova-compute[73917]: DEBUG nova.network.neutron [req-861d66d2-873b-4631-af01-2a0c7a5251a7 req-31aa5d03-6922-4e67-8e8e-160e0d291e3e service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Updating instance_info_cache with network_info: [{"id": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "address": "fa:16:3e:2b:d7:c2", "network": {"id": "891da1fc-832f-40dc-8203-e34b109bd216", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2042761334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f8c3286fd14430b4ae5be87f712580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81bab5-d8", "ovs_interfaceid": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:32:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-861d66d2-873b-4631-af01-2a0c7a5251a7 req-31aa5d03-6922-4e67-8e8e-160e0d291e3e service nova] Releasing lock "refresh_cache-0aa9e505-caf3-45d1-96e5-3df233d05f0c" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:32:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:32:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:32:41 user nova-compute[73917]: INFO nova.compute.manager [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Shelving
Aug 26 19:32:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:42 user nova-compute[73917]: DEBUG nova.compute.manager [req-77b1af79-3f7a-4e85-bd18-3925931358bf req-576de74b-4346-4af6-a1a8-f32453afad95 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received event network-vif-unplugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:32:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-77b1af79-3f7a-4e85-bd18-3925931358bf req-576de74b-4346-4af6-a1a8-f32453afad95 service nova] Acquiring lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:32:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-77b1af79-3f7a-4e85-bd18-3925931358bf req-576de74b-4346-4af6-a1a8-f32453afad95 service nova] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:32:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-77b1af79-3f7a-4e85-bd18-3925931358bf req-576de74b-4346-4af6-a1a8-f32453afad95 service nova] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:32:42 user nova-compute[73917]: DEBUG nova.compute.manager [req-77b1af79-3f7a-4e85-bd18-3925931358bf req-576de74b-4346-4af6-a1a8-f32453afad95 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] No waiting events found dispatching network-vif-unplugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:32:42 user nova-compute[73917]: WARNING nova.compute.manager [req-77b1af79-3f7a-4e85-bd18-3925931358bf req-576de74b-4346-4af6-a1a8-f32453afad95 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received unexpected event network-vif-unplugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb for instance with vm_state active and task_state shelving.
Aug 26 19:32:42 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Instance destroyed successfully.
Aug 26 19:32:42 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Beginning cold snapshot process
Aug 26 19:32:42 user nova-compute[73917]: DEBUG nova.privsep.utils [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73917) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 19:32:42 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk /opt/stack/data/nova/instances/snapshots/tmp4slogf40/0864679c04464fdf80bfb9160e454bbd {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk /opt/stack/data/nova/instances/snapshots/tmp4slogf40/0864679c04464fdf80bfb9160e454bbd" returned: 0 in 0.415s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:43 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Snapshot extracted, beginning image upload
Aug 26 19:32:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG nova.compute.manager [req-73fcf54e-1fe2-4fd7-aee0-1017dc1f494e req-33642320-020b-4243-a0c0-966aefe2e7f5 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received event network-vif-plugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-73fcf54e-1fe2-4fd7-aee0-1017dc1f494e req-33642320-020b-4243-a0c0-966aefe2e7f5 service nova] Acquiring lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-73fcf54e-1fe2-4fd7-aee0-1017dc1f494e req-33642320-020b-4243-a0c0-966aefe2e7f5 service nova] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-73fcf54e-1fe2-4fd7-aee0-1017dc1f494e req-33642320-020b-4243-a0c0-966aefe2e7f5 service nova] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG nova.compute.manager [req-73fcf54e-1fe2-4fd7-aee0-1017dc1f494e req-33642320-020b-4243-a0c0-966aefe2e7f5 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] No waiting events found dispatching network-vif-plugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:32:44 user nova-compute[73917]: WARNING nova.compute.manager [req-73fcf54e-1fe2-4fd7-aee0-1017dc1f494e req-33642320-020b-4243-a0c0-966aefe2e7f5 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received unexpected event network-vif-plugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Acquiring lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG nova.objects.instance [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lazy-loading 'flavor' on Instance uuid 0aa9e505-caf3-45d1-96e5-3df233d05f0c {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Acquiring lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:32:44 user nova-compute[73917]: INFO nova.compute.manager [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Attaching volume 3175c616-155d-47a4-a8ee-f0e9b682d598 to /dev/vdb
Aug 26 19:32:44 user nova-compute[73917]: DEBUG os_brick.utils [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4824cfc9-4cf7-4e25-a014-d715f5a8ab76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d500e68-d2a7-4311-b371-bcfed3d997f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18da65c-10d6-44f9-b68e-350a3cc4f4e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0828bd-f3a1-4c09-9263-a1ec1b008153]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:32:44 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:32:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[def33ff4-524f-4012-a354-5ba2ce22fcd4]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG os_brick.utils [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:32:44 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Updating existing volume attachment record: e12a2bd6-23ff-43a8-b8b7-327fd58e95d6 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:32:45 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Snapshot image upload complete
Aug 26 19:32:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:32:45 user nova-compute[73917]: INFO nova.compute.manager [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Shelve offloading
Aug 26 19:32:45 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Instance destroyed successfully.
Aug 26 19:32:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:32:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:32:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquired lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:32:45 user nova-compute[73917]: DEBUG nova.network.neutron [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:32:46 user nova-compute[73917]: DEBUG nova.network.neutron [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Updating instance_info_cache with network_info: [{"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:32:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Releasing lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:32:47 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Instance destroyed successfully.
Aug 26 19:32:47 user nova-compute[73917]: DEBUG nova.objects.instance [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'resources' on Instance uuid 24e53fcd-f3ea-4f6a-a09c-83813f739a1e {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1484928366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1484928366',id=42,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpGCGggJbEXbF0OVNJLJ7CgUM+t4zKuAo1hX+bjTVZOGWPRk+hqqRNql720cO1HVYFKJp8UEYPhGL0umPueNY4q/aihiXk5GFQMPZSa17qYaaT2B8zrQdoYGbYMPV/LfA==',key_name='tempest-keypair-1671593516',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:30:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='96cf0ccd59944be6922b561ecddc7d5b',ramdisk_id='',reservation_id='r-zh03nzoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1729132577',owner_user_name='tempest-AttachVolumeShelveTestJSON-1729132577-project-member',shelved_at='2023-08-26T19:32:45.685994',shelved_host='user',shelved_image_id='bb8c6385-e1da-4cee-ae53-42173209c9c7'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:32:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860f7b92664e43d19c908f3bdb52d717',uuid=24e53fcd-f3ea-4f6a-a09c-83813f739a1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converting VIF {"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9a:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dcdc64c-d3c6-4e11-bc82-a4149510e4fb,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcdc64c-d3') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG os_vif [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9a:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dcdc64c-d3c6-4e11-bc82-a4149510e4fb,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcdc64c-d3') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dcdc64c-d3, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG nova.compute.manager [req-69547133-4715-40f3-9d92-5cf3199044aa req-f966657e-280c-42ef-bf4f-17863f7d681a service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received event network-changed-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG nova.compute.manager [req-69547133-4715-40f3-9d92-5cf3199044aa req-f966657e-280c-42ef-bf4f-17863f7d681a service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Refreshing instance network info cache due to event network-changed-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-69547133-4715-40f3-9d92-5cf3199044aa req-f966657e-280c-42ef-bf4f-17863f7d681a service nova] Acquiring lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-69547133-4715-40f3-9d92-5cf3199044aa req-f966657e-280c-42ef-bf4f-17863f7d681a service nova] Acquired lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG nova.network.neutron [req-69547133-4715-40f3-9d92-5cf3199044aa req-f966657e-280c-42ef-bf4f-17863f7d681a service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Refreshing network info cache for port 2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:32:47 user nova-compute[73917]: INFO os_vif [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9a:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dcdc64c-d3c6-4e11-bc82-a4149510e4fb,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcdc64c-d3')
Aug 26 19:32:47 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Deleting instance files /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e_del
Aug 26 19:32:47 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Deletion of /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e_del complete
Aug 26 19:32:47 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Deleted allocations for instance 24e53fcd-f3ea-4f6a-a09c-83813f739a1e
Aug 26 19:32:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG nova.objects.instance [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'numa_topology' on Instance uuid 24e53fcd-f3ea-4f6a-a09c-83813f739a1e {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG nova.objects.base [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Object Instance<24e53fcd-f3ea-4f6a-a09c-83813f739a1e> lazy-loaded attributes: resources,numa_topology {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-835ffd60-f10e-4f96-aa54-918875b2698d tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.687s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG nova.network.neutron [req-69547133-4715-40f3-9d92-5cf3199044aa req-f966657e-280c-42ef-bf4f-17863f7d681a service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Updated VIF entry in instance network info cache for port 2dcdc64c-d3c6-4e11-bc82-a4149510e4fb. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG nova.network.neutron [req-69547133-4715-40f3-9d92-5cf3199044aa req-f966657e-280c-42ef-bf4f-17863f7d681a service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Updating instance_info_cache with network_info: [{"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:32:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-69547133-4715-40f3-9d92-5cf3199044aa req-f966657e-280c-42ef-bf4f-17863f7d681a service nova] Releasing lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:32:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxvZfGVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:32:56 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:32:56 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:32:56 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1192767d-3bba-415c-bcf3-de163962b024]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:32:56 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fad4a8-f556-4267-9e79-57741ddffcfb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598] added
Aug 26 19:32:56 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dbdc85-6ec6-441b-984f-5b27aa4162d4]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4617385-b0c6-43dc-9452-db6a2d746c19]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AxvZfGVH {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AxvZfGVH" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f473cd1e-fead-4a15-8c1e-feb9bbb51b0b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AxvZfGVH'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8415ae11-0000-4fc7-a316-945f02fdfe48]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8820205f-4558-42cf-9f59-f014704d5044]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)
Aug 26 19:32:56 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)
Aug 26 19:32:56 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d970f8ee-f889-475c-a317-c8b8df777717]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598, portal: 172.16.0.220,3260]
Aug 26 19:32:56 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598, portal: 172.16.0.220,3260] successful.
Aug 26 19:32:56 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0084ee50-e5ab-48c8-a103-1fd55220bf35]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6cd530-713f-4e0d-8b81-34a08df41641]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)
Aug 26 19:32:56 user nova-compute[73917]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 (non-flash)
Aug 26 19:32:56 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)
Aug 26 19:32:56 user nova-compute[73917]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 (non-flash)
Aug 26 19:32:56 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbe40f5-7896-4dcc-8184-11822d285e9a]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:32:56 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxvZfGVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:32:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:32:57 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:32:57 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26338636335386433', 'path': '/dev/sdc'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:32:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338636335386433', 'path': '/dev/sdc'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:32:57 user nova-compute[73917]: DEBUG nova.objects.instance [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lazy-loading 'flavor' on Instance uuid 0aa9e505-caf3-45d1-96e5-3df233d05f0c {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:32:57 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:32:57 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:32:57 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:32:57 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:32:57 user nova-compute[73917]:   <serial>3175c616-155d-47a4-a8ee-f0e9b682d598</serial>
Aug 26 19:32:57 user nova-compute[73917]: </disk>
Aug 26 19:32:57 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:32:57 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693078362.664919, 24e53fcd-f3ea-4f6a-a09c-83813f739a1e => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:32:57 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] VM Stopped (Lifecycle Event)
Aug 26 19:32:57 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5ac8df72-dec7-40ad-abf8-91cc84869f87 None None] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:32:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:32:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:32:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] No VIF found with MAC fa:16:3e:2b:d7:c2, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:32:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-cc774af3-7a15-4687-91f0-013212f4bf2e tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.750s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Acquiring lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:33:00 user nova-compute[73917]: INFO nova.compute.manager [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Detaching volume 3175c616-155d-47a4-a8ee-f0e9b682d598
Aug 26 19:33:00 user nova-compute[73917]: INFO nova.virt.block_device [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Attempting to driver detach volume 3175c616-155d-47a4-a8ee-f0e9b682d598 from mountpoint /dev/vdb
Aug 26 19:33:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Attempting to detach device vdb from instance 0aa9e505-caf3-45d1-96e5-3df233d05f0c from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:33:00 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:33:00 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:33:00 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:33:00 user nova-compute[73917]:   <serial>3175c616-155d-47a4-a8ee-f0e9b682d598</serial>
Aug 26 19:33:00 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:33:00 user nova-compute[73917]: </disk>
Aug 26 19:33:00 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:33:00 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Successfully detached device vdb from instance 0aa9e505-caf3-45d1-96e5-3df233d05f0c from the persistent domain config.
Aug 26 19:33:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0aa9e505-caf3-45d1-96e5-3df233d05f0c from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:33:00 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:33:00 user nova-compute[73917]:   <source dev="/dev/sdc"/>
Aug 26 19:33:00 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:33:00 user nova-compute[73917]:   <serial>3175c616-155d-47a4-a8ee-f0e9b682d598</serial>
Aug 26 19:33:00 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:33:00 user nova-compute[73917]: </disk>
Aug 26 19:33:00 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693078380.6240764, 0aa9e505-caf3-45d1-96e5-3df233d05f0c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0aa9e505-caf3-45d1-96e5-3df233d05f0c {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:33:00 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Successfully detached device vdb from instance 0aa9e505-caf3-45d1-96e5-3df233d05f0c from the live domain config.
Aug 26 19:33:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxvZfGVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:33:00 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:33:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba96c59-b2c7-40d0-b823-3b75b432e6d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b1a30a-2c24-4f20-915d-76e1ac120304]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)
Aug 26 19:33:00 user nova-compute[73917]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 (non-flash)
Aug 26 19:33:00 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)
Aug 26 19:33:00 user nova-compute[73917]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 (non-flash)
Aug 26 19:33:00 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b985ff400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598'): ({'sdc'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Removing single pathed devices sdc {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad29c47-0f2e-47fb-b547-6954e8d83db1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[082d9d7f-d95c-4232-8162-8663a5abc034]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Flushing IO for device /dev/sdc {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81da882-61b3-4def-b2a2-164476d0f64c]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2e05df-7898-44b1-8097-e232406e9608]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1758c085-51dd-471e-88c9-e772e1cb03d8]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[247ec1f8-4e2e-4a7e-b564-0b662d72de6a]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598, portal: 172.16.0.220,3260]
Aug 26 19:33:00 user nova-compute[73917]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598, portal: 172.16.0.220,3260] successful.
Aug 26 19:33:00 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3175c616-155d-47a4-a8ee-f0e9b682d598 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6d0fda-895d-46b6-8932-b84cf3d8e86b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] <== disconnect_volume: return (304ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:33:00 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:33:01 user nova-compute[73917]: DEBUG nova.objects.instance [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lazy-loading 'flavor' on Instance uuid 0aa9e505-caf3-45d1-96e5-3df233d05f0c {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:33:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-64e0208a-9f09-4116-b0bc-1562308c8880 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.699s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:33:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:02 user nova-compute[73917]: DEBUG nova.compute.manager [req-55c0b978-5be7-4381-88ca-ae13c72d7e9d req-1088ce71-549f-454e-aea3-6b20905d4c43 service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Received event network-changed-dcd0eceb-374a-46e1-92cd-5e5fcb947a75 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:33:02 user nova-compute[73917]: DEBUG nova.compute.manager [req-55c0b978-5be7-4381-88ca-ae13c72d7e9d req-1088ce71-549f-454e-aea3-6b20905d4c43 service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Refreshing instance network info cache due to event network-changed-dcd0eceb-374a-46e1-92cd-5e5fcb947a75. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:33:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-55c0b978-5be7-4381-88ca-ae13c72d7e9d req-1088ce71-549f-454e-aea3-6b20905d4c43 service nova] Acquiring lock "refresh_cache-fbc66439-479c-4818-a416-c3c64d49741d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:33:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-55c0b978-5be7-4381-88ca-ae13c72d7e9d req-1088ce71-549f-454e-aea3-6b20905d4c43 service nova] Acquired lock "refresh_cache-fbc66439-479c-4818-a416-c3c64d49741d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:33:02 user nova-compute[73917]: DEBUG nova.network.neutron [req-55c0b978-5be7-4381-88ca-ae13c72d7e9d req-1088ce71-549f-454e-aea3-6b20905d4c43 service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Refreshing network info cache for port dcd0eceb-374a-46e1-92cd-5e5fcb947a75 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:33:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "fbc66439-479c-4818-a416-c3c64d49741d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:33:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "fbc66439-479c-4818-a416-c3c64d49741d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:33:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "fbc66439-479c-4818-a416-c3c64d49741d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:33:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "fbc66439-479c-4818-a416-c3c64d49741d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:33:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "fbc66439-479c-4818-a416-c3c64d49741d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:33:02 user nova-compute[73917]: INFO nova.compute.manager [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Terminating instance
Aug 26 19:33:02 user nova-compute[73917]: DEBUG nova.compute.manager [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:33:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG nova.compute.manager [req-83f18a63-1578-4b0d-8850-8620a89b4924 req-ba379271-b19b-41ee-8b44-48f4eb6e516b service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Received event network-vif-unplugged-dcd0eceb-374a-46e1-92cd-5e5fcb947a75 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-83f18a63-1578-4b0d-8850-8620a89b4924 req-ba379271-b19b-41ee-8b44-48f4eb6e516b service nova] Acquiring lock "fbc66439-479c-4818-a416-c3c64d49741d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-83f18a63-1578-4b0d-8850-8620a89b4924 req-ba379271-b19b-41ee-8b44-48f4eb6e516b service nova] Lock "fbc66439-479c-4818-a416-c3c64d49741d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-83f18a63-1578-4b0d-8850-8620a89b4924 req-ba379271-b19b-41ee-8b44-48f4eb6e516b service nova] Lock "fbc66439-479c-4818-a416-c3c64d49741d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG nova.compute.manager [req-83f18a63-1578-4b0d-8850-8620a89b4924 req-ba379271-b19b-41ee-8b44-48f4eb6e516b service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] No waiting events found dispatching network-vif-unplugged-dcd0eceb-374a-46e1-92cd-5e5fcb947a75 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG nova.compute.manager [req-83f18a63-1578-4b0d-8850-8620a89b4924 req-ba379271-b19b-41ee-8b44-48f4eb6e516b service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Received event network-vif-unplugged-dcd0eceb-374a-46e1-92cd-5e5fcb947a75 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:03 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Instance destroyed successfully.
Aug 26 19:33:03 user nova-compute[73917]: DEBUG nova.objects.instance [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lazy-loading 'resources' on Instance uuid fbc66439-479c-4818-a416-c3c64d49741d {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:25:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1123877833',display_name='tempest-TestStampPattern-server-1123877833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1123877833',id=37,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3qikrHaZv1b57+PYsAMrjbGE8666IZRULu8TbUkxpO21qNoIsGBqbZ/2lTZ8QJOtcHXsoQIRIproBK4xx57gBXc3m4j4E+STy5i75C4teNDHC5iYRzQB7oXEceIdSncQ==',key_name='tempest-TestStampPattern-235197864',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:25:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e307e771e354caa99ff68b73b842743',ramdisk_id='',reservation_id='r-0lhmcms6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-432009003',owner_user_name='tempest-TestStampPattern-432009003-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:28:54Z,user_data=None,user_id='22f87b69a0fb471f9ec5373b208d3abc',uuid=fbc66439-479c-4818-a416-c3c64d49741d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "address": "fa:16:3e:92:aa:c8", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd0eceb-37", "ovs_interfaceid": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Converting VIF {"id": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "address": "fa:16:3e:92:aa:c8", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd0eceb-37", "ovs_interfaceid": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:aa:c8,bridge_name='br-int',has_traffic_filtering=True,id=dcd0eceb-374a-46e1-92cd-5e5fcb947a75,network=Network(1cf7828d-2911-4253-bc82-d0fa6677f746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcd0eceb-37') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG os_vif [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:aa:c8,bridge_name='br-int',has_traffic_filtering=True,id=dcd0eceb-374a-46e1-92cd-5e5fcb947a75,network=Network(1cf7828d-2911-4253-bc82-d0fa6677f746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcd0eceb-37') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcd0eceb-37, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:33:03 user nova-compute[73917]: INFO os_vif [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:aa:c8,bridge_name='br-int',has_traffic_filtering=True,id=dcd0eceb-374a-46e1-92cd-5e5fcb947a75,network=Network(1cf7828d-2911-4253-bc82-d0fa6677f746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcd0eceb-37')
Aug 26 19:33:03 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Deleting instance files /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d_del
Aug 26 19:33:03 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Deletion of /opt/stack/data/nova/instances/fbc66439-479c-4818-a416-c3c64d49741d_del complete
Aug 26 19:33:03 user nova-compute[73917]: INFO nova.compute.manager [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 26 19:33:03 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: fbc66439-479c-4818-a416-c3c64d49741d] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG nova.network.neutron [req-55c0b978-5be7-4381-88ca-ae13c72d7e9d req-1088ce71-549f-454e-aea3-6b20905d4c43 service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Updated VIF entry in instance network info cache for port dcd0eceb-374a-46e1-92cd-5e5fcb947a75. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG nova.network.neutron [req-55c0b978-5be7-4381-88ca-ae13c72d7e9d req-1088ce71-549f-454e-aea3-6b20905d4c43 service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Updating instance_info_cache with network_info: [{"id": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "address": "fa:16:3e:92:aa:c8", "network": {"id": "1cf7828d-2911-4253-bc82-d0fa6677f746", "bridge": "br-int", "label": "tempest-TestStampPattern-796630916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e307e771e354caa99ff68b73b842743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd0eceb-37", "ovs_interfaceid": "dcd0eceb-374a-46e1-92cd-5e5fcb947a75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:33:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-55c0b978-5be7-4381-88ca-ae13c72d7e9d req-1088ce71-549f-454e-aea3-6b20905d4c43 service nova] Releasing lock "refresh_cache-fbc66439-479c-4818-a416-c3c64d49741d" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:33:04 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:33:04 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Took 0.57 seconds to deallocate network for instance.
Aug 26 19:33:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:33:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:33:04 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:33:04 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:33:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:33:04 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Deleted allocations for instance fbc66439-479c-4818-a416-c3c64d49741d
Aug 26 19:33:04 user nova-compute[73917]: DEBUG nova.compute.manager [req-088ba4eb-7c71-4716-9900-dd4d26f97c9a req-f0969208-2073-45a6-8822-089f6f17b4d2 service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Received event network-vif-deleted-dcd0eceb-374a-46e1-92cd-5e5fcb947a75 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:33:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-df4f6cf4-f800-4881-8c08-ca8757bf3130 tempest-TestStampPattern-432009003 tempest-TestStampPattern-432009003-project-member] Lock "fbc66439-479c-4818-a416-c3c64d49741d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.012s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:33:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-12da41c8-b52b-4b4e-83e4-d9e978eed566 req-110c3d1b-5ed1-4fd0-97d6-ff6ea820206a service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Received event network-vif-plugged-dcd0eceb-374a-46e1-92cd-5e5fcb947a75 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:33:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-12da41c8-b52b-4b4e-83e4-d9e978eed566 req-110c3d1b-5ed1-4fd0-97d6-ff6ea820206a service nova] Acquiring lock "fbc66439-479c-4818-a416-c3c64d49741d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:33:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-12da41c8-b52b-4b4e-83e4-d9e978eed566 req-110c3d1b-5ed1-4fd0-97d6-ff6ea820206a service nova] Lock "fbc66439-479c-4818-a416-c3c64d49741d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:33:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-12da41c8-b52b-4b4e-83e4-d9e978eed566 req-110c3d1b-5ed1-4fd0-97d6-ff6ea820206a service nova] Lock "fbc66439-479c-4818-a416-c3c64d49741d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:33:05 user nova-compute[73917]: DEBUG nova.compute.manager [req-12da41c8-b52b-4b4e-83e4-d9e978eed566 req-110c3d1b-5ed1-4fd0-97d6-ff6ea820206a service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] No waiting events found dispatching network-vif-plugged-dcd0eceb-374a-46e1-92cd-5e5fcb947a75 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:33:05 user nova-compute[73917]: WARNING nova.compute.manager [req-12da41c8-b52b-4b4e-83e4-d9e978eed566 req-110c3d1b-5ed1-4fd0-97d6-ff6ea820206a service nova] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Received unexpected event network-vif-plugged-dcd0eceb-374a-46e1-92cd-5e5fcb947a75 for instance with vm_state deleted and task_state None.
Aug 26 19:33:07 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:33:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:33:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:09 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:33:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:33:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:33:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:33:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:33:09 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:33:09 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid dfb9fa80-41e1-4c0f-a0da-89fa020581ef {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:33:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:10 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Updating instance_info_cache with network_info: [{"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:33:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:33:10 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:33:10 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:33:10 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:33:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:14 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:33:14 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:33:14 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:33:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 19:33:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] There are 0 instances to clean {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 19:33:15 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:33:15 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:33:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:33:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:33:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:33:15 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:33:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:33:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:33:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:33:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:33:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:33:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:33:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:33:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:33:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:33:16 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:33:16 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:33:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8398MB free_disk=25.14102554321289GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:33:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:33:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:33:17 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance dfb9fa80-41e1-4c0f-a0da-89fa020581ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:33:17 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 0aa9e505-caf3-45d1-96e5-3df233d05f0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:33:17 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:33:17 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:33:17 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing inventories for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 19:33:17 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating ProviderTree inventory for provider d90ad23a-e063-4f0d-8341-c34e0141d16a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 19:33:17 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating inventory in ProviderTree for provider d90ad23a-e063-4f0d-8341-c34e0141d16a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 19:33:17 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing aggregate associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, aggregates: None {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 19:33:17 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing trait associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 19:33:17 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:33:17 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:33:17 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:33:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.635s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:33:18 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693078383.5255327, fbc66439-479c-4818-a416-c3c64d49741d => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:33:18 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: fbc66439-479c-4818-a416-c3c64d49741d] VM Stopped (Lifecycle Event)
Aug 26 19:33:18 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c20e277f-b406-44ed-9fd7-21dc66330c62 None None] [instance: fbc66439-479c-4818-a416-c3c64d49741d] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:33:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:18 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:33:18 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:33:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:19 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:33:20 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:33:20 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73917) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 19:33:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:33:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:33:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:33:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:33:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:33:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:33:22 user nova-compute[73917]: INFO nova.compute.claims [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Claim successful on node user
Aug 26 19:33:23 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG nova.network.neutron [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:33:23 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:33:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG nova.policy [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a13f8e1284f14ebfa52d965681261aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f304ce651b5242efa39d1f348662fb84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:33:23 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Creating image(s)
Aug 26 19:33:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "/opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "/opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.181s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk 1073741824" returned: 0 in 0.050s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.198s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:33:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:33:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:24 user nova-compute[73917]: DEBUG nova.network.neutron [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Successfully created port: 0d3046e2-38a9-4900-bd32-4b9041bcd8f0 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:33:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:33:24 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Cannot resize image /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:33:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:33:24 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Ensure instance console log exists: /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:33:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:33:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:33:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.network.neutron [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Successfully updated port: 0d3046e2-38a9-4900-bd32-4b9041bcd8f0 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "refresh_cache-5c350c27-2506-419d-a54f-da4cee2b4ebc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquired lock "refresh_cache-5c350c27-2506-419d-a54f-da4cee2b4ebc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.network.neutron [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-f098d243-ec6f-4055-be7b-febf554bdce6 req-cc093abc-97ae-46aa-a2a8-329df08fb11d service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Received event network-changed-0d3046e2-38a9-4900-bd32-4b9041bcd8f0 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-f098d243-ec6f-4055-be7b-febf554bdce6 req-cc093abc-97ae-46aa-a2a8-329df08fb11d service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Refreshing instance network info cache due to event network-changed-0d3046e2-38a9-4900-bd32-4b9041bcd8f0. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f098d243-ec6f-4055-be7b-febf554bdce6 req-cc093abc-97ae-46aa-a2a8-329df08fb11d service nova] Acquiring lock "refresh_cache-5c350c27-2506-419d-a54f-da4cee2b4ebc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.network.neutron [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.network.neutron [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Updating instance_info_cache with network_info: [{"id": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "address": "fa:16:3e:ba:d3:78", "network": {"id": "e5ca5d7a-a164-4883-8a3e-5a189fecbcf2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-925027545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f304ce651b5242efa39d1f348662fb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3046e2-38", "ovs_interfaceid": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Releasing lock "refresh_cache-5c350c27-2506-419d-a54f-da4cee2b4ebc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Instance network_info: |[{"id": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "address": "fa:16:3e:ba:d3:78", "network": {"id": "e5ca5d7a-a164-4883-8a3e-5a189fecbcf2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-925027545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f304ce651b5242efa39d1f348662fb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3046e2-38", "ovs_interfaceid": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f098d243-ec6f-4055-be7b-febf554bdce6 req-cc093abc-97ae-46aa-a2a8-329df08fb11d service nova] Acquired lock "refresh_cache-5c350c27-2506-419d-a54f-da4cee2b4ebc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.network.neutron [req-f098d243-ec6f-4055-be7b-febf554bdce6 req-cc093abc-97ae-46aa-a2a8-329df08fb11d service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Refreshing network info cache for port 0d3046e2-38a9-4900-bd32-4b9041bcd8f0 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Start _get_guest_xml network_info=[{"id": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "address": "fa:16:3e:ba:d3:78", "network": {"id": "e5ca5d7a-a164-4883-8a3e-5a189fecbcf2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-925027545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f304ce651b5242efa39d1f348662fb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3046e2-38", "ovs_interfaceid": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:33:25 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:33:25 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-355744839',display_name='tempest-TestServerVolumeAttachmentScenario-server-355744839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-355744839',id=44,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBLYRqR3EC/9IHOi3XqBWpnZ+sA7Y4gDEUFod8VwUNg4aAaAS0Il0bMkIX1M0EiHnCLWU7D9U6hVhUsZWAWs7nV550r1r8EqiPZqAw2vt0XK3ai4YredBFThqkgkibkWw==',key_name='tempest-keypair-2127082084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f304ce651b5242efa39d1f348662fb84',ramdisk_id='',reservation_id='r-4td42a7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-22819724',owner_user_name='tempest-TestServerVolumeAttachmentScenario-22819724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13f8e1284f14ebfa52d965681261aff',uuid=5c350c27-2506-419d-a54f-da4cee2b4ebc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "address": "fa:16:3e:ba:d3:78", "network": {"id": "e5ca5d7a-a164-4883-8a3e-5a189fecbcf2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-925027545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f304ce651b5242efa39d1f348662fb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3046e2-38", "ovs_interfaceid": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Converting VIF {"id": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "address": "fa:16:3e:ba:d3:78", "network": {"id": "e5ca5d7a-a164-4883-8a3e-5a189fecbcf2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-925027545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f304ce651b5242efa39d1f348662fb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3046e2-38", "ovs_interfaceid": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d3:78,bridge_name='br-int',has_traffic_filtering=True,id=0d3046e2-38a9-4900-bd32-4b9041bcd8f0,network=Network(e5ca5d7a-a164-4883-8a3e-5a189fecbcf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3046e2-38') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.objects.instance [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c350c27-2506-419d-a54f-da4cee2b4ebc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:33:25 user nova-compute[73917]:   <uuid>5c350c27-2506-419d-a54f-da4cee2b4ebc</uuid>
Aug 26 19:33:25 user nova-compute[73917]:   <name>instance-0000002c</name>
Aug 26 19:33:25 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:33:25 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:33:25 user nova-compute[73917]:   <metadata>
Aug 26 19:33:25 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:33:25 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:33:25 user nova-compute[73917]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-355744839</nova:name>
Aug 26 19:33:25 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:33:25</nova:creationTime>
Aug 26 19:33:25 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:33:25 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:33:25 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:33:25 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:33:25 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:33:25 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:33:25 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:33:25 user nova-compute[73917]:       <nova:owner>
Aug 26 19:33:25 user nova-compute[73917]:         <nova:user uuid="a13f8e1284f14ebfa52d965681261aff">tempest-TestServerVolumeAttachmentScenario-22819724-project-member</nova:user>
Aug 26 19:33:25 user nova-compute[73917]:         <nova:project uuid="f304ce651b5242efa39d1f348662fb84">tempest-TestServerVolumeAttachmentScenario-22819724</nova:project>
Aug 26 19:33:25 user nova-compute[73917]:       </nova:owner>
Aug 26 19:33:25 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:33:25 user nova-compute[73917]:       <nova:ports>
Aug 26 19:33:25 user nova-compute[73917]:         <nova:port uuid="0d3046e2-38a9-4900-bd32-4b9041bcd8f0">
Aug 26 19:33:25 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 19:33:25 user nova-compute[73917]:         </nova:port>
Aug 26 19:33:25 user nova-compute[73917]:       </nova:ports>
Aug 26 19:33:25 user nova-compute[73917]:     </nova:instance>
Aug 26 19:33:25 user nova-compute[73917]:   </metadata>
Aug 26 19:33:25 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:33:25 user nova-compute[73917]:     <system>
Aug 26 19:33:25 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:33:25 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:33:25 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:33:25 user nova-compute[73917]:       <entry name="serial">5c350c27-2506-419d-a54f-da4cee2b4ebc</entry>
Aug 26 19:33:25 user nova-compute[73917]:       <entry name="uuid">5c350c27-2506-419d-a54f-da4cee2b4ebc</entry>
Aug 26 19:33:25 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:33:25 user nova-compute[73917]:     </system>
Aug 26 19:33:25 user nova-compute[73917]:   </sysinfo>
Aug 26 19:33:25 user nova-compute[73917]:   <os>
Aug 26 19:33:25 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:33:25 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:33:25 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:33:25 user nova-compute[73917]:   </os>
Aug 26 19:33:25 user nova-compute[73917]:   <features>
Aug 26 19:33:25 user nova-compute[73917]:     <acpi/>
Aug 26 19:33:25 user nova-compute[73917]:     <apic/>
Aug 26 19:33:25 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:33:25 user nova-compute[73917]:   </features>
Aug 26 19:33:25 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:33:25 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:33:25 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:33:25 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:33:25 user nova-compute[73917]:   </clock>
Aug 26 19:33:25 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:33:25 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:33:25 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:33:25 user nova-compute[73917]:   </cpu>
Aug 26 19:33:25 user nova-compute[73917]:   <devices>
Aug 26 19:33:25 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:33:25 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:33:25 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk"/>
Aug 26 19:33:25 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:33:25 user nova-compute[73917]:     </disk>
Aug 26 19:33:25 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:33:25 user nova-compute[73917]:       <mac address="fa:16:3e:ba:d3:78"/>
Aug 26 19:33:25 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:33:25 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:33:25 user nova-compute[73917]:       <target dev="tap0d3046e2-38"/>
Aug 26 19:33:25 user nova-compute[73917]:     </interface>
Aug 26 19:33:25 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:33:25 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/console.log" append="off"/>
Aug 26 19:33:25 user nova-compute[73917]:     </serial>
Aug 26 19:33:25 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:33:25 user nova-compute[73917]:     <video>
Aug 26 19:33:25 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:33:25 user nova-compute[73917]:     </video>
Aug 26 19:33:25 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:33:25 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:33:25 user nova-compute[73917]:     </rng>
Aug 26 19:33:25 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:33:25 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:33:25 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:33:25 user nova-compute[73917]:     </memballoon>
Aug 26 19:33:25 user nova-compute[73917]:   </devices>
Aug 26 19:33:25 user nova-compute[73917]: </domain>
Aug 26 19:33:25 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-355744839',display_name='tempest-TestServerVolumeAttachmentScenario-server-355744839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-355744839',id=44,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBLYRqR3EC/9IHOi3XqBWpnZ+sA7Y4gDEUFod8VwUNg4aAaAS0Il0bMkIX1M0EiHnCLWU7D9U6hVhUsZWAWs7nV550r1r8EqiPZqAw2vt0XK3ai4YredBFThqkgkibkWw==',key_name='tempest-keypair-2127082084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f304ce651b5242efa39d1f348662fb84',ramdisk_id='',reservation_id='r-4td42a7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-22819724',owner_user_name='tempest-TestServerVolumeAttachmentScenario-22819724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13f8e1284f14ebfa52d965681261aff',uuid=5c350c27-2506-419d-a54f-da4cee2b4ebc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "address": "fa:16:3e:ba:d3:78", "network": {"id": "e5ca5d7a-a164-4883-8a3e-5a189fecbcf2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-925027545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f304ce651b5242efa39d1f348662fb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3046e2-38", "ovs_interfaceid": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Converting VIF {"id": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "address": "fa:16:3e:ba:d3:78", "network": {"id": "e5ca5d7a-a164-4883-8a3e-5a189fecbcf2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-925027545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f304ce651b5242efa39d1f348662fb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3046e2-38", "ovs_interfaceid": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d3:78,bridge_name='br-int',has_traffic_filtering=True,id=0d3046e2-38a9-4900-bd32-4b9041bcd8f0,network=Network(e5ca5d7a-a164-4883-8a3e-5a189fecbcf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3046e2-38') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG os_vif [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d3:78,bridge_name='br-int',has_traffic_filtering=True,id=0d3046e2-38a9-4900-bd32-4b9041bcd8f0,network=Network(e5ca5d7a-a164-4883-8a3e-5a189fecbcf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3046e2-38') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d3046e2-38, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0d3046e2-38, col_values=(('external_ids', {'iface-id': '0d3046e2-38a9-4900-bd32-4b9041bcd8f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:d3:78', 'vm-uuid': '5c350c27-2506-419d-a54f-da4cee2b4ebc'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:25 user nova-compute[73917]: INFO os_vif [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d3:78,bridge_name='br-int',has_traffic_filtering=True,id=0d3046e2-38a9-4900-bd32-4b9041bcd8f0,network=Network(e5ca5d7a-a164-4883-8a3e-5a189fecbcf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3046e2-38')
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] No VIF found with MAC fa:16:3e:ba:d3:78, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.network.neutron [req-f098d243-ec6f-4055-be7b-febf554bdce6 req-cc093abc-97ae-46aa-a2a8-329df08fb11d service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Updated VIF entry in instance network info cache for port 0d3046e2-38a9-4900-bd32-4b9041bcd8f0. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG nova.network.neutron [req-f098d243-ec6f-4055-be7b-febf554bdce6 req-cc093abc-97ae-46aa-a2a8-329df08fb11d service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Updating instance_info_cache with network_info: [{"id": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "address": "fa:16:3e:ba:d3:78", "network": {"id": "e5ca5d7a-a164-4883-8a3e-5a189fecbcf2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-925027545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f304ce651b5242efa39d1f348662fb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3046e2-38", "ovs_interfaceid": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:33:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f098d243-ec6f-4055-be7b-febf554bdce6 req-cc093abc-97ae-46aa-a2a8-329df08fb11d service nova] Releasing lock "refresh_cache-5c350c27-2506-419d-a54f-da4cee2b4ebc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:33:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-de6947ae-f27c-404a-8f57-152ebc67f73e req-0e907317-45bd-433d-982e-5e015d7a0264 service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Received event network-vif-plugged-0d3046e2-38a9-4900-bd32-4b9041bcd8f0 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:33:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-de6947ae-f27c-404a-8f57-152ebc67f73e req-0e907317-45bd-433d-982e-5e015d7a0264 service nova] Acquiring lock "5c350c27-2506-419d-a54f-da4cee2b4ebc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:33:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-de6947ae-f27c-404a-8f57-152ebc67f73e req-0e907317-45bd-433d-982e-5e015d7a0264 service nova] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:33:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-de6947ae-f27c-404a-8f57-152ebc67f73e req-0e907317-45bd-433d-982e-5e015d7a0264 service nova] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:33:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-de6947ae-f27c-404a-8f57-152ebc67f73e req-0e907317-45bd-433d-982e-5e015d7a0264 service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] No waiting events found dispatching network-vif-plugged-0d3046e2-38a9-4900-bd32-4b9041bcd8f0 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:33:27 user nova-compute[73917]: WARNING nova.compute.manager [req-de6947ae-f27c-404a-8f57-152ebc67f73e req-0e907317-45bd-433d-982e-5e015d7a0264 service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Received unexpected event network-vif-plugged-0d3046e2-38a9-4900-bd32-4b9041bcd8f0 for instance with vm_state building and task_state spawning.
Aug 26 19:33:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:29 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078409.1010365, 5c350c27-2506-419d-a54f-da4cee2b4ebc => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:33:29 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] VM Resumed (Lifecycle Event)
Aug 26 19:33:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:33:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:33:29 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Instance spawned successfully.
Aug 26 19:33:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:33:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:33:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:33:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:33:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:33:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:33:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:33:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:33:29 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:33:29 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:33:29 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078409.1038213, 5c350c27-2506-419d-a54f-da4cee2b4ebc => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:33:29 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] VM Started (Lifecycle Event)
Aug 26 19:33:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:33:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:33:29 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:33:29 user nova-compute[73917]: INFO nova.compute.manager [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Took 5.90 seconds to spawn the instance on the hypervisor.
Aug 26 19:33:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:33:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-d1960a22-111f-4d74-a25a-3f3c44a850bd req-2a3e72de-8c7c-4b6a-9afe-4144551bc757 service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Received event network-vif-plugged-0d3046e2-38a9-4900-bd32-4b9041bcd8f0 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:33:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d1960a22-111f-4d74-a25a-3f3c44a850bd req-2a3e72de-8c7c-4b6a-9afe-4144551bc757 service nova] Acquiring lock "5c350c27-2506-419d-a54f-da4cee2b4ebc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:33:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d1960a22-111f-4d74-a25a-3f3c44a850bd req-2a3e72de-8c7c-4b6a-9afe-4144551bc757 service nova] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:33:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d1960a22-111f-4d74-a25a-3f3c44a850bd req-2a3e72de-8c7c-4b6a-9afe-4144551bc757 service nova] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:33:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-d1960a22-111f-4d74-a25a-3f3c44a850bd req-2a3e72de-8c7c-4b6a-9afe-4144551bc757 service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] No waiting events found dispatching network-vif-plugged-0d3046e2-38a9-4900-bd32-4b9041bcd8f0 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:33:29 user nova-compute[73917]: WARNING nova.compute.manager [req-d1960a22-111f-4d74-a25a-3f3c44a850bd req-2a3e72de-8c7c-4b6a-9afe-4144551bc757 service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Received unexpected event network-vif-plugged-0d3046e2-38a9-4900-bd32-4b9041bcd8f0 for instance with vm_state building and task_state spawning.
Aug 26 19:33:29 user nova-compute[73917]: INFO nova.compute.manager [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Took 6.48 seconds to build instance.
Aug 26 19:33:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c9be6997-8522-422a-bb2a-a47e429e092d tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.605s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:33:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:33:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:33:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Acquiring lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:33:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:33:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Acquiring lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:33:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:33:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:33:57 user nova-compute[73917]: INFO nova.compute.manager [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Terminating instance
Aug 26 19:33:57 user nova-compute[73917]: DEBUG nova.compute.manager [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG nova.compute.manager [req-457962d9-94f4-4d6b-b217-51f6eb22847f req-47dc6ac1-b381-4882-bf94-5130ba553a5c service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Received event network-vif-unplugged-af81bab5-d822-4ef6-a0dd-a234f1143a95 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-457962d9-94f4-4d6b-b217-51f6eb22847f req-47dc6ac1-b381-4882-bf94-5130ba553a5c service nova] Acquiring lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-457962d9-94f4-4d6b-b217-51f6eb22847f req-47dc6ac1-b381-4882-bf94-5130ba553a5c service nova] Lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-457962d9-94f4-4d6b-b217-51f6eb22847f req-47dc6ac1-b381-4882-bf94-5130ba553a5c service nova] Lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG nova.compute.manager [req-457962d9-94f4-4d6b-b217-51f6eb22847f req-47dc6ac1-b381-4882-bf94-5130ba553a5c service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] No waiting events found dispatching network-vif-unplugged-af81bab5-d822-4ef6-a0dd-a234f1143a95 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG nova.compute.manager [req-457962d9-94f4-4d6b-b217-51f6eb22847f req-47dc6ac1-b381-4882-bf94-5130ba553a5c service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Received event network-vif-unplugged-af81bab5-d822-4ef6-a0dd-a234f1143a95 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:58 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Instance destroyed successfully.
Aug 26 19:33:58 user nova-compute[73917]: DEBUG nova.objects.instance [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lazy-loading 'resources' on Instance uuid 0aa9e505-caf3-45d1-96e5-3df233d05f0c {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:30:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-66812972',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-66812972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6681297',id=43,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDn1AUth23DmsKaAeg8QNuVU75Xlfuo0Oah/gGZN24Si+4rSxy75McFvouvUjc5AyYGgIIzkbhvA4nUAiTNA7uAqZ+PNLM5Sf3xmruXpBLpO8azvmkwJpyai7GOgD1mvg==',key_name='tempest-keypair-1991361779',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:30:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04f8c3286fd14430b4ae5be87f712580',ramdisk_id='',reservation_id='r-7k5lrja0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-258390537',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:30:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='170aaa5ea0234d4184ec34fe835100db',uuid=0aa9e505-caf3-45d1-96e5-3df233d05f0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "address": "fa:16:3e:2b:d7:c2", "network": {"id": "891da1fc-832f-40dc-8203-e34b109bd216", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2042761334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f8c3286fd14430b4ae5be87f712580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81bab5-d8", "ovs_interfaceid": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Converting VIF {"id": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "address": "fa:16:3e:2b:d7:c2", "network": {"id": "891da1fc-832f-40dc-8203-e34b109bd216", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2042761334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f8c3286fd14430b4ae5be87f712580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81bab5-d8", "ovs_interfaceid": "af81bab5-d822-4ef6-a0dd-a234f1143a95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:d7:c2,bridge_name='br-int',has_traffic_filtering=True,id=af81bab5-d822-4ef6-a0dd-a234f1143a95,network=Network(891da1fc-832f-40dc-8203-e34b109bd216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf81bab5-d8') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG os_vif [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:d7:c2,bridge_name='br-int',has_traffic_filtering=True,id=af81bab5-d822-4ef6-a0dd-a234f1143a95,network=Network(891da1fc-832f-40dc-8203-e34b109bd216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf81bab5-d8') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf81bab5-d8, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:33:58 user nova-compute[73917]: INFO os_vif [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:d7:c2,bridge_name='br-int',has_traffic_filtering=True,id=af81bab5-d822-4ef6-a0dd-a234f1143a95,network=Network(891da1fc-832f-40dc-8203-e34b109bd216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf81bab5-d8')
Aug 26 19:33:58 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Deleting instance files /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c_del
Aug 26 19:33:58 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Deletion of /opt/stack/data/nova/instances/0aa9e505-caf3-45d1-96e5-3df233d05f0c_del complete
Aug 26 19:33:58 user nova-compute[73917]: INFO nova.compute.manager [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 26 19:33:58 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:33:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:00 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:34:00 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Took 1.11 seconds to deallocate network for instance.
Aug 26 19:34:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:34:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:34:00 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:34:00 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:34:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:34:00 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Deleted allocations for instance 0aa9e505-caf3-45d1-96e5-3df233d05f0c
Aug 26 19:34:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-85740856-b37c-4d4a-ba55-8162025331f0 tempest-TestServerVolumeAttachScenarioOldVersion-258390537 tempest-TestServerVolumeAttachScenarioOldVersion-258390537-project-member] Lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.435s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:34:00 user nova-compute[73917]: DEBUG nova.compute.manager [req-8557e3e8-b746-44a6-a9e4-cfaf5c414323 req-0277a61f-0eab-47b6-ab7c-ce095f900af0 service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Received event network-vif-plugged-af81bab5-d822-4ef6-a0dd-a234f1143a95 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:34:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8557e3e8-b746-44a6-a9e4-cfaf5c414323 req-0277a61f-0eab-47b6-ab7c-ce095f900af0 service nova] Acquiring lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:34:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8557e3e8-b746-44a6-a9e4-cfaf5c414323 req-0277a61f-0eab-47b6-ab7c-ce095f900af0 service nova] Lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:34:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8557e3e8-b746-44a6-a9e4-cfaf5c414323 req-0277a61f-0eab-47b6-ab7c-ce095f900af0 service nova] Lock "0aa9e505-caf3-45d1-96e5-3df233d05f0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:34:00 user nova-compute[73917]: DEBUG nova.compute.manager [req-8557e3e8-b746-44a6-a9e4-cfaf5c414323 req-0277a61f-0eab-47b6-ab7c-ce095f900af0 service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] No waiting events found dispatching network-vif-plugged-af81bab5-d822-4ef6-a0dd-a234f1143a95 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:34:00 user nova-compute[73917]: WARNING nova.compute.manager [req-8557e3e8-b746-44a6-a9e4-cfaf5c414323 req-0277a61f-0eab-47b6-ab7c-ce095f900af0 service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Received unexpected event network-vif-plugged-af81bab5-d822-4ef6-a0dd-a234f1143a95 for instance with vm_state deleted and task_state None.
Aug 26 19:34:00 user nova-compute[73917]: DEBUG nova.compute.manager [req-8557e3e8-b746-44a6-a9e4-cfaf5c414323 req-0277a61f-0eab-47b6-ab7c-ce095f900af0 service nova] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Received event network-vif-deleted-af81bab5-d822-4ef6-a0dd-a234f1143a95 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:34:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:07 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:34:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:34:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:10 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:34:10 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:34:10 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Didn't find any instances for network info cache update. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 19:34:11 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:34:11 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:34:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-c2ccf63f-737b-4b74-8b9e-abadcb87f283 req-404dd0f7-b239-4f90-a0c6-b7505f74e26e service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received event network-changed-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:34:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-c2ccf63f-737b-4b74-8b9e-abadcb87f283 req-404dd0f7-b239-4f90-a0c6-b7505f74e26e service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Refreshing instance network info cache due to event network-changed-511b289f-3048-493d-b658-e31546805791. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:34:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c2ccf63f-737b-4b74-8b9e-abadcb87f283 req-404dd0f7-b239-4f90-a0c6-b7505f74e26e service nova] Acquiring lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:34:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c2ccf63f-737b-4b74-8b9e-abadcb87f283 req-404dd0f7-b239-4f90-a0c6-b7505f74e26e service nova] Acquired lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:34:11 user nova-compute[73917]: DEBUG nova.network.neutron [req-c2ccf63f-737b-4b74-8b9e-abadcb87f283 req-404dd0f7-b239-4f90-a0c6-b7505f74e26e service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Refreshing network info cache for port 511b289f-3048-493d-b658-e31546805791 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:34:12 user nova-compute[73917]: DEBUG nova.network.neutron [req-c2ccf63f-737b-4b74-8b9e-abadcb87f283 req-404dd0f7-b239-4f90-a0c6-b7505f74e26e service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Updated VIF entry in instance network info cache for port 511b289f-3048-493d-b658-e31546805791. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:34:12 user nova-compute[73917]: DEBUG nova.network.neutron [req-c2ccf63f-737b-4b74-8b9e-abadcb87f283 req-404dd0f7-b239-4f90-a0c6-b7505f74e26e service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Updating instance_info_cache with network_info: [{"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:34:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c2ccf63f-737b-4b74-8b9e-abadcb87f283 req-404dd0f7-b239-4f90-a0c6-b7505f74e26e service nova] Releasing lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:34:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-900abc27-4181-4c46-8ef9-31a3cbe077ab req-5ffc3bc8-f90f-4996-9af0-51fc5b89e230 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received event network-changed-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:34:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-900abc27-4181-4c46-8ef9-31a3cbe077ab req-5ffc3bc8-f90f-4996-9af0-51fc5b89e230 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Refreshing instance network info cache due to event network-changed-511b289f-3048-493d-b658-e31546805791. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:34:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-900abc27-4181-4c46-8ef9-31a3cbe077ab req-5ffc3bc8-f90f-4996-9af0-51fc5b89e230 service nova] Acquiring lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:34:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-900abc27-4181-4c46-8ef9-31a3cbe077ab req-5ffc3bc8-f90f-4996-9af0-51fc5b89e230 service nova] Acquired lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:34:13 user nova-compute[73917]: DEBUG nova.network.neutron [req-900abc27-4181-4c46-8ef9-31a3cbe077ab req-5ffc3bc8-f90f-4996-9af0-51fc5b89e230 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Refreshing network info cache for port 511b289f-3048-493d-b658-e31546805791 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:34:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:34:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:34:13 user nova-compute[73917]: INFO nova.compute.manager [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Detaching volume 00048de6-d6f5-4110-a320-4050c20dff48
Aug 26 19:34:13 user nova-compute[73917]: INFO nova.virt.block_device [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Attempting to driver detach volume 00048de6-d6f5-4110-a320-4050c20dff48 from mountpoint /dev/vdb
Aug 26 19:34:13 user nova-compute[73917]: DEBUG nova.network.neutron [req-900abc27-4181-4c46-8ef9-31a3cbe077ab req-5ffc3bc8-f90f-4996-9af0-51fc5b89e230 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Updated VIF entry in instance network info cache for port 511b289f-3048-493d-b658-e31546805791. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:34:13 user nova-compute[73917]: DEBUG nova.network.neutron [req-900abc27-4181-4c46-8ef9-31a3cbe077ab req-5ffc3bc8-f90f-4996-9af0-51fc5b89e230 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Updating instance_info_cache with network_info: [{"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:34:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Attempting to detach device vdb from instance dfb9fa80-41e1-4c0f-a0da-89fa020581ef from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:34:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:34:13 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:34:13 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 19:34:13 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:34:13 user nova-compute[73917]:   <serial>00048de6-d6f5-4110-a320-4050c20dff48</serial>
Aug 26 19:34:13 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 19:34:13 user nova-compute[73917]: </disk>
Aug 26 19:34:13 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:34:13 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Successfully detached device vdb from instance dfb9fa80-41e1-4c0f-a0da-89fa020581ef from the persistent domain config.
Aug 26 19:34:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dfb9fa80-41e1-4c0f-a0da-89fa020581ef from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:34:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:34:13 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:34:13 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 19:34:13 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:34:13 user nova-compute[73917]:   <serial>00048de6-d6f5-4110-a320-4050c20dff48</serial>
Aug 26 19:34:13 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 19:34:13 user nova-compute[73917]: </disk>
Aug 26 19:34:13 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:34:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-900abc27-4181-4c46-8ef9-31a3cbe077ab req-5ffc3bc8-f90f-4996-9af0-51fc5b89e230 service nova] Releasing lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:34:13 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693078438.8560908, 0aa9e505-caf3-45d1-96e5-3df233d05f0c => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:34:13 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] VM Stopped (Lifecycle Event)
Aug 26 19:34:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ac607169-bbc0-478c-9741-076da69bd4d6 None None] [instance: 0aa9e505-caf3-45d1-96e5-3df233d05f0c] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:34:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:34:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:34:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:34:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:34:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693078454.1578348, dfb9fa80-41e1-4c0f-a0da-89fa020581ef => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dfb9fa80-41e1-4c0f-a0da-89fa020581ef {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:34:14 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Successfully detached device vdb from instance dfb9fa80-41e1-4c0f-a0da-89fa020581ef from the live domain config.
Aug 26 19:34:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBeZEgwY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:34:14 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:34:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1e3fff-1c55-4fa9-b2dc-1d473d40f186]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b76bdd-9fe0-4b25-977b-97e9bec26b97]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)
Aug 26 19:34:14 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 (non-flash)
Aug 26 19:34:14 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b985239a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48'): ({'sdb'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Removing single pathed devices sdb {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a7fd74-3e7e-4a5a-8287-451206e0cbc5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2dad01-c054-4864-81ca-0254ae7b38a0]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Flushing IO for device /dev/sdb {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcfde9d-a735-45b4-b9f8-3592087ab5f2]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f10a3c9-7d9c-417b-aef8-083a47ad3179]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[192e774c-8156-46be-b8d8-00ca8813d946]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cbdfd7-8c04-4030-ac6c-1a52b4d594f3]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48, portal: 172.16.0.220,3260]
Aug 26 19:34:14 user nova-compute[73917]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48, portal: 172.16.0.220,3260] successful.
Aug 26 19:34:14 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00048de6-d6f5-4110-a320-4050c20dff48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[31900719-ea23-4b40-b434-acb73fde014b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] <== disconnect_volume: return (273ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:34:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:34:15 user nova-compute[73917]: DEBUG nova.objects.instance [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lazy-loading 'flavor' on Instance uuid dfb9fa80-41e1-4c0f-a0da-89fa020581ef {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:34:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-70225c49-4be0-4ae8-ada6-ee8c14c41e80 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.630s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:34:15 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:34:15 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:34:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:34:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:34:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:34:15 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:34:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:16 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:34:16 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:34:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8516MB free_disk=25.12957000732422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance dfb9fa80-41e1-4c0f-a0da-89fa020581ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 5c350c27-2506-419d-a54f-da4cee2b4ebc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid dfb9fa80-41e1-4c0f-a0da-89fa020581ef {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid 5c350c27-2506-419d-a54f-da4cee2b4ebc {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:34:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:34:18 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:34:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:19 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:34:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:34:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:34:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:34:34 user nova-compute[73917]: INFO nova.compute.manager [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Unshelving
Aug 26 19:34:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:34:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:34:35 user nova-compute[73917]: DEBUG nova.objects.instance [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'pci_requests' on Instance uuid 24e53fcd-f3ea-4f6a-a09c-83813f739a1e {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:34:35 user nova-compute[73917]: DEBUG nova.objects.instance [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'numa_topology' on Instance uuid 24e53fcd-f3ea-4f6a-a09c-83813f739a1e {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:34:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:34:35 user nova-compute[73917]: INFO nova.compute.claims [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Claim successful on node user
Aug 26 19:34:35 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:34:35 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:34:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.246s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:34:35 user nova-compute[73917]: INFO nova.network.neutron [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Updating port 2dcdc64c-d3c6-4e11-bc82-a4149510e4fb with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 19:34:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:34:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquired lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:34:36 user nova-compute[73917]: DEBUG nova.network.neutron [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:34:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-899a45df-48f2-4c89-9a9a-86fc0eaa6f47 req-2f8decb2-6655-4e6a-8628-73995bc0b6f5 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received event network-changed-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:34:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-899a45df-48f2-4c89-9a9a-86fc0eaa6f47 req-2f8decb2-6655-4e6a-8628-73995bc0b6f5 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Refreshing instance network info cache due to event network-changed-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:34:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-899a45df-48f2-4c89-9a9a-86fc0eaa6f47 req-2f8decb2-6655-4e6a-8628-73995bc0b6f5 service nova] Acquiring lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:34:36 user nova-compute[73917]: DEBUG nova.network.neutron [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Updating instance_info_cache with network_info: [{"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:34:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Releasing lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:34:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:34:36 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Creating image(s)
Aug 26 19:34:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "/opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:34:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "/opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:34:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "/opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:34:36 user nova-compute[73917]: DEBUG nova.objects.instance [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'trusted_certs' on Instance uuid 24e53fcd-f3ea-4f6a-a09c-83813f739a1e {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:34:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-899a45df-48f2-4c89-9a9a-86fc0eaa6f47 req-2f8decb2-6655-4e6a-8628-73995bc0b6f5 service nova] Acquired lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:34:36 user nova-compute[73917]: DEBUG nova.network.neutron [req-899a45df-48f2-4c89-9a9a-86fc0eaa6f47 req-2f8decb2-6655-4e6a-8628-73995bc0b6f5 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Refreshing network info cache for port 2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:34:36 user nova-compute[73917]: DEBUG nova.objects.base [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Object Instance<24e53fcd-f3ea-4f6a-a09c-83813f739a1e> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:34:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "c945ac371e635510a61af6c987c17e4ab8c32c5d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:34:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "c945ac371e635510a61af6c987c17e4ab8c32c5d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:34:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c945ac371e635510a61af6c987c17e4ab8c32c5d.part --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c945ac371e635510a61af6c987c17e4ab8c32c5d.part --force-share --output=json" returned: 0 in 0.177s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:37 user nova-compute[73917]: DEBUG nova.virt.images [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] bb8c6385-e1da-4cee-ae53-42173209c9c7 was qcow2, converting to raw {{(pid=73917) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 19:34:37 user nova-compute[73917]: DEBUG nova.privsep.utils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73917) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 19:34:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c945ac371e635510a61af6c987c17e4ab8c32c5d.part /opt/stack/data/nova/instances/_base/c945ac371e635510a61af6c987c17e4ab8c32c5d.converted {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:38 user nova-compute[73917]: DEBUG nova.network.neutron [req-899a45df-48f2-4c89-9a9a-86fc0eaa6f47 req-2f8decb2-6655-4e6a-8628-73995bc0b6f5 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Updated VIF entry in instance network info cache for port 2dcdc64c-d3c6-4e11-bc82-a4149510e4fb. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:34:38 user nova-compute[73917]: DEBUG nova.network.neutron [req-899a45df-48f2-4c89-9a9a-86fc0eaa6f47 req-2f8decb2-6655-4e6a-8628-73995bc0b6f5 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Updating instance_info_cache with network_info: [{"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:34:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-899a45df-48f2-4c89-9a9a-86fc0eaa6f47 req-2f8decb2-6655-4e6a-8628-73995bc0b6f5 service nova] Releasing lock "refresh_cache-24e53fcd-f3ea-4f6a-a09c-83813f739a1e" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:34:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c945ac371e635510a61af6c987c17e4ab8c32c5d.part /opt/stack/data/nova/instances/_base/c945ac371e635510a61af6c987c17e4ab8c32c5d.converted" returned: 0 in 0.642s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c945ac371e635510a61af6c987c17e4ab8c32c5d.converted --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c945ac371e635510a61af6c987c17e4ab8c32c5d.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "c945ac371e635510a61af6c987c17e4ab8c32c5d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.046s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:34:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c945ac371e635510a61af6c987c17e4ab8c32c5d --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c945ac371e635510a61af6c987c17e4ab8c32c5d --force-share --output=json" returned: 0 in 0.173s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "c945ac371e635510a61af6c987c17e4ab8c32c5d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:34:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "c945ac371e635510a61af6c987c17e4ab8c32c5d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:34:38 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c945ac371e635510a61af6c987c17e4ab8c32c5d --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c945ac371e635510a61af6c987c17e4ab8c32c5d --force-share --output=json" returned: 0 in 0.175s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c945ac371e635510a61af6c987c17e4ab8c32c5d,backing_fmt=raw /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c945ac371e635510a61af6c987c17e4ab8c32c5d,backing_fmt=raw /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk 1073741824" returned: 0 in 0.055s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "c945ac371e635510a61af6c987c17e4ab8c32c5d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:34:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c945ac371e635510a61af6c987c17e4ab8c32c5d --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c945ac371e635510a61af6c987c17e4ab8c32c5d --force-share --output=json" returned: 0 in 0.185s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:39 user nova-compute[73917]: DEBUG nova.objects.instance [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'migration_context' on Instance uuid 24e53fcd-f3ea-4f6a-a09c-83813f739a1e {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:34:39 user nova-compute[73917]: DEBUG nova.objects.base [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Object Instance<24e53fcd-f3ea-4f6a-a09c-83813f739a1e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:34:39 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Rebasing disk image.
Aug 26 19:34:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 -F raw /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 -F raw /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk" returned: 0 in 2.206s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Ensure instance console log exists: /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Start _get_guest_xml network_info=[{"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='73b04b3c8e91c752c982796113eb8f09',container_format='bare',created_at=2023-08-26T19:32:42Z,direct_url=<?>,disk_format='qcow2',id=bb8c6385-e1da-4cee-ae53-42173209c9c7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1484928366-shelved',owner='96cf0ccd59944be6922b561ecddc7d5b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T19:32:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:34:41 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:34:41 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='73b04b3c8e91c752c982796113eb8f09',container_format='bare',created_at=2023-08-26T19:32:42Z,direct_url=<?>,disk_format='qcow2',id=bb8c6385-e1da-4cee-ae53-42173209c9c7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1484928366-shelved',owner='96cf0ccd59944be6922b561ecddc7d5b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T19:32:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.objects.instance [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'vcpu_model' on Instance uuid 24e53fcd-f3ea-4f6a-a09c-83813f739a1e {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.objects.base [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Object Instance<24e53fcd-f3ea-4f6a-a09c-83813f739a1e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T19:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1484928366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1484928366',id=42,image_ref='bb8c6385-e1da-4cee-ae53-42173209c9c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1671593516',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:30:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='96cf0ccd59944be6922b561ecddc7d5b',ramdisk_id='',reservation_id='r-zh03nzoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1729132577',owner_user_name='tempest-AttachVolumeShelveTestJSON-1729132577-project-member',shelved_at='2023-08-26T19:32:45.685994',shelved_host='user',shelved_image_id='bb8c6385-e1da-4cee-ae53-42173209c9c7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860f7b92664e43d19c908f3bdb52d717',uuid=24e53fcd-f3ea-4f6a-a09c-83813f739a1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converting VIF {"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9a:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dcdc64c-d3c6-4e11-bc82-a4149510e4fb,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcdc64c-d3') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.objects.instance [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'pci_devices' on Instance uuid 24e53fcd-f3ea-4f6a-a09c-83813f739a1e {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.objects.base [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Object Instance<24e53fcd-f3ea-4f6a-a09c-83813f739a1e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:34:41 user nova-compute[73917]:   <uuid>24e53fcd-f3ea-4f6a-a09c-83813f739a1e</uuid>
Aug 26 19:34:41 user nova-compute[73917]:   <name>instance-0000002a</name>
Aug 26 19:34:41 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:34:41 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:34:41 user nova-compute[73917]:   <metadata>
Aug 26 19:34:41 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:34:41 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:34:41 user nova-compute[73917]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1484928366</nova:name>
Aug 26 19:34:41 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:34:41</nova:creationTime>
Aug 26 19:34:41 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:34:41 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:34:41 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:34:41 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:34:41 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:34:41 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:34:41 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:34:41 user nova-compute[73917]:       <nova:owner>
Aug 26 19:34:41 user nova-compute[73917]:         <nova:user uuid="860f7b92664e43d19c908f3bdb52d717">tempest-AttachVolumeShelveTestJSON-1729132577-project-member</nova:user>
Aug 26 19:34:41 user nova-compute[73917]:         <nova:project uuid="96cf0ccd59944be6922b561ecddc7d5b">tempest-AttachVolumeShelveTestJSON-1729132577</nova:project>
Aug 26 19:34:41 user nova-compute[73917]:       </nova:owner>
Aug 26 19:34:41 user nova-compute[73917]:       <nova:root type="image" uuid="bb8c6385-e1da-4cee-ae53-42173209c9c7"/>
Aug 26 19:34:41 user nova-compute[73917]:       <nova:ports>
Aug 26 19:34:41 user nova-compute[73917]:         <nova:port uuid="2dcdc64c-d3c6-4e11-bc82-a4149510e4fb">
Aug 26 19:34:41 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 19:34:41 user nova-compute[73917]:         </nova:port>
Aug 26 19:34:41 user nova-compute[73917]:       </nova:ports>
Aug 26 19:34:41 user nova-compute[73917]:     </nova:instance>
Aug 26 19:34:41 user nova-compute[73917]:   </metadata>
Aug 26 19:34:41 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:34:41 user nova-compute[73917]:     <system>
Aug 26 19:34:41 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:34:41 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:34:41 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:34:41 user nova-compute[73917]:       <entry name="serial">24e53fcd-f3ea-4f6a-a09c-83813f739a1e</entry>
Aug 26 19:34:41 user nova-compute[73917]:       <entry name="uuid">24e53fcd-f3ea-4f6a-a09c-83813f739a1e</entry>
Aug 26 19:34:41 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:34:41 user nova-compute[73917]:     </system>
Aug 26 19:34:41 user nova-compute[73917]:   </sysinfo>
Aug 26 19:34:41 user nova-compute[73917]:   <os>
Aug 26 19:34:41 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:34:41 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:34:41 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:34:41 user nova-compute[73917]:   </os>
Aug 26 19:34:41 user nova-compute[73917]:   <features>
Aug 26 19:34:41 user nova-compute[73917]:     <acpi/>
Aug 26 19:34:41 user nova-compute[73917]:     <apic/>
Aug 26 19:34:41 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:34:41 user nova-compute[73917]:   </features>
Aug 26 19:34:41 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:34:41 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:34:41 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:34:41 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:34:41 user nova-compute[73917]:   </clock>
Aug 26 19:34:41 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:34:41 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:34:41 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:34:41 user nova-compute[73917]:   </cpu>
Aug 26 19:34:41 user nova-compute[73917]:   <devices>
Aug 26 19:34:41 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:34:41 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:34:41 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk"/>
Aug 26 19:34:41 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:34:41 user nova-compute[73917]:     </disk>
Aug 26 19:34:41 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:34:41 user nova-compute[73917]:       <mac address="fa:16:3e:b6:9a:f9"/>
Aug 26 19:34:41 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:34:41 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:34:41 user nova-compute[73917]:       <target dev="tap2dcdc64c-d3"/>
Aug 26 19:34:41 user nova-compute[73917]:     </interface>
Aug 26 19:34:41 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:34:41 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/console.log" append="off"/>
Aug 26 19:34:41 user nova-compute[73917]:     </serial>
Aug 26 19:34:41 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:34:41 user nova-compute[73917]:     <video>
Aug 26 19:34:41 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:34:41 user nova-compute[73917]:     </video>
Aug 26 19:34:41 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:34:41 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:34:41 user nova-compute[73917]:     </rng>
Aug 26 19:34:41 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:34:41 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:34:41 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:34:41 user nova-compute[73917]:     </memballoon>
Aug 26 19:34:41 user nova-compute[73917]:   </devices>
Aug 26 19:34:41 user nova-compute[73917]: </domain>
Aug 26 19:34:41 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T19:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1484928366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1484928366',id=42,image_ref='bb8c6385-e1da-4cee-ae53-42173209c9c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1671593516',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:30:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='96cf0ccd59944be6922b561ecddc7d5b',ramdisk_id='',reservation_id='r-zh03nzoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1729132577',owner_user_name='tempest-AttachVolumeShelveTestJSON-1729132577-project-member',shelved_at='2023-08-26T19:32:45.685994',shelved_host='user',shelved_image_id='bb8c6385-e1da-4cee-ae53-42173209c9c7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860f7b92664e43d19c908f3bdb52d717',uuid=24e53fcd-f3ea-4f6a-a09c-83813f739a1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converting VIF {"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9a:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dcdc64c-d3c6-4e11-bc82-a4149510e4fb,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcdc64c-d3') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG os_vif [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9a:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dcdc64c-d3c6-4e11-bc82-a4149510e4fb,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcdc64c-d3') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dcdc64c-d3, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2dcdc64c-d3, col_values=(('external_ids', {'iface-id': '2dcdc64c-d3c6-4e11-bc82-a4149510e4fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:9a:f9', 'vm-uuid': '24e53fcd-f3ea-4f6a-a09c-83813f739a1e'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:34:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:41 user nova-compute[73917]: INFO os_vif [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9a:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dcdc64c-d3c6-4e11-bc82-a4149510e4fb,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcdc64c-d3')
Aug 26 19:34:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:34:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] No VIF found with MAC fa:16:3e:b6:9a:f9, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:34:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:43 user nova-compute[73917]: DEBUG nova.compute.manager [req-ac19e785-bafe-48e8-9542-72c6ea755791 req-e567e88d-3bb6-4ae2-8403-9f3b2ae01d01 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received event network-vif-plugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:34:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ac19e785-bafe-48e8-9542-72c6ea755791 req-e567e88d-3bb6-4ae2-8403-9f3b2ae01d01 service nova] Acquiring lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:34:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ac19e785-bafe-48e8-9542-72c6ea755791 req-e567e88d-3bb6-4ae2-8403-9f3b2ae01d01 service nova] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:34:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ac19e785-bafe-48e8-9542-72c6ea755791 req-e567e88d-3bb6-4ae2-8403-9f3b2ae01d01 service nova] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:34:43 user nova-compute[73917]: DEBUG nova.compute.manager [req-ac19e785-bafe-48e8-9542-72c6ea755791 req-e567e88d-3bb6-4ae2-8403-9f3b2ae01d01 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] No waiting events found dispatching network-vif-plugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:34:43 user nova-compute[73917]: WARNING nova.compute.manager [req-ac19e785-bafe-48e8-9542-72c6ea755791 req-e567e88d-3bb6-4ae2-8403-9f3b2ae01d01 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received unexpected event network-vif-plugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 19:34:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:45 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078485.4317358, 24e53fcd-f3ea-4f6a-a09c-83813f739a1e => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:34:45 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] VM Resumed (Lifecycle Event)
Aug 26 19:34:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:34:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:34:45 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Instance spawned successfully.
Aug 26 19:34:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:34:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:34:45 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:34:45 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078485.435136, 24e53fcd-f3ea-4f6a-a09c-83813f739a1e => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:34:45 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] VM Started (Lifecycle Event)
Aug 26 19:34:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:34:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:34:45 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:34:45 user nova-compute[73917]: DEBUG nova.compute.manager [req-00591a85-d909-4711-b4f4-40b2283b6b07 req-88d41eb2-5919-43e2-b0a5-b7e1cbbfcaa1 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received event network-vif-plugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:34:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-00591a85-d909-4711-b4f4-40b2283b6b07 req-88d41eb2-5919-43e2-b0a5-b7e1cbbfcaa1 service nova] Acquiring lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:34:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-00591a85-d909-4711-b4f4-40b2283b6b07 req-88d41eb2-5919-43e2-b0a5-b7e1cbbfcaa1 service nova] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:34:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-00591a85-d909-4711-b4f4-40b2283b6b07 req-88d41eb2-5919-43e2-b0a5-b7e1cbbfcaa1 service nova] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:34:45 user nova-compute[73917]: DEBUG nova.compute.manager [req-00591a85-d909-4711-b4f4-40b2283b6b07 req-88d41eb2-5919-43e2-b0a5-b7e1cbbfcaa1 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] No waiting events found dispatching network-vif-plugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:34:45 user nova-compute[73917]: WARNING nova.compute.manager [req-00591a85-d909-4711-b4f4-40b2283b6b07 req-88d41eb2-5919-43e2-b0a5-b7e1cbbfcaa1 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received unexpected event network-vif-plugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 19:34:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:34:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-7b541fea-e60e-4a35-a00e-4b90d580e021 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.968s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:34:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:34:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:09 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:35:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:35:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:11 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:35:11 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:35:11 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:35:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:35:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:35:11 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:35:11 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid dfb9fa80-41e1-4c0f-a0da-89fa020581ef {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:35:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:35:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:35:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:35:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:35:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:35:11 user nova-compute[73917]: INFO nova.compute.manager [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Terminating instance
Aug 26 19:35:11 user nova-compute[73917]: DEBUG nova.compute.manager [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:35:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:12 user nova-compute[73917]: DEBUG nova.compute.manager [req-cc1b71c7-2edb-4397-a243-9995dd9e9ee3 req-83cd6e5d-74e2-4ca2-94b0-a14076c46bde service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received event network-vif-unplugged-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:35:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cc1b71c7-2edb-4397-a243-9995dd9e9ee3 req-83cd6e5d-74e2-4ca2-94b0-a14076c46bde service nova] Acquiring lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:35:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cc1b71c7-2edb-4397-a243-9995dd9e9ee3 req-83cd6e5d-74e2-4ca2-94b0-a14076c46bde service nova] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:35:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cc1b71c7-2edb-4397-a243-9995dd9e9ee3 req-83cd6e5d-74e2-4ca2-94b0-a14076c46bde service nova] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:35:12 user nova-compute[73917]: DEBUG nova.compute.manager [req-cc1b71c7-2edb-4397-a243-9995dd9e9ee3 req-83cd6e5d-74e2-4ca2-94b0-a14076c46bde service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] No waiting events found dispatching network-vif-unplugged-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:35:12 user nova-compute[73917]: DEBUG nova.compute.manager [req-cc1b71c7-2edb-4397-a243-9995dd9e9ee3 req-83cd6e5d-74e2-4ca2-94b0-a14076c46bde service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received event network-vif-unplugged-511b289f-3048-493d-b658-e31546805791 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:35:12 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Instance destroyed successfully.
Aug 26 19:35:12 user nova-compute[73917]: DEBUG nova.objects.instance [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lazy-loading 'resources' on Instance uuid dfb9fa80-41e1-4c0f-a0da-89fa020581ef {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:35:12 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-830005725',display_name='tempest-TestMinimumBasicScenario-server-830005725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-830005725',id=41,image_ref='f67140e5-e503-4aed-830e-32289bf444d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKIvXK+EFfAY8AbL9No26I8VkXN8H+s7RYjXU+kc/uU0ESbs6S2bOlZ3YqKLmR0KjWCcFGmGJECDyJn0N/OdkNO4xIFFra8Wly//jdVw7ylYCxB9DelSYujFH3w6qpR7w==',key_name='tempest-TestMinimumBasicScenario-2144509393',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70c87f2fad4648bf90baef68e16d6a5e',ramdisk_id='',reservation_id='r-fesjgsbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f67140e5-e503-4aed-830e-32289bf444d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1764501925',owner_user_name='tempest-TestMinimumBasicScenario-1764501925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:32:26Z,user_data=None,user_id='00d8fe7c07284b06985746a92c11f518',uuid=dfb9fa80-41e1-4c0f-a0da-89fa020581ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:35:12 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Converting VIF {"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:35:12 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:18:e2,bridge_name='br-int',has_traffic_filtering=True,id=511b289f-3048-493d-b658-e31546805791,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511b289f-30') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:35:12 user nova-compute[73917]: DEBUG os_vif [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:18:e2,bridge_name='br-int',has_traffic_filtering=True,id=511b289f-3048-493d-b658-e31546805791,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511b289f-30') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:35:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap511b289f-30, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:35:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:35:12 user nova-compute[73917]: INFO os_vif [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:18:e2,bridge_name='br-int',has_traffic_filtering=True,id=511b289f-3048-493d-b658-e31546805791,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511b289f-30')
Aug 26 19:35:12 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Deleting instance files /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef_del
Aug 26 19:35:12 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Deletion of /opt/stack/data/nova/instances/dfb9fa80-41e1-4c0f-a0da-89fa020581ef_del complete
Aug 26 19:35:12 user nova-compute[73917]: INFO nova.compute.manager [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 26 19:35:12 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:35:12 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:35:12 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:35:12 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Updating instance_info_cache with network_info: [{"id": "511b289f-3048-493d-b658-e31546805791", "address": "fa:16:3e:0c:18:e2", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511b289f-30", "ovs_interfaceid": "511b289f-3048-493d-b658-e31546805791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:35:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-dfb9fa80-41e1-4c0f-a0da-89fa020581ef" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:35:12 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:35:13 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:35:13 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:35:13 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:35:13 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Took 0.78 seconds to deallocate network for instance.
Aug 26 19:35:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:35:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:35:13 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:35:13 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:35:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:35:13 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Deleted allocations for instance dfb9fa80-41e1-4c0f-a0da-89fa020581ef
Aug 26 19:35:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-71c16354-32ed-45d0-9919-125cb28edf3a tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.110s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:35:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:14 user nova-compute[73917]: DEBUG nova.compute.manager [req-4ac3a42f-c32a-4480-9a8b-e6562a93bf77 req-253a3745-bbaa-4f73-a4aa-95a834224e64 service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Received event network-changed-0d3046e2-38a9-4900-bd32-4b9041bcd8f0 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:35:14 user nova-compute[73917]: DEBUG nova.compute.manager [req-4ac3a42f-c32a-4480-9a8b-e6562a93bf77 req-253a3745-bbaa-4f73-a4aa-95a834224e64 service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Refreshing instance network info cache due to event network-changed-0d3046e2-38a9-4900-bd32-4b9041bcd8f0. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:35:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4ac3a42f-c32a-4480-9a8b-e6562a93bf77 req-253a3745-bbaa-4f73-a4aa-95a834224e64 service nova] Acquiring lock "refresh_cache-5c350c27-2506-419d-a54f-da4cee2b4ebc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:35:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4ac3a42f-c32a-4480-9a8b-e6562a93bf77 req-253a3745-bbaa-4f73-a4aa-95a834224e64 service nova] Acquired lock "refresh_cache-5c350c27-2506-419d-a54f-da4cee2b4ebc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:35:14 user nova-compute[73917]: DEBUG nova.network.neutron [req-4ac3a42f-c32a-4480-9a8b-e6562a93bf77 req-253a3745-bbaa-4f73-a4aa-95a834224e64 service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Refreshing network info cache for port 0d3046e2-38a9-4900-bd32-4b9041bcd8f0 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:35:14 user nova-compute[73917]: DEBUG nova.compute.manager [req-66f33422-b220-4115-87f6-590e5583e90b req-fb73fc79-3a92-496d-9475-9c8640d41744 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received event network-vif-plugged-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:35:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-66f33422-b220-4115-87f6-590e5583e90b req-fb73fc79-3a92-496d-9475-9c8640d41744 service nova] Acquiring lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:35:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-66f33422-b220-4115-87f6-590e5583e90b req-fb73fc79-3a92-496d-9475-9c8640d41744 service nova] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:35:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-66f33422-b220-4115-87f6-590e5583e90b req-fb73fc79-3a92-496d-9475-9c8640d41744 service nova] Lock "dfb9fa80-41e1-4c0f-a0da-89fa020581ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:35:14 user nova-compute[73917]: DEBUG nova.compute.manager [req-66f33422-b220-4115-87f6-590e5583e90b req-fb73fc79-3a92-496d-9475-9c8640d41744 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] No waiting events found dispatching network-vif-plugged-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:35:14 user nova-compute[73917]: WARNING nova.compute.manager [req-66f33422-b220-4115-87f6-590e5583e90b req-fb73fc79-3a92-496d-9475-9c8640d41744 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received unexpected event network-vif-plugged-511b289f-3048-493d-b658-e31546805791 for instance with vm_state deleted and task_state None.
Aug 26 19:35:14 user nova-compute[73917]: DEBUG nova.compute.manager [req-66f33422-b220-4115-87f6-590e5583e90b req-fb73fc79-3a92-496d-9475-9c8640d41744 service nova] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Received event network-vif-deleted-511b289f-3048-493d-b658-e31546805791 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:35:14 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:35:14 user nova-compute[73917]: DEBUG nova.network.neutron [req-4ac3a42f-c32a-4480-9a8b-e6562a93bf77 req-253a3745-bbaa-4f73-a4aa-95a834224e64 service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Updated VIF entry in instance network info cache for port 0d3046e2-38a9-4900-bd32-4b9041bcd8f0. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:35:14 user nova-compute[73917]: DEBUG nova.network.neutron [req-4ac3a42f-c32a-4480-9a8b-e6562a93bf77 req-253a3745-bbaa-4f73-a4aa-95a834224e64 service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Updating instance_info_cache with network_info: [{"id": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "address": "fa:16:3e:ba:d3:78", "network": {"id": "e5ca5d7a-a164-4883-8a3e-5a189fecbcf2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-925027545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f304ce651b5242efa39d1f348662fb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3046e2-38", "ovs_interfaceid": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:35:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4ac3a42f-c32a-4480-9a8b-e6562a93bf77 req-253a3745-bbaa-4f73-a4aa-95a834224e64 service nova] Releasing lock "refresh_cache-5c350c27-2506-419d-a54f-da4cee2b4ebc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:35:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:35:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:35:14 user nova-compute[73917]: DEBUG nova.objects.instance [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lazy-loading 'flavor' on Instance uuid 5c350c27-2506-419d-a54f-da4cee2b4ebc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:35:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:35:15 user nova-compute[73917]: INFO nova.compute.manager [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Attaching volume f38d4983-40d1-4ec3-a26d-8c41e8a69e7d to /dev/vdb
Aug 26 19:35:15 user nova-compute[73917]: DEBUG os_brick.utils [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85bf273-bd1f-4af8-a70f-3deeb68a618c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b648f139-48da-4ca9-9160-84e2e72ba1ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afb18b0-c35d-47cf-a68a-0a2c3b908c1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d87697-d98a-446f-abe3-c4d22112fed4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:35:15 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:35:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9848f9-ee08-4c83-b268-3530041755a9]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG os_brick.utils [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:35:15 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Updating existing volume attachment record: dfaa09b9-91fd-4e57-950b-8817d5505626 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:35:16 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:35:16 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:35:17 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:35:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:35:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:35:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:35:17 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:35:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:18 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:18 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:35:18 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:35:18 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8493MB free_disk=25.12945556640625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:35:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:35:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:35:18 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 5c350c27-2506-419d-a54f-da4cee2b4ebc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:35:18 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 24e53fcd-f3ea-4f6a-a09c-83813f739a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:35:18 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:35:18 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:35:18 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:35:18 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:35:18 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:35:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:35:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:20 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:35:20 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:35:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquiring lock "71c539b7-f142-4762-8566-4c11babae575" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:35:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "71c539b7-f142-4762-8566-4c11babae575" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:35:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:35:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:35:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:35:24 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:35:24 user nova-compute[73917]: INFO nova.compute.claims [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Claim successful on node user
Aug 26 19:35:25 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.227s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG nova.network.neutron [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:35:25 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:35:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:35:25 user nova-compute[73917]: INFO nova.virt.block_device [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Booting with volume c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 at /dev/vda
Aug 26 19:35:25 user nova-compute[73917]: DEBUG nova.policy [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef0552b4cc7c4f4d88ee36f9491bd3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8fd28f327440e5a107e4b40d8c5aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG os_brick.utils [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e955139-99e5-4dee-bf08-f4dc5c9fe4e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[128dd4d3-68ae-496e-a017-62c4732690dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3170c50e-3b31-4323-934b-5275a0a907f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c1e529-9adf-4768-a572-e0a4de9542c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:35:25 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d9cb32-8ae2-497b-ba69-9b3641b6f6ea]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG os_brick.utils [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Updating existing volume attachment record: 93a1647c-41e1-4b56-96e2-58e44b5ab684 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mqoreRtn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:35:25 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:35:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:35:25 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:35:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:35:25 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d98960c-e4e9-4e2e-84fe-f33cfa8d4ff9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:35:25 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd22f881-393d-4cf2-85d2-40c02e33b90c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d] added
Aug 26 19:35:25 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[979b5d36-078c-415a-b58d-b9e833a42be7]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace0a3c8-f575-4e3c-aa5f-a6395e7352fa]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG nova.network.neutron [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Successfully created port: 7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mqoreRtn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mqoreRtn" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5521fe4-c502-480a-b4bb-e32eca3dd64f]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mqoreRtn'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4716c5ab-ad04-4616-993d-db70633f88fa]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61e39c2-5995-4e12-9b86-00a7afd549ff]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 19:35:25 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:35:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 19:35:25 user nova-compute[73917]:  {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:35:25 user nova-compute[73917]: WARNING os_brick.initiator.connectors.iscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 19:35:25 user nova-compute[73917]: 
Aug 26 19:35:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89e3c90-8c14-47f4-8f65-9f406ae148cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d, portal: 172.16.0.220,3260]
Aug 26 19:35:26 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d, portal: 172.16.0.220,3260] successful.
Aug 26 19:35:26 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f184aff4-2f9c-4ac5-8631-6efe9b8171e7]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[471a8158-9d1f-4eaf-bc66-95666954f7ac]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)
Aug 26 19:35:26 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)
Aug 26 19:35:26 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f779c466-02ab-4038-92e6-b890859bcd11]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG nova.network.neutron [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Successfully updated port: 7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquiring lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquired lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG nova.network.neutron [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-47cbba92-478d-4ca2-a30a-fc9d69d37282 req-8f2807d1-42d8-4956-8b83-eee10a47d607 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received event network-changed-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-47cbba92-478d-4ca2-a30a-fc9d69d37282 req-8f2807d1-42d8-4956-8b83-eee10a47d607 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Refreshing instance network info cache due to event network-changed-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-47cbba92-478d-4ca2-a30a-fc9d69d37282 req-8f2807d1-42d8-4956-8b83-eee10a47d607 service nova] Acquiring lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:35:26 user nova-compute[73917]: DEBUG nova.network.neutron [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG nova.network.neutron [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Updating instance_info_cache with network_info: [{"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Releasing lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Instance network_info: |[{"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-47cbba92-478d-4ca2-a30a-fc9d69d37282 req-8f2807d1-42d8-4956-8b83-eee10a47d607 service nova] Acquired lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG nova.network.neutron [req-47cbba92-478d-4ca2-a30a-fc9d69d37282 req-8f2807d1-42d8-4956-8b83-eee10a47d607 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Refreshing network info cache for port 7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mqoreRtn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23565373333356664', 'path': '/dev/sdb'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565373333356664', 'path': '/dev/sdb'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG nova.objects.instance [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lazy-loading 'flavor' on Instance uuid 5c350c27-2506-419d-a54f-da4cee2b4ebc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:35:27 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:35:27 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 19:35:27 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:35:27 user nova-compute[73917]:   <serial>f38d4983-40d1-4ec3-a26d-8c41e8a69e7d</serial>
Aug 26 19:35:27 user nova-compute[73917]: </disk>
Aug 26 19:35:27 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693078512.5390148, dfb9fa80-41e1-4c0f-a0da-89fa020581ef => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:35:27 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] VM Stopped (Lifecycle Event)
Aug 26 19:35:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af0d9b2f-7aba-4231-b7a3-b57043c29159 None None] [instance: dfb9fa80-41e1-4c0f-a0da-89fa020581ef] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] No VIF found with MAC fa:16:3e:ba:d3:78, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-acdc93f4-2456-436d-882f-a2c97bb5ca3b tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.585s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG nova.network.neutron [req-47cbba92-478d-4ca2-a30a-fc9d69d37282 req-8f2807d1-42d8-4956-8b83-eee10a47d607 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Updated VIF entry in instance network info cache for port 7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG nova.network.neutron [req-47cbba92-478d-4ca2-a30a-fc9d69d37282 req-8f2807d1-42d8-4956-8b83-eee10a47d607 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Updating instance_info_cache with network_info: [{"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:35:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-47cbba92-478d-4ca2-a30a-fc9d69d37282 req-8f2807d1-42d8-4956-8b83-eee10a47d607 service nova] Releasing lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:35:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG nova.objects.instance [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lazy-loading 'flavor' on Instance uuid 5c350c27-2506-419d-a54f-da4cee2b4ebc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:35:30 user nova-compute[73917]: INFO nova.compute.manager [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Attaching volume 68b039f3-8270-4853-93e5-6be6b2c800cb to /dev/vdc
Aug 26 19:35:30 user nova-compute[73917]: DEBUG os_brick.utils [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d23add6-83f3-476a-a120-92f3fe90a1f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff4717a-6bfa-4e16-bddf-58583954c995]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b37d8e0-1ffa-40f3-b614-762d80e435d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfc37da-2f4e-449f-81fc-10634e205174]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:35:30 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:35:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76917c6-030e-4a3e-9a02-af431e1e7584]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG os_brick.utils [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:35:30 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Updating existing volume attachment record: d0985bd9-a13c-4daf-a634-acb867a91d98 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:35:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:35:36 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Creating image(s)
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Did not create local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Ensure instance console log exists: /opt/stack/data/nova/instances/71c539b7-f142-4762-8566-4c11babae575/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Start _get_guest_xml network_info=[{"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'joznIWdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71c539b7-f142-4762-8566-4c11babae575', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4', 'serial': 'c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '93a1647c-41e1-4b56-96e2-58e44b5ab684', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:35:36 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:35:36 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'joznIWdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:35:36 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:35:36 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:35:36 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c8e104-f5a9-487c-a68f-08261661b372]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:35:36 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a723608d-4114-48f4-9fd1-013bed09f0a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4] added
Aug 26 19:35:36 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4663c9-b8c4-4724-be8c-2f57e59aa89e]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f9f419-d138-4526-819b-103ed1918edd]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v joznIWdD {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v joznIWdD" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9560663-179c-478b-a542-ca93e6c12a85]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'joznIWdD'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d630162a-4c30-4a8b-ac45-eac39c195a8b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ea2f65-fea8-483b-a352-a377e25b34b1]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)
Aug 26 19:35:36 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)
Aug 26 19:35:36 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ded619-d870-4248-9b43-965d3de4ea41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4, portal: 172.16.0.220,3260]
Aug 26 19:35:36 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4, portal: 172.16.0.220,3260] successful.
Aug 26 19:35:36 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b5eaa6-10bf-4149-8391-a90f4a631130]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0757adf-f15a-4320-a261-b3e9a8f6021a]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)
Aug 26 19:35:36 user nova-compute[73917]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:35:36 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)
Aug 26 19:35:36 user nova-compute[73917]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:35:36 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b050522-a65c-4c37-af2a-08691c30ae8f]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:35:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'joznIWdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26566326564626665', 'path': '/dev/sdc'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566326564626665', 'path': '/dev/sdc'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:35:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-763505391',display_name='tempest-TestShelveInstance-server-763505391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-763505391',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxbkAEeRNNUpdupl0HezplQPbflafoItcKeJ0Ucl0BfkXiH6vy+3IUyX/ALUXHuqugKl6m7l882KSOE6pvTef/tI2FBrQ6NVEM1houUOr21Vgs5eN2qSDUqPQyYkJP8Xg==',key_name='tempest-TestShelveInstance-280473212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be8fd28f327440e5a107e4b40d8c5aca',ramdisk_id='',reservation_id='r-sjp08okj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1743210450',owner_user_name='tempest-TestShelveInstance-1743210450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:35:25Z,user_data=None,user_id='ef0552b4cc7c4f4d88ee36f9491bd3aa',uuid=71c539b7-f142-4762-8566-4c11babae575,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Converting VIF {"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44,network=Network(b51c4533-8ad8-4684-9c5b-7c2c64a80f0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc26e8e-d6') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG nova.objects.instance [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lazy-loading 'pci_devices' on Instance uuid 71c539b7-f142-4762-8566-4c11babae575 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:35:37 user nova-compute[73917]:   <uuid>71c539b7-f142-4762-8566-4c11babae575</uuid>
Aug 26 19:35:37 user nova-compute[73917]:   <name>instance-0000002d</name>
Aug 26 19:35:37 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:35:37 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:35:37 user nova-compute[73917]:   <metadata>
Aug 26 19:35:37 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:35:37 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:35:37 user nova-compute[73917]:       <nova:name>tempest-TestShelveInstance-server-763505391</nova:name>
Aug 26 19:35:37 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:35:36</nova:creationTime>
Aug 26 19:35:37 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:35:37 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:35:37 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:35:37 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:35:37 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:35:37 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:35:37 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:35:37 user nova-compute[73917]:       <nova:owner>
Aug 26 19:35:37 user nova-compute[73917]:         <nova:user uuid="ef0552b4cc7c4f4d88ee36f9491bd3aa">tempest-TestShelveInstance-1743210450-project-member</nova:user>
Aug 26 19:35:37 user nova-compute[73917]:         <nova:project uuid="be8fd28f327440e5a107e4b40d8c5aca">tempest-TestShelveInstance-1743210450</nova:project>
Aug 26 19:35:37 user nova-compute[73917]:       </nova:owner>
Aug 26 19:35:37 user nova-compute[73917]:       <nova:ports>
Aug 26 19:35:37 user nova-compute[73917]:         <nova:port uuid="7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44">
Aug 26 19:35:37 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 19:35:37 user nova-compute[73917]:         </nova:port>
Aug 26 19:35:37 user nova-compute[73917]:       </nova:ports>
Aug 26 19:35:37 user nova-compute[73917]:     </nova:instance>
Aug 26 19:35:37 user nova-compute[73917]:   </metadata>
Aug 26 19:35:37 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:35:37 user nova-compute[73917]:     <system>
Aug 26 19:35:37 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:35:37 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:35:37 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:35:37 user nova-compute[73917]:       <entry name="serial">71c539b7-f142-4762-8566-4c11babae575</entry>
Aug 26 19:35:37 user nova-compute[73917]:       <entry name="uuid">71c539b7-f142-4762-8566-4c11babae575</entry>
Aug 26 19:35:37 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:35:37 user nova-compute[73917]:     </system>
Aug 26 19:35:37 user nova-compute[73917]:   </sysinfo>
Aug 26 19:35:37 user nova-compute[73917]:   <os>
Aug 26 19:35:37 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:35:37 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:35:37 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:35:37 user nova-compute[73917]:   </os>
Aug 26 19:35:37 user nova-compute[73917]:   <features>
Aug 26 19:35:37 user nova-compute[73917]:     <acpi/>
Aug 26 19:35:37 user nova-compute[73917]:     <apic/>
Aug 26 19:35:37 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:35:37 user nova-compute[73917]:   </features>
Aug 26 19:35:37 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:35:37 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:35:37 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:35:37 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:35:37 user nova-compute[73917]:   </clock>
Aug 26 19:35:37 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:35:37 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:35:37 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:35:37 user nova-compute[73917]:   </cpu>
Aug 26 19:35:37 user nova-compute[73917]:   <devices>
Aug 26 19:35:37 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:35:37 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:35:37 user nova-compute[73917]:       <source dev="/dev/sdc"/>
Aug 26 19:35:37 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:35:37 user nova-compute[73917]:       <serial>c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4</serial>
Aug 26 19:35:37 user nova-compute[73917]:     </disk>
Aug 26 19:35:37 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:35:37 user nova-compute[73917]:       <mac address="fa:16:3e:95:69:f8"/>
Aug 26 19:35:37 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:35:37 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:35:37 user nova-compute[73917]:       <target dev="tap7cc26e8e-d6"/>
Aug 26 19:35:37 user nova-compute[73917]:     </interface>
Aug 26 19:35:37 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:35:37 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/71c539b7-f142-4762-8566-4c11babae575/console.log" append="off"/>
Aug 26 19:35:37 user nova-compute[73917]:     </serial>
Aug 26 19:35:37 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:35:37 user nova-compute[73917]:     <video>
Aug 26 19:35:37 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:35:37 user nova-compute[73917]:     </video>
Aug 26 19:35:37 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:35:37 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:35:37 user nova-compute[73917]:     </rng>
Aug 26 19:35:37 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:35:37 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:35:37 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:35:37 user nova-compute[73917]:     </memballoon>
Aug 26 19:35:37 user nova-compute[73917]:   </devices>
Aug 26 19:35:37 user nova-compute[73917]: </domain>
Aug 26 19:35:37 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:35:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-763505391',display_name='tempest-TestShelveInstance-server-763505391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-763505391',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxbkAEeRNNUpdupl0HezplQPbflafoItcKeJ0Ucl0BfkXiH6vy+3IUyX/ALUXHuqugKl6m7l882KSOE6pvTef/tI2FBrQ6NVEM1houUOr21Vgs5eN2qSDUqPQyYkJP8Xg==',key_name='tempest-TestShelveInstance-280473212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be8fd28f327440e5a107e4b40d8c5aca',ramdisk_id='',reservation_id='r-sjp08okj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1743210450',owner_user_name='tempest-TestShelveInstance-1743210450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:35:25Z,user_data=None,user_id='ef0552b4cc7c4f4d88ee36f9491bd3aa',uuid=71c539b7-f142-4762-8566-4c11babae575,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Converting VIF {"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44,network=Network(b51c4533-8ad8-4684-9c5b-7c2c64a80f0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc26e8e-d6') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG os_vif [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44,network=Network(b51c4533-8ad8-4684-9c5b-7c2c64a80f0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc26e8e-d6') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cc26e8e-d6, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7cc26e8e-d6, col_values=(('external_ids', {'iface-id': '7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:69:f8', 'vm-uuid': '71c539b7-f142-4762-8566-4c11babae575'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:37 user nova-compute[73917]: INFO os_vif [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44,network=Network(b51c4533-8ad8-4684-9c5b-7c2c64a80f0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc26e8e-d6')
Aug 26 19:35:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:35:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] No VIF found with MAC fa:16:3e:95:69:f8, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:35:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:39 user nova-compute[73917]: DEBUG nova.compute.manager [req-8a3c1064-102b-47ed-b3a9-7d85417534c6 req-0a4d7ceb-2d8c-47fc-b109-0e5acee0ab1c service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received event network-vif-plugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:35:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8a3c1064-102b-47ed-b3a9-7d85417534c6 req-0a4d7ceb-2d8c-47fc-b109-0e5acee0ab1c service nova] Acquiring lock "71c539b7-f142-4762-8566-4c11babae575-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:35:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8a3c1064-102b-47ed-b3a9-7d85417534c6 req-0a4d7ceb-2d8c-47fc-b109-0e5acee0ab1c service nova] Lock "71c539b7-f142-4762-8566-4c11babae575-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:35:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8a3c1064-102b-47ed-b3a9-7d85417534c6 req-0a4d7ceb-2d8c-47fc-b109-0e5acee0ab1c service nova] Lock "71c539b7-f142-4762-8566-4c11babae575-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:35:39 user nova-compute[73917]: DEBUG nova.compute.manager [req-8a3c1064-102b-47ed-b3a9-7d85417534c6 req-0a4d7ceb-2d8c-47fc-b109-0e5acee0ab1c service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] No waiting events found dispatching network-vif-plugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:35:39 user nova-compute[73917]: WARNING nova.compute.manager [req-8a3c1064-102b-47ed-b3a9-7d85417534c6 req-0a4d7ceb-2d8c-47fc-b109-0e5acee0ab1c service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received unexpected event network-vif-plugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 for instance with vm_state building and task_state spawning.
Aug 26 19:35:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078541.1282113, 71c539b7-f142-4762-8566-4c11babae575 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:35:41 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 71c539b7-f142-4762-8566-4c11babae575] VM Resumed (Lifecycle Event)
Aug 26 19:35:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:35:41 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 71c539b7-f142-4762-8566-4c11babae575] Instance spawned successfully.
Aug 26 19:35:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 71c539b7-f142-4762-8566-4c11babae575] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 71c539b7-f142-4762-8566-4c11babae575] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:35:41 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 71c539b7-f142-4762-8566-4c11babae575] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:35:41 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078541.131738, 71c539b7-f142-4762-8566-4c11babae575 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:35:41 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 71c539b7-f142-4762-8566-4c11babae575] VM Started (Lifecycle Event)
Aug 26 19:35:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 71c539b7-f142-4762-8566-4c11babae575] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 71c539b7-f142-4762-8566-4c11babae575] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:35:41 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 71c539b7-f142-4762-8566-4c11babae575] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:35:41 user nova-compute[73917]: INFO nova.compute.manager [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Took 4.98 seconds to spawn the instance on the hypervisor.
Aug 26 19:35:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG nova.compute.manager [req-9dc9e25f-5c40-4cc8-88a7-ab0da46c81fb req-190d744b-e841-4be8-a85e-cccf1a5fd2bd service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received event network-vif-plugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9dc9e25f-5c40-4cc8-88a7-ab0da46c81fb req-190d744b-e841-4be8-a85e-cccf1a5fd2bd service nova] Acquiring lock "71c539b7-f142-4762-8566-4c11babae575-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9dc9e25f-5c40-4cc8-88a7-ab0da46c81fb req-190d744b-e841-4be8-a85e-cccf1a5fd2bd service nova] Lock "71c539b7-f142-4762-8566-4c11babae575-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9dc9e25f-5c40-4cc8-88a7-ab0da46c81fb req-190d744b-e841-4be8-a85e-cccf1a5fd2bd service nova] Lock "71c539b7-f142-4762-8566-4c11babae575-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG nova.compute.manager [req-9dc9e25f-5c40-4cc8-88a7-ab0da46c81fb req-190d744b-e841-4be8-a85e-cccf1a5fd2bd service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] No waiting events found dispatching network-vif-plugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:35:41 user nova-compute[73917]: WARNING nova.compute.manager [req-9dc9e25f-5c40-4cc8-88a7-ab0da46c81fb req-190d744b-e841-4be8-a85e-cccf1a5fd2bd service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received unexpected event network-vif-plugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 for instance with vm_state building and task_state spawning.
Aug 26 19:35:41 user nova-compute[73917]: INFO nova.compute.manager [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Took 16.51 seconds to build instance.
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-889b7cee-f54e-42ea-862b-b88f7b6e2a0e tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "71c539b7-f142-4762-8566-4c11babae575" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.608s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JTjFOebW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:35:41 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:35:41 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:35:41 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d5448f-b4e1-4737-bf2b-2fa574fa3d6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:35:41 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bcad40-824b-4b26-92c5-b7dd9a8ca9e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb] added
Aug 26 19:35:41 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbdb3b0-f831-4bde-823e-f7e4f6118a47]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb045bde-8483-47c1-b63d-b1f210476d5d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JTjFOebW {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JTjFOebW" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44eb564-eb46-43e8-98db-9fe60e1dcf0c]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JTjFOebW'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6cdcc9-d95f-435b-b88a-c0ce1b955abf]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52595fd-bd69-4ede-b49b-bf2d25d9e997]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)
Aug 26 19:35:41 user nova-compute[73917]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:35:41 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)
Aug 26 19:35:41 user nova-compute[73917]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:35:41 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[554a76cc-1587-4c97-b7d6-7845639faba0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb, portal: 172.16.0.220,3260]
Aug 26 19:35:41 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb, portal: 172.16.0.220,3260] successful.
Aug 26 19:35:41 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b4d900-3234-4f78-88e2-24536a6f7c48]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[773e7bf7-a64c-446f-aac3-03e60a8a13dd]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)
Aug 26 19:35:41 user nova-compute[73917]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:35:41 user nova-compute[73917]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb (non-flash)
Aug 26 19:35:41 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)
Aug 26 19:35:41 user nova-compute[73917]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:35:41 user nova-compute[73917]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb (non-flash)
Aug 26 19:35:41 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] HCTL ('35', '-', '-', 0) found on session 53 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a193f4d-c291-4ae8-96da-caae806c3ae9]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:41 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: None {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:35:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:42 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:35:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JTjFOebW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:35:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:35:42 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23861363632343862', 'path': '/dev/sdd'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:35:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861363632343862', 'path': '/dev/sdd'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:35:42 user nova-compute[73917]: DEBUG nova.objects.instance [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lazy-loading 'flavor' on Instance uuid 5c350c27-2506-419d-a54f-da4cee2b4ebc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:35:42 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:35:42 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:35:42 user nova-compute[73917]:   <source dev="/dev/sdd"/>
Aug 26 19:35:42 user nova-compute[73917]:   <target dev="vdc" bus="virtio"/>
Aug 26 19:35:42 user nova-compute[73917]:   <serial>68b039f3-8270-4853-93e5-6be6b2c800cb</serial>
Aug 26 19:35:42 user nova-compute[73917]: </disk>
Aug 26 19:35:42 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:35:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:35:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:35:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:35:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] No VIF found with MAC fa:16:3e:ba:d3:78, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:35:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9c12bc57-f164-468d-bfbc-9298211f1208 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.078s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:35:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:35:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:35:44 user nova-compute[73917]: INFO nova.compute.manager [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Detaching volume 68b039f3-8270-4853-93e5-6be6b2c800cb
Aug 26 19:35:44 user nova-compute[73917]: INFO nova.virt.block_device [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Attempting to driver detach volume 68b039f3-8270-4853-93e5-6be6b2c800cb from mountpoint /dev/vdc
Aug 26 19:35:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Attempting to detach device vdc from instance 5c350c27-2506-419d-a54f-da4cee2b4ebc from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:35:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:35:44 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:35:44 user nova-compute[73917]:   <source dev="/dev/sdd"/>
Aug 26 19:35:44 user nova-compute[73917]:   <target dev="vdc" bus="virtio"/>
Aug 26 19:35:44 user nova-compute[73917]:   <serial>68b039f3-8270-4853-93e5-6be6b2c800cb</serial>
Aug 26 19:35:44 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 19:35:44 user nova-compute[73917]: </disk>
Aug 26 19:35:44 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:35:44 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Successfully detached device vdc from instance 5c350c27-2506-419d-a54f-da4cee2b4ebc from the persistent domain config.
Aug 26 19:35:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5c350c27-2506-419d-a54f-da4cee2b4ebc from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:35:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:35:44 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:35:44 user nova-compute[73917]:   <source dev="/dev/sdd"/>
Aug 26 19:35:44 user nova-compute[73917]:   <target dev="vdc" bus="virtio"/>
Aug 26 19:35:44 user nova-compute[73917]:   <serial>68b039f3-8270-4853-93e5-6be6b2c800cb</serial>
Aug 26 19:35:44 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 19:35:44 user nova-compute[73917]: </disk>
Aug 26 19:35:44 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693078545.3545623, 5c350c27-2506-419d-a54f-da4cee2b4ebc => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5c350c27-2506-419d-a54f-da4cee2b4ebc {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:35:45 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Successfully detached device vdc from instance 5c350c27-2506-419d-a54f-da4cee2b4ebc from the live domain config.
Aug 26 19:35:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JTjFOebW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:35:45 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:35:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[997d03e1-acde-465f-b449-1be47b3d2629]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3008f1f6-6960-4606-9e15-8bad371524c4]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)
Aug 26 19:35:45 user nova-compute[73917]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:35:45 user nova-compute[73917]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb (non-flash)
Aug 26 19:35:45 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)
Aug 26 19:35:45 user nova-compute[73917]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:35:45 user nova-compute[73917]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb (non-flash)
Aug 26 19:35:45 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b98522710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb'): ({'sdd'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Removing single pathed devices sdd {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d61dc8f-8d70-44e1-b783-5b3977c9296d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[888ec07a-851c-4279-b283-ad8616ec5473]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Flushing IO for device /dev/sdd {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d21665-e27d-4a84-9a1b-2980f565ed25]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.067s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc3a0a4-673d-44fb-9498-588f81a32f47]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] SCSI volumes sdd have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3e7b39-ac52-4d71-9862-d2e5e511be0c]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[657d356c-fa99-4cde-bd8d-a52e425ad3d8]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb, portal: 172.16.0.220,3260]
Aug 26 19:35:45 user nova-compute[73917]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb, portal: 172.16.0.220,3260] successful.
Aug 26 19:35:45 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b039f3-8270-4853-93e5-6be6b2c800cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8267a003-9e65-4415-9bfe-8ef2f7fd8d0b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] <== disconnect_volume: return (309ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:35:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:35:46 user nova-compute[73917]: DEBUG nova.objects.instance [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lazy-loading 'flavor' on Instance uuid 5c350c27-2506-419d-a54f-da4cee2b4ebc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:35:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1089605b-e48b-4bc9-abda-1eabe64eb744 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.703s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:35:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:35:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "298fb1d1-b2b3-4809-9690-12f531a4ff10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:36:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:36:06 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:36:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:36:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:36:06 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:36:06 user nova-compute[73917]: INFO nova.compute.claims [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Claim successful on node user
Aug 26 19:36:07 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:36:07 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:36:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.246s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:36:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:36:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:36:07 user nova-compute[73917]: DEBUG nova.network.neutron [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:36:07 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:36:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:36:07 user nova-compute[73917]: DEBUG nova.policy [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00d8fe7c07284b06985746a92c11f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c87f2fad4648bf90baef68e16d6a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:36:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:36:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:36:07 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Creating image(s)
Aug 26 19:36:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "/opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:36:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "/opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:36:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "/opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:36:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "5de966a3faf05f65d2c168268da87a37ce90d544" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:36:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "5de966a3faf05f65d2c168268da87a37ce90d544" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:36:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5de966a3faf05f65d2c168268da87a37ce90d544.part --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5de966a3faf05f65d2c168268da87a37ce90d544.part --force-share --output=json" returned: 0 in 0.182s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:08 user nova-compute[73917]: DEBUG nova.virt.images [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] dd993060-0bae-4efa-ada4-489511d9ff49 was qcow2, converting to raw {{(pid=73917) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 19:36:08 user nova-compute[73917]: DEBUG nova.privsep.utils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73917) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 19:36:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5de966a3faf05f65d2c168268da87a37ce90d544.part /opt/stack/data/nova/instances/_base/5de966a3faf05f65d2c168268da87a37ce90d544.converted {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:08 user nova-compute[73917]: DEBUG nova.network.neutron [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Successfully created port: 4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:36:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5de966a3faf05f65d2c168268da87a37ce90d544.part /opt/stack/data/nova/instances/_base/5de966a3faf05f65d2c168268da87a37ce90d544.converted" returned: 0 in 0.585s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5de966a3faf05f65d2c168268da87a37ce90d544.converted --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5de966a3faf05f65d2c168268da87a37ce90d544.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "5de966a3faf05f65d2c168268da87a37ce90d544" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.497s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:36:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5de966a3faf05f65d2c168268da87a37ce90d544 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:08 user nova-compute[73917]: DEBUG nova.network.neutron [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Successfully updated port: 4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:36:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:36:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquired lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:36:08 user nova-compute[73917]: DEBUG nova.network.neutron [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:36:08 user nova-compute[73917]: DEBUG nova.compute.manager [req-732e2ee6-99de-4973-90bb-36cb81a625e4 req-c42f8165-9f70-4737-8b62-5812fa7c6208 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received event network-changed-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:36:08 user nova-compute[73917]: DEBUG nova.compute.manager [req-732e2ee6-99de-4973-90bb-36cb81a625e4 req-c42f8165-9f70-4737-8b62-5812fa7c6208 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Refreshing instance network info cache due to event network-changed-4884888d-f202-47b6-be09-0e0cca7704e2. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:36:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-732e2ee6-99de-4973-90bb-36cb81a625e4 req-c42f8165-9f70-4737-8b62-5812fa7c6208 service nova] Acquiring lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.network.neutron [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5de966a3faf05f65d2c168268da87a37ce90d544 --force-share --output=json" returned: 0 in 0.175s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "5de966a3faf05f65d2c168268da87a37ce90d544" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "5de966a3faf05f65d2c168268da87a37ce90d544" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5de966a3faf05f65d2c168268da87a37ce90d544 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5de966a3faf05f65d2c168268da87a37ce90d544 --force-share --output=json" returned: 0 in 0.179s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5de966a3faf05f65d2c168268da87a37ce90d544,backing_fmt=raw /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5de966a3faf05f65d2c168268da87a37ce90d544,backing_fmt=raw /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk 1073741824" returned: 0 in 0.061s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "5de966a3faf05f65d2c168268da87a37ce90d544" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5de966a3faf05f65d2c168268da87a37ce90d544 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.network.neutron [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Updating instance_info_cache with network_info: [{"id": "4884888d-f202-47b6-be09-0e0cca7704e2", "address": "fa:16:3e:2f:df:54", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4884888d-f2", "ovs_interfaceid": "4884888d-f202-47b6-be09-0e0cca7704e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Releasing lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Instance network_info: |[{"id": "4884888d-f202-47b6-be09-0e0cca7704e2", "address": "fa:16:3e:2f:df:54", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4884888d-f2", "ovs_interfaceid": "4884888d-f202-47b6-be09-0e0cca7704e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-732e2ee6-99de-4973-90bb-36cb81a625e4 req-c42f8165-9f70-4737-8b62-5812fa7c6208 service nova] Acquired lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.network.neutron [req-732e2ee6-99de-4973-90bb-36cb81a625e4 req-c42f8165-9f70-4737-8b62-5812fa7c6208 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Refreshing network info cache for port 4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5de966a3faf05f65d2c168268da87a37ce90d544 --force-share --output=json" returned: 0 in 0.190s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Checking if we can resize image /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Cannot resize image /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Ensure instance console log exists: /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Start _get_guest_xml network_info=[{"id": "4884888d-f202-47b6-be09-0e0cca7704e2", "address": "fa:16:3e:2f:df:54", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4884888d-f2", "ovs_interfaceid": "4884888d-f202-47b6-be09-0e0cca7704e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:36:04Z,direct_url=<?>,disk_format='qcow2',id=dd993060-0bae-4efa-ada4-489511d9ff49,min_disk=0,min_ram=0,name='tempest-scenario-img--1919512886',owner='70c87f2fad4648bf90baef68e16d6a5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:36:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': 'dd993060-0bae-4efa-ada4-489511d9ff49'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:36:09 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:36:09 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:36:04Z,direct_url=<?>,disk_format='qcow2',id=dd993060-0bae-4efa-ada4-489511d9ff49,min_disk=0,min_ram=0,name='tempest-scenario-img--1919512886',owner='70c87f2fad4648bf90baef68e16d6a5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:36:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:36:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-959693260',display_name='tempest-TestMinimumBasicScenario-server-959693260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-959693260',id=46,image_ref='dd993060-0bae-4efa-ada4-489511d9ff49',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrq6awz0xaQ2iMY3gdPadD/sqxiKk+FD1mWFaDKAhAIG3+b8d2fT+ykqYC2UK463dCUIFOXQEA8HYDhZyEA55eUMGfLpNHDKTpfbrdyyqKsMjsK7jW73n9kwIJ0ijhtzw==',key_name='tempest-TestMinimumBasicScenario-1995240937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70c87f2fad4648bf90baef68e16d6a5e',ramdisk_id='',reservation_id='r-ur0oekb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd993060-0bae-4efa-ada4-489511d9ff49',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1764501925',owner_user_name='tempest-TestMinimumBasicScenario-1764501925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:36:07Z,user_data=None,user_id='00d8fe7c07284b06985746a92c11f518',uuid=298fb1d1-b2b3-4809-9690-12f531a4ff10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4884888d-f202-47b6-be09-0e0cca7704e2", "address": "fa:16:3e:2f:df:54", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4884888d-f2", "ovs_interfaceid": "4884888d-f202-47b6-be09-0e0cca7704e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Converting VIF {"id": "4884888d-f202-47b6-be09-0e0cca7704e2", "address": "fa:16:3e:2f:df:54", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4884888d-f2", "ovs_interfaceid": "4884888d-f202-47b6-be09-0e0cca7704e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:df:54,bridge_name='br-int',has_traffic_filtering=True,id=4884888d-f202-47b6-be09-0e0cca7704e2,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4884888d-f2') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.objects.instance [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lazy-loading 'pci_devices' on Instance uuid 298fb1d1-b2b3-4809-9690-12f531a4ff10 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:36:09 user nova-compute[73917]:   <uuid>298fb1d1-b2b3-4809-9690-12f531a4ff10</uuid>
Aug 26 19:36:09 user nova-compute[73917]:   <name>instance-0000002e</name>
Aug 26 19:36:09 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:36:09 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:36:09 user nova-compute[73917]:   <metadata>
Aug 26 19:36:09 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:36:09 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:36:09 user nova-compute[73917]:       <nova:name>tempest-TestMinimumBasicScenario-server-959693260</nova:name>
Aug 26 19:36:09 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:36:09</nova:creationTime>
Aug 26 19:36:09 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:36:09 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:36:09 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:36:09 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:36:09 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:36:09 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:36:09 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:36:09 user nova-compute[73917]:       <nova:owner>
Aug 26 19:36:09 user nova-compute[73917]:         <nova:user uuid="00d8fe7c07284b06985746a92c11f518">tempest-TestMinimumBasicScenario-1764501925-project-member</nova:user>
Aug 26 19:36:09 user nova-compute[73917]:         <nova:project uuid="70c87f2fad4648bf90baef68e16d6a5e">tempest-TestMinimumBasicScenario-1764501925</nova:project>
Aug 26 19:36:09 user nova-compute[73917]:       </nova:owner>
Aug 26 19:36:09 user nova-compute[73917]:       <nova:root type="image" uuid="dd993060-0bae-4efa-ada4-489511d9ff49"/>
Aug 26 19:36:09 user nova-compute[73917]:       <nova:ports>
Aug 26 19:36:09 user nova-compute[73917]:         <nova:port uuid="4884888d-f202-47b6-be09-0e0cca7704e2">
Aug 26 19:36:09 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 19:36:09 user nova-compute[73917]:         </nova:port>
Aug 26 19:36:09 user nova-compute[73917]:       </nova:ports>
Aug 26 19:36:09 user nova-compute[73917]:     </nova:instance>
Aug 26 19:36:09 user nova-compute[73917]:   </metadata>
Aug 26 19:36:09 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:36:09 user nova-compute[73917]:     <system>
Aug 26 19:36:09 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:36:09 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:36:09 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:36:09 user nova-compute[73917]:       <entry name="serial">298fb1d1-b2b3-4809-9690-12f531a4ff10</entry>
Aug 26 19:36:09 user nova-compute[73917]:       <entry name="uuid">298fb1d1-b2b3-4809-9690-12f531a4ff10</entry>
Aug 26 19:36:09 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:36:09 user nova-compute[73917]:     </system>
Aug 26 19:36:09 user nova-compute[73917]:   </sysinfo>
Aug 26 19:36:09 user nova-compute[73917]:   <os>
Aug 26 19:36:09 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:36:09 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:36:09 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:36:09 user nova-compute[73917]:   </os>
Aug 26 19:36:09 user nova-compute[73917]:   <features>
Aug 26 19:36:09 user nova-compute[73917]:     <acpi/>
Aug 26 19:36:09 user nova-compute[73917]:     <apic/>
Aug 26 19:36:09 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:36:09 user nova-compute[73917]:   </features>
Aug 26 19:36:09 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:36:09 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:36:09 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:36:09 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:36:09 user nova-compute[73917]:   </clock>
Aug 26 19:36:09 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:36:09 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:36:09 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:36:09 user nova-compute[73917]:   </cpu>
Aug 26 19:36:09 user nova-compute[73917]:   <devices>
Aug 26 19:36:09 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:36:09 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:36:09 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk"/>
Aug 26 19:36:09 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:36:09 user nova-compute[73917]:     </disk>
Aug 26 19:36:09 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:36:09 user nova-compute[73917]:       <mac address="fa:16:3e:2f:df:54"/>
Aug 26 19:36:09 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:36:09 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:36:09 user nova-compute[73917]:       <target dev="tap4884888d-f2"/>
Aug 26 19:36:09 user nova-compute[73917]:     </interface>
Aug 26 19:36:09 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:36:09 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/console.log" append="off"/>
Aug 26 19:36:09 user nova-compute[73917]:     </serial>
Aug 26 19:36:09 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:36:09 user nova-compute[73917]:     <video>
Aug 26 19:36:09 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:36:09 user nova-compute[73917]:     </video>
Aug 26 19:36:09 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:36:09 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:36:09 user nova-compute[73917]:     </rng>
Aug 26 19:36:09 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:36:09 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:36:09 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:36:09 user nova-compute[73917]:     </memballoon>
Aug 26 19:36:09 user nova-compute[73917]:   </devices>
Aug 26 19:36:09 user nova-compute[73917]: </domain>
Aug 26 19:36:09 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:36:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-959693260',display_name='tempest-TestMinimumBasicScenario-server-959693260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-959693260',id=46,image_ref='dd993060-0bae-4efa-ada4-489511d9ff49',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrq6awz0xaQ2iMY3gdPadD/sqxiKk+FD1mWFaDKAhAIG3+b8d2fT+ykqYC2UK463dCUIFOXQEA8HYDhZyEA55eUMGfLpNHDKTpfbrdyyqKsMjsK7jW73n9kwIJ0ijhtzw==',key_name='tempest-TestMinimumBasicScenario-1995240937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70c87f2fad4648bf90baef68e16d6a5e',ramdisk_id='',reservation_id='r-ur0oekb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd993060-0bae-4efa-ada4-489511d9ff49',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1764501925',owner_user_name='tempest-TestMinimumBasicScenario-1764501925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:36:07Z,user_data=None,user_id='00d8fe7c07284b06985746a92c11f518',uuid=298fb1d1-b2b3-4809-9690-12f531a4ff10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4884888d-f202-47b6-be09-0e0cca7704e2", "address": "fa:16:3e:2f:df:54", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4884888d-f2", "ovs_interfaceid": "4884888d-f202-47b6-be09-0e0cca7704e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Converting VIF {"id": "4884888d-f202-47b6-be09-0e0cca7704e2", "address": "fa:16:3e:2f:df:54", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4884888d-f2", "ovs_interfaceid": "4884888d-f202-47b6-be09-0e0cca7704e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:df:54,bridge_name='br-int',has_traffic_filtering=True,id=4884888d-f202-47b6-be09-0e0cca7704e2,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4884888d-f2') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG os_vif [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:df:54,bridge_name='br-int',has_traffic_filtering=True,id=4884888d-f202-47b6-be09-0e0cca7704e2,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4884888d-f2') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4884888d-f2, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4884888d-f2, col_values=(('external_ids', {'iface-id': '4884888d-f202-47b6-be09-0e0cca7704e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:df:54', 'vm-uuid': '298fb1d1-b2b3-4809-9690-12f531a4ff10'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:09 user nova-compute[73917]: INFO os_vif [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:df:54,bridge_name='br-int',has_traffic_filtering=True,id=4884888d-f202-47b6-be09-0e0cca7704e2,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4884888d-f2')
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.network.neutron [req-732e2ee6-99de-4973-90bb-36cb81a625e4 req-c42f8165-9f70-4737-8b62-5812fa7c6208 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Updated VIF entry in instance network info cache for port 4884888d-f202-47b6-be09-0e0cca7704e2. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.network.neutron [req-732e2ee6-99de-4973-90bb-36cb81a625e4 req-c42f8165-9f70-4737-8b62-5812fa7c6208 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Updating instance_info_cache with network_info: [{"id": "4884888d-f202-47b6-be09-0e0cca7704e2", "address": "fa:16:3e:2f:df:54", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4884888d-f2", "ovs_interfaceid": "4884888d-f202-47b6-be09-0e0cca7704e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-732e2ee6-99de-4973-90bb-36cb81a625e4 req-c42f8165-9f70-4737-8b62-5812fa7c6208 service nova] Releasing lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:36:09 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] No VIF found with MAC fa:16:3e:2f:df:54, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:36:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:11 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:36:11 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:36:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-0f45a3eb-622d-4b4e-84d1-6cba6079d1d3 req-f0b6202a-8acc-49f4-8bd4-9a6a628f7555 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received event network-vif-plugged-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:36:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0f45a3eb-622d-4b4e-84d1-6cba6079d1d3 req-f0b6202a-8acc-49f4-8bd4-9a6a628f7555 service nova] Acquiring lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:36:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0f45a3eb-622d-4b4e-84d1-6cba6079d1d3 req-f0b6202a-8acc-49f4-8bd4-9a6a628f7555 service nova] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:36:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0f45a3eb-622d-4b4e-84d1-6cba6079d1d3 req-f0b6202a-8acc-49f4-8bd4-9a6a628f7555 service nova] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:36:11 user nova-compute[73917]: DEBUG nova.compute.manager [req-0f45a3eb-622d-4b4e-84d1-6cba6079d1d3 req-f0b6202a-8acc-49f4-8bd4-9a6a628f7555 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] No waiting events found dispatching network-vif-plugged-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:36:11 user nova-compute[73917]: WARNING nova.compute.manager [req-0f45a3eb-622d-4b4e-84d1-6cba6079d1d3 req-f0b6202a-8acc-49f4-8bd4-9a6a628f7555 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received unexpected event network-vif-plugged-4884888d-f202-47b6-be09-0e0cca7704e2 for instance with vm_state building and task_state spawning.
Aug 26 19:36:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-5c350c27-2506-419d-a54f-da4cee2b4ebc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:36:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-5c350c27-2506-419d-a54f-da4cee2b4ebc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:36:11 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:36:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:11 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Updating instance_info_cache with network_info: [{"id": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "address": "fa:16:3e:ba:d3:78", "network": {"id": "e5ca5d7a-a164-4883-8a3e-5a189fecbcf2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-925027545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f304ce651b5242efa39d1f348662fb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3046e2-38", "ovs_interfaceid": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:36:11 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-5c350c27-2506-419d-a54f-da4cee2b4ebc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:36:11 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:36:13 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078573.1319187, 298fb1d1-b2b3-4809-9690-12f531a4ff10 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:36:13 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] VM Resumed (Lifecycle Event)
Aug 26 19:36:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:36:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:36:13 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Instance spawned successfully.
Aug 26 19:36:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:36:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:36:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:36:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:36:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:36:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:36:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:36:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:36:13 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:36:13 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:36:13 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078573.133064, 298fb1d1-b2b3-4809-9690-12f531a4ff10 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:36:13 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] VM Started (Lifecycle Event)
Aug 26 19:36:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:36:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:36:13 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:36:13 user nova-compute[73917]: INFO nova.compute.manager [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Took 5.92 seconds to spawn the instance on the hypervisor.
Aug 26 19:36:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:36:13 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:36:13 user nova-compute[73917]: INFO nova.compute.manager [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Took 6.50 seconds to build instance.
Aug 26 19:36:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-2f396f71-0923-44a5-8f6c-50e28a0d2bf5 req-ae9c3aed-c432-4fdd-a1c3-197a66449817 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received event network-vif-plugged-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:36:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2f396f71-0923-44a5-8f6c-50e28a0d2bf5 req-ae9c3aed-c432-4fdd-a1c3-197a66449817 service nova] Acquiring lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:36:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2f396f71-0923-44a5-8f6c-50e28a0d2bf5 req-ae9c3aed-c432-4fdd-a1c3-197a66449817 service nova] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:36:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2f396f71-0923-44a5-8f6c-50e28a0d2bf5 req-ae9c3aed-c432-4fdd-a1c3-197a66449817 service nova] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:36:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-2f396f71-0923-44a5-8f6c-50e28a0d2bf5 req-ae9c3aed-c432-4fdd-a1c3-197a66449817 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] No waiting events found dispatching network-vif-plugged-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:36:13 user nova-compute[73917]: WARNING nova.compute.manager [req-2f396f71-0923-44a5-8f6c-50e28a0d2bf5 req-ae9c3aed-c432-4fdd-a1c3-197a66449817 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received unexpected event network-vif-plugged-4884888d-f202-47b6-be09-0e0cca7704e2 for instance with vm_state active and task_state None.
Aug 26 19:36:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1a4c2b19-b230-466c-8009-54a15577dd09 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.586s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:36:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:15 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:36:16 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:36:16 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:36:19 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:36:19 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:36:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:36:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:36:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:36:19 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:36:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:36:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:36:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:20 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:36:20 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:36:20 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8353MB free_disk=25.096920013427734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:36:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:36:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:36:21 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 5c350c27-2506-419d-a54f-da4cee2b4ebc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:36:21 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 24e53fcd-f3ea-4f6a-a09c-83813f739a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:36:21 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 71c539b7-f142-4762-8566-4c11babae575 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:36:21 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 298fb1d1-b2b3-4809-9690-12f531a4ff10 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:36:21 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:36:21 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:36:21 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:36:21 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:36:21 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:36:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:36:23 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:36:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:36:25 user nova-compute[73917]: INFO nova.compute.manager [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Terminating instance
Aug 26 19:36:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-64defcbe-ab0e-4266-b407-d781a6499b09 req-07508dbb-47ad-40c8-944d-509d7b00cb92 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received event network-vif-unplugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-64defcbe-ab0e-4266-b407-d781a6499b09 req-07508dbb-47ad-40c8-944d-509d7b00cb92 service nova] Acquiring lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-64defcbe-ab0e-4266-b407-d781a6499b09 req-07508dbb-47ad-40c8-944d-509d7b00cb92 service nova] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-64defcbe-ab0e-4266-b407-d781a6499b09 req-07508dbb-47ad-40c8-944d-509d7b00cb92 service nova] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-64defcbe-ab0e-4266-b407-d781a6499b09 req-07508dbb-47ad-40c8-944d-509d7b00cb92 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] No waiting events found dispatching network-vif-unplugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-64defcbe-ab0e-4266-b407-d781a6499b09 req-07508dbb-47ad-40c8-944d-509d7b00cb92 service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received event network-vif-unplugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:36:25 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Instance destroyed successfully.
Aug 26 19:36:25 user nova-compute[73917]: DEBUG nova.objects.instance [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lazy-loading 'resources' on Instance uuid 24e53fcd-f3ea-4f6a-a09c-83813f739a1e {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T19:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1484928366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1484928366',id=42,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpGCGggJbEXbF0OVNJLJ7CgUM+t4zKuAo1hX+bjTVZOGWPRk+hqqRNql720cO1HVYFKJp8UEYPhGL0umPueNY4q/aihiXk5GFQMPZSa17qYaaT2B8zrQdoYGbYMPV/LfA==',key_name='tempest-keypair-1671593516',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:34:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96cf0ccd59944be6922b561ecddc7d5b',ramdisk_id='',reservation_id='r-zh03nzoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1729132577',owner_user_name='tempest-AttachVolumeShelveTestJSON-1729132577-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:34:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860f7b92664e43d19c908f3bdb52d717',uuid=24e53fcd-f3ea-4f6a-a09c-83813f739a1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converting VIF {"id": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "address": "fa:16:3e:b6:9a:f9", "network": {"id": "d9a4df01-3d85-4e88-a5bd-a84c6aae21e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-672046049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cf0ccd59944be6922b561ecddc7d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcdc64c-d3", "ovs_interfaceid": "2dcdc64c-d3c6-4e11-bc82-a4149510e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9a:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dcdc64c-d3c6-4e11-bc82-a4149510e4fb,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcdc64c-d3') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG os_vif [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9a:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dcdc64c-d3c6-4e11-bc82-a4149510e4fb,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcdc64c-d3') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dcdc64c-d3, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:36:25 user nova-compute[73917]: INFO os_vif [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9a:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dcdc64c-d3c6-4e11-bc82-a4149510e4fb,network=Network(d9a4df01-3d85-4e88-a5bd-a84c6aae21e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcdc64c-d3')
Aug 26 19:36:25 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Deleting instance files /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e_del
Aug 26 19:36:25 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Deletion of /opt/stack/data/nova/instances/24e53fcd-f3ea-4f6a-a09c-83813f739a1e_del complete
Aug 26 19:36:25 user nova-compute[73917]: INFO nova.compute.manager [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 26 19:36:25 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:36:25 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:36:26 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:36:26 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Took 0.78 seconds to deallocate network for instance.
Aug 26 19:36:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:36:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:36:26 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:36:26 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:36:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:36:26 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Deleted allocations for instance 24e53fcd-f3ea-4f6a-a09c-83813f739a1e
Aug 26 19:36:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-37f73ad9-219d-477b-b03c-4d4268de67a2 tempest-AttachVolumeShelveTestJSON-1729132577 tempest-AttachVolumeShelveTestJSON-1729132577-project-member] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.874s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:36:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-93391281-06fa-4d36-8703-80aba017420d req-d5595a02-9a5d-4acf-bd06-1d30344ee2ab service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received event network-vif-plugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:36:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-93391281-06fa-4d36-8703-80aba017420d req-d5595a02-9a5d-4acf-bd06-1d30344ee2ab service nova] Acquiring lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:36:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-93391281-06fa-4d36-8703-80aba017420d req-d5595a02-9a5d-4acf-bd06-1d30344ee2ab service nova] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:36:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-93391281-06fa-4d36-8703-80aba017420d req-d5595a02-9a5d-4acf-bd06-1d30344ee2ab service nova] Lock "24e53fcd-f3ea-4f6a-a09c-83813f739a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:36:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-93391281-06fa-4d36-8703-80aba017420d req-d5595a02-9a5d-4acf-bd06-1d30344ee2ab service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] No waiting events found dispatching network-vif-plugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:36:27 user nova-compute[73917]: WARNING nova.compute.manager [req-93391281-06fa-4d36-8703-80aba017420d req-d5595a02-9a5d-4acf-bd06-1d30344ee2ab service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received unexpected event network-vif-plugged-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb for instance with vm_state deleted and task_state None.
Aug 26 19:36:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-93391281-06fa-4d36-8703-80aba017420d req-d5595a02-9a5d-4acf-bd06-1d30344ee2ab service nova] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Received event network-vif-deleted-2dcdc64c-d3c6-4e11-bc82-a4149510e4fb {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:36:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:36:35 user nova-compute[73917]: INFO nova.compute.manager [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Detaching volume f38d4983-40d1-4ec3-a26d-8c41e8a69e7d
Aug 26 19:36:35 user nova-compute[73917]: INFO nova.virt.block_device [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Attempting to driver detach volume f38d4983-40d1-4ec3-a26d-8c41e8a69e7d from mountpoint /dev/vdb
Aug 26 19:36:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Attempting to detach device vdb from instance 5c350c27-2506-419d-a54f-da4cee2b4ebc from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:36:35 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:36:35 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 19:36:35 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:36:35 user nova-compute[73917]:   <serial>f38d4983-40d1-4ec3-a26d-8c41e8a69e7d</serial>
Aug 26 19:36:35 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:36:35 user nova-compute[73917]: </disk>
Aug 26 19:36:35 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:36:35 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Successfully detached device vdb from instance 5c350c27-2506-419d-a54f-da4cee2b4ebc from the persistent domain config.
Aug 26 19:36:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c350c27-2506-419d-a54f-da4cee2b4ebc from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:36:35 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:36:35 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 19:36:35 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:36:35 user nova-compute[73917]:   <serial>f38d4983-40d1-4ec3-a26d-8c41e8a69e7d</serial>
Aug 26 19:36:35 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:36:35 user nova-compute[73917]: </disk>
Aug 26 19:36:35 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693078595.8820693, 5c350c27-2506-419d-a54f-da4cee2b4ebc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c350c27-2506-419d-a54f-da4cee2b4ebc {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:36:35 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Successfully detached device vdb from instance 5c350c27-2506-419d-a54f-da4cee2b4ebc from the live domain config.
Aug 26 19:36:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mqoreRtn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:36:35 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:36:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b262ca0e-4a18-4978-9025-7f42baba9dc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8daec3d6-4006-4624-ac91-7d9dc8e6cf51]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)
Aug 26 19:36:35 user nova-compute[73917]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:36:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d (non-flash)
Aug 26 19:36:35 user nova-compute[73917]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:36:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b7858db40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d'): ({'sdb'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Removing single pathed devices sdb {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[768a108d-91af-4361-a864-434d228f39a9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:36:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b31426-82fd-4b04-8a4f-02209035753d]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Flushing IO for device /dev/sdb {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c928eed0-8746-4976-b54d-2dc8f7ca878e]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e2b1c2-285c-453f-95ba-eafcf03d4f05]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[18316089-c92d-464c-90d9-60c2b73e49b1]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9544ae-f91f-42dc-9ec8-990b26c20f25]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d, portal: 172.16.0.220,3260]
Aug 26 19:36:36 user nova-compute[73917]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d, portal: 172.16.0.220,3260] successful.
Aug 26 19:36:36 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f38d4983-40d1-4ec3-a26d-8c41e8a69e7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d499256c-9705-49c7-968a-9df935598311]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] <== disconnect_volume: return (307ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG nova.objects.instance [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lazy-loading 'flavor' on Instance uuid 5c350c27-2506-419d-a54f-da4cee2b4ebc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:36:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5d84f78c-ef46-47c5-80ec-ef7b0551cc34 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.692s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:36:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:40 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693078585.6717536, 24e53fcd-f3ea-4f6a-a09c-83813f739a1e => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:36:40 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] VM Stopped (Lifecycle Event)
Aug 26 19:36:40 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1239997c-570a-4ef0-9e09-6255edda0018 None None] [instance: 24e53fcd-f3ea-4f6a-a09c-83813f739a1e] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:36:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:36:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:11 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:37:11 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:37:12 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:37:12 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:37:12 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Didn't find any instances for network info cache update. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 19:37:15 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:37:15 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:37:15 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:37:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:16 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:37:17 user nova-compute[73917]: DEBUG nova.compute.manager [req-fdce1038-473c-4f08-a638-6514b8e58c8e req-e4e58753-cc10-4183-9519-7794fe66e3b6 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received event network-changed-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:37:17 user nova-compute[73917]: DEBUG nova.compute.manager [req-fdce1038-473c-4f08-a638-6514b8e58c8e req-e4e58753-cc10-4183-9519-7794fe66e3b6 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Refreshing instance network info cache due to event network-changed-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:37:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fdce1038-473c-4f08-a638-6514b8e58c8e req-e4e58753-cc10-4183-9519-7794fe66e3b6 service nova] Acquiring lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:37:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fdce1038-473c-4f08-a638-6514b8e58c8e req-e4e58753-cc10-4183-9519-7794fe66e3b6 service nova] Acquired lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:37:17 user nova-compute[73917]: DEBUG nova.network.neutron [req-fdce1038-473c-4f08-a638-6514b8e58c8e req-e4e58753-cc10-4183-9519-7794fe66e3b6 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Refreshing network info cache for port 7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:37:17 user nova-compute[73917]: DEBUG nova.network.neutron [req-fdce1038-473c-4f08-a638-6514b8e58c8e req-e4e58753-cc10-4183-9519-7794fe66e3b6 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Updated VIF entry in instance network info cache for port 7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:37:17 user nova-compute[73917]: DEBUG nova.network.neutron [req-fdce1038-473c-4f08-a638-6514b8e58c8e req-e4e58753-cc10-4183-9519-7794fe66e3b6 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Updating instance_info_cache with network_info: [{"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:37:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-fdce1038-473c-4f08-a638-6514b8e58c8e req-e4e58753-cc10-4183-9519-7794fe66e3b6 service nova] Releasing lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:37:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquiring lock "71c539b7-f142-4762-8566-4c11babae575" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:37:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "71c539b7-f142-4762-8566-4c11babae575" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:37:17 user nova-compute[73917]: INFO nova.compute.manager [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Shelve offloading
Aug 26 19:37:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:18 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:37:18 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 71c539b7-f142-4762-8566-4c11babae575] Instance destroyed successfully.
Aug 26 19:37:18 user nova-compute[73917]: DEBUG nova.compute.manager [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:37:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquiring lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:37:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquired lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:37:18 user nova-compute[73917]: DEBUG nova.network.neutron [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:37:18 user nova-compute[73917]: DEBUG nova.network.neutron [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Updating instance_info_cache with network_info: [{"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:37:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Releasing lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG nova.compute.manager [req-84b8e141-77da-4a87-ade2-32cdeba5bfbd req-69a707ca-0eb4-440a-bc04-89458b958540 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received event network-vif-unplugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-84b8e141-77da-4a87-ade2-32cdeba5bfbd req-69a707ca-0eb4-440a-bc04-89458b958540 service nova] Acquiring lock "71c539b7-f142-4762-8566-4c11babae575-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-84b8e141-77da-4a87-ade2-32cdeba5bfbd req-69a707ca-0eb4-440a-bc04-89458b958540 service nova] Lock "71c539b7-f142-4762-8566-4c11babae575-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-84b8e141-77da-4a87-ade2-32cdeba5bfbd req-69a707ca-0eb4-440a-bc04-89458b958540 service nova] Lock "71c539b7-f142-4762-8566-4c11babae575-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG nova.compute.manager [req-84b8e141-77da-4a87-ade2-32cdeba5bfbd req-69a707ca-0eb4-440a-bc04-89458b958540 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] No waiting events found dispatching network-vif-unplugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:37:19 user nova-compute[73917]: WARNING nova.compute.manager [req-84b8e141-77da-4a87-ade2-32cdeba5bfbd req-69a707ca-0eb4-440a-bc04-89458b958540 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received unexpected event network-vif-unplugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 for instance with vm_state active and task_state shelving.
Aug 26 19:37:19 user nova-compute[73917]: DEBUG nova.compute.manager [req-84b8e141-77da-4a87-ade2-32cdeba5bfbd req-69a707ca-0eb4-440a-bc04-89458b958540 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received event network-vif-plugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-84b8e141-77da-4a87-ade2-32cdeba5bfbd req-69a707ca-0eb4-440a-bc04-89458b958540 service nova] Acquiring lock "71c539b7-f142-4762-8566-4c11babae575-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-84b8e141-77da-4a87-ade2-32cdeba5bfbd req-69a707ca-0eb4-440a-bc04-89458b958540 service nova] Lock "71c539b7-f142-4762-8566-4c11babae575-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-84b8e141-77da-4a87-ade2-32cdeba5bfbd req-69a707ca-0eb4-440a-bc04-89458b958540 service nova] Lock "71c539b7-f142-4762-8566-4c11babae575-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG nova.compute.manager [req-84b8e141-77da-4a87-ade2-32cdeba5bfbd req-69a707ca-0eb4-440a-bc04-89458b958540 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] No waiting events found dispatching network-vif-plugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:37:19 user nova-compute[73917]: WARNING nova.compute.manager [req-84b8e141-77da-4a87-ade2-32cdeba5bfbd req-69a707ca-0eb4-440a-bc04-89458b958540 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received unexpected event network-vif-plugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 for instance with vm_state active and task_state shelving.
Aug 26 19:37:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:19 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 71c539b7-f142-4762-8566-4c11babae575] Instance destroyed successfully.
Aug 26 19:37:19 user nova-compute[73917]: DEBUG nova.objects.instance [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lazy-loading 'resources' on Instance uuid 71c539b7-f142-4762-8566-4c11babae575 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:35:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-763505391',display_name='tempest-TestShelveInstance-server-763505391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-763505391',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxbkAEeRNNUpdupl0HezplQPbflafoItcKeJ0Ucl0BfkXiH6vy+3IUyX/ALUXHuqugKl6m7l882KSOE6pvTef/tI2FBrQ6NVEM1houUOr21Vgs5eN2qSDUqPQyYkJP8Xg==',key_name='tempest-TestShelveInstance-280473212',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be8fd28f327440e5a107e4b40d8c5aca',ramdisk_id='',reservation_id='r-sjp08okj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1743210450',owner_user_name='tempest-TestShelveInstance-1743210450-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:35:41Z,user_data=None,user_id='ef0552b4cc7c4f4d88ee36f9491bd3aa',uuid=71c539b7-f142-4762-8566-4c11babae575,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Converting VIF {"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44,network=Network(b51c4533-8ad8-4684-9c5b-7c2c64a80f0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc26e8e-d6') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG os_vif [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44,network=Network(b51c4533-8ad8-4684-9c5b-7c2c64a80f0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc26e8e-d6') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cc26e8e-d6, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:37:19 user nova-compute[73917]: INFO os_vif [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44,network=Network(b51c4533-8ad8-4684-9c5b-7c2c64a80f0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc26e8e-d6')
Aug 26 19:37:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'joznIWdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:37:19 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:37:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1953abb2-1a20-454a-b31a-2a36316fbe05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39bc7da-bcd6-44b0-8bc0-d3d93c4435db]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:37:19 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:37:19 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b983d7250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4'): ({'sdc'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Removing single pathed devices sdc {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2a2a9d-c991-4847-9288-201ce2f53d1e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[605a790d-c08d-4180-92ba-2c2e7679f653]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Flushing IO for device /dev/sdc {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca1c4fa-e16c-4e60-ba1a-639008b95e65]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9976627-fb17-4b54-b4df-403f2eae9e4a]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd07647-0cc7-4590-a778-dbcea7bbdb5a]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[247ef027-5c9a-45db-bb73-0a4db3020b39]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4, portal: 172.16.0.220,3260]
Aug 26 19:37:19 user nova-compute[73917]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4, portal: 172.16.0.220,3260] successful.
Aug 26 19:37:19 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fea5aca-6dfa-4788-a4bc-4faf0bf50a6a]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] <== disconnect_volume: return (270ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:37:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:37:19 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Deleting instance files /opt/stack/data/nova/instances/71c539b7-f142-4762-8566-4c11babae575_del
Aug 26 19:37:19 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Deletion of /opt/stack/data/nova/instances/71c539b7-f142-4762-8566-4c11babae575_del complete
Aug 26 19:37:20 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:37:20 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:37:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:37:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:37:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:37:20 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:37:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:37:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:37:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:37:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:37:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:37:20 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Deleted allocations for instance 71c539b7-f142-4762-8566-4c11babae575
Aug 26 19:37:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:37:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:37:20 user nova-compute[73917]: DEBUG nova.objects.instance [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lazy-loading 'numa_topology' on Instance uuid 71c539b7-f142-4762-8566-4c11babae575 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:37:20 user nova-compute[73917]: DEBUG nova.objects.base [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Object Instance<71c539b7-f142-4762-8566-4c11babae575> lazy-loaded attributes: resources,numa_topology {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:37:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:37:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:37:21 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:37:21 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:37:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-2dc51286-795d-4dae-9873-0c4230a12f07 req-ed5399f8-cba7-4829-bc0d-d70c66d1eff5 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received event network-changed-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:37:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-2dc51286-795d-4dae-9873-0c4230a12f07 req-ed5399f8-cba7-4829-bc0d-d70c66d1eff5 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Refreshing instance network info cache due to event network-changed-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:37:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2dc51286-795d-4dae-9873-0c4230a12f07 req-ed5399f8-cba7-4829-bc0d-d70c66d1eff5 service nova] Acquiring lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:37:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2dc51286-795d-4dae-9873-0c4230a12f07 req-ed5399f8-cba7-4829-bc0d-d70c66d1eff5 service nova] Acquired lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:37:21 user nova-compute[73917]: DEBUG nova.network.neutron [req-2dc51286-795d-4dae-9873-0c4230a12f07 req-ed5399f8-cba7-4829-bc0d-d70c66d1eff5 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Refreshing network info cache for port 7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:37:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:37:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.613s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:37:21 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:37:21 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:37:21 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8514MB free_disk=25.095867156982422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:37:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:37:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:37:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-25869978-a8c4-4ee5-a3a9-64edf8990dbc tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "71c539b7-f142-4762-8566-4c11babae575" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.987s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:37:21 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 5c350c27-2506-419d-a54f-da4cee2b4ebc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:37:21 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 298fb1d1-b2b3-4809-9690-12f531a4ff10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:37:21 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:37:21 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:37:21 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:37:21 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:37:21 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:37:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:37:22 user nova-compute[73917]: DEBUG nova.network.neutron [req-2dc51286-795d-4dae-9873-0c4230a12f07 req-ed5399f8-cba7-4829-bc0d-d70c66d1eff5 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Updated VIF entry in instance network info cache for port 7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:37:22 user nova-compute[73917]: DEBUG nova.network.neutron [req-2dc51286-795d-4dae-9873-0c4230a12f07 req-ed5399f8-cba7-4829-bc0d-d70c66d1eff5 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Updating instance_info_cache with network_info: [{"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": null, "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:37:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-2dc51286-795d-4dae-9873-0c4230a12f07 req-ed5399f8-cba7-4829-bc0d-d70c66d1eff5 service nova] Releasing lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:37:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:24 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:37:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:37:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:37:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "5c350c27-2506-419d-a54f-da4cee2b4ebc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:37:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:37:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:37:25 user nova-compute[73917]: INFO nova.compute.manager [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Terminating instance
Aug 26 19:37:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:37:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-ee50e971-140a-49f2-97e6-bcb046907b4a req-2f1412dd-0bee-48a5-9d81-a5ee10d54a00 service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Received event network-vif-unplugged-0d3046e2-38a9-4900-bd32-4b9041bcd8f0 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:37:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ee50e971-140a-49f2-97e6-bcb046907b4a req-2f1412dd-0bee-48a5-9d81-a5ee10d54a00 service nova] Acquiring lock "5c350c27-2506-419d-a54f-da4cee2b4ebc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:37:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ee50e971-140a-49f2-97e6-bcb046907b4a req-2f1412dd-0bee-48a5-9d81-a5ee10d54a00 service nova] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:37:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ee50e971-140a-49f2-97e6-bcb046907b4a req-2f1412dd-0bee-48a5-9d81-a5ee10d54a00 service nova] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:37:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-ee50e971-140a-49f2-97e6-bcb046907b4a req-2f1412dd-0bee-48a5-9d81-a5ee10d54a00 service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] No waiting events found dispatching network-vif-unplugged-0d3046e2-38a9-4900-bd32-4b9041bcd8f0 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:37:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-ee50e971-140a-49f2-97e6-bcb046907b4a req-2f1412dd-0bee-48a5-9d81-a5ee10d54a00 service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Received event network-vif-unplugged-0d3046e2-38a9-4900-bd32-4b9041bcd8f0 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:37:26 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Instance destroyed successfully.
Aug 26 19:37:26 user nova-compute[73917]: DEBUG nova.objects.instance [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lazy-loading 'resources' on Instance uuid 5c350c27-2506-419d-a54f-da4cee2b4ebc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:37:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-355744839',display_name='tempest-TestServerVolumeAttachmentScenario-server-355744839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-355744839',id=44,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBLYRqR3EC/9IHOi3XqBWpnZ+sA7Y4gDEUFod8VwUNg4aAaAS0Il0bMkIX1M0EiHnCLWU7D9U6hVhUsZWAWs7nV550r1r8EqiPZqAw2vt0XK3ai4YredBFThqkgkibkWw==',key_name='tempest-keypair-2127082084',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:33:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f304ce651b5242efa39d1f348662fb84',ramdisk_id='',reservation_id='r-4td42a7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-22819724',owner_user_name='tempest-TestServerVolumeAttachmentScenario-22819724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:33:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13f8e1284f14ebfa52d965681261aff',uuid=5c350c27-2506-419d-a54f-da4cee2b4ebc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "address": "fa:16:3e:ba:d3:78", "network": {"id": "e5ca5d7a-a164-4883-8a3e-5a189fecbcf2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-925027545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f304ce651b5242efa39d1f348662fb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3046e2-38", "ovs_interfaceid": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:37:26 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Converting VIF {"id": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "address": "fa:16:3e:ba:d3:78", "network": {"id": "e5ca5d7a-a164-4883-8a3e-5a189fecbcf2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-925027545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f304ce651b5242efa39d1f348662fb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3046e2-38", "ovs_interfaceid": "0d3046e2-38a9-4900-bd32-4b9041bcd8f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:37:26 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:d3:78,bridge_name='br-int',has_traffic_filtering=True,id=0d3046e2-38a9-4900-bd32-4b9041bcd8f0,network=Network(e5ca5d7a-a164-4883-8a3e-5a189fecbcf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3046e2-38') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:37:26 user nova-compute[73917]: DEBUG os_vif [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:d3:78,bridge_name='br-int',has_traffic_filtering=True,id=0d3046e2-38a9-4900-bd32-4b9041bcd8f0,network=Network(e5ca5d7a-a164-4883-8a3e-5a189fecbcf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3046e2-38') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:37:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d3046e2-38, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:37:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:37:26 user nova-compute[73917]: INFO os_vif [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:d3:78,bridge_name='br-int',has_traffic_filtering=True,id=0d3046e2-38a9-4900-bd32-4b9041bcd8f0,network=Network(e5ca5d7a-a164-4883-8a3e-5a189fecbcf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3046e2-38')
Aug 26 19:37:26 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Deleting instance files /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc_del
Aug 26 19:37:26 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Deletion of /opt/stack/data/nova/instances/5c350c27-2506-419d-a54f-da4cee2b4ebc_del complete
Aug 26 19:37:26 user nova-compute[73917]: INFO nova.compute.manager [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 26 19:37:26 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:37:26 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:37:26 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:37:27 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:37:27 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Took 0.94 seconds to deallocate network for instance.
Aug 26 19:37:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-02e6fce1-b8ee-435d-a716-6c29443e59d9 req-f79f5ce6-c8f4-45b5-ab02-90053d9e468b service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Received event network-vif-deleted-0d3046e2-38a9-4900-bd32-4b9041bcd8f0 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:37:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:37:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:37:27 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:37:27 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:37:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:37:27 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Deleted allocations for instance 5c350c27-2506-419d-a54f-da4cee2b4ebc
Aug 26 19:37:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1f806e2b-41f0-46e9-8888-16eace964ce7 tempest-TestServerVolumeAttachmentScenario-22819724 tempest-TestServerVolumeAttachmentScenario-22819724-project-member] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.146s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:37:28 user nova-compute[73917]: DEBUG nova.compute.manager [req-efb9d0a1-a629-4f57-baa7-126f21545d7a req-5e78489d-645b-4d6b-8a83-35e14a7d8e74 service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Received event network-vif-plugged-0d3046e2-38a9-4900-bd32-4b9041bcd8f0 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:37:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-efb9d0a1-a629-4f57-baa7-126f21545d7a req-5e78489d-645b-4d6b-8a83-35e14a7d8e74 service nova] Acquiring lock "5c350c27-2506-419d-a54f-da4cee2b4ebc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:37:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-efb9d0a1-a629-4f57-baa7-126f21545d7a req-5e78489d-645b-4d6b-8a83-35e14a7d8e74 service nova] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:37:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-efb9d0a1-a629-4f57-baa7-126f21545d7a req-5e78489d-645b-4d6b-8a83-35e14a7d8e74 service nova] Lock "5c350c27-2506-419d-a54f-da4cee2b4ebc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:37:28 user nova-compute[73917]: DEBUG nova.compute.manager [req-efb9d0a1-a629-4f57-baa7-126f21545d7a req-5e78489d-645b-4d6b-8a83-35e14a7d8e74 service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] No waiting events found dispatching network-vif-plugged-0d3046e2-38a9-4900-bd32-4b9041bcd8f0 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:37:28 user nova-compute[73917]: WARNING nova.compute.manager [req-efb9d0a1-a629-4f57-baa7-126f21545d7a req-5e78489d-645b-4d6b-8a83-35e14a7d8e74 service nova] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Received unexpected event network-vif-plugged-0d3046e2-38a9-4900-bd32-4b9041bcd8f0 for instance with vm_state deleted and task_state None.
Aug 26 19:37:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:33 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693078638.4499335, 71c539b7-f142-4762-8566-4c11babae575 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:37:33 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 71c539b7-f142-4762-8566-4c11babae575] VM Stopped (Lifecycle Event)
Aug 26 19:37:33 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b7a1939d-ac90-43d4-b980-afbd04367451 None None] [instance: 71c539b7-f142-4762-8566-4c11babae575] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:37:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:41 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693078646.4129264, 5c350c27-2506-419d-a54f-da4cee2b4ebc => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:37:41 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] VM Stopped (Lifecycle Event)
Aug 26 19:37:41 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ca080c1a-e813-4dcc-8b7f-2327e6ac4cf0 None None] [instance: 5c350c27-2506-419d-a54f-da4cee2b4ebc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:37:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:37:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:37:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:37:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:37:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:37:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "298fb1d1-b2b3-4809-9690-12f531a4ff10" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG nova.objects.instance [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lazy-loading 'flavor' on Instance uuid 298fb1d1-b2b3-4809-9690-12f531a4ff10 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "298fb1d1-b2b3-4809-9690-12f531a4ff10" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:38:02 user nova-compute[73917]: INFO nova.compute.manager [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Attaching volume 5ddfef62-83cb-4009-8664-5f9559b06794 to /dev/vdb
Aug 26 19:38:02 user nova-compute[73917]: DEBUG os_brick.utils [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1fd208-5b40-4dfa-b494-343797238303]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c120222-1b57-4493-a3fa-c01e7c020a2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f62cc4a-6e5c-40d6-9ccf-77777154ee0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de118d0-2340-4374-9a58-fd142680256d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:38:02 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:38:02 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa1b39c-edd1-4de7-99e1-136398f13512]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG os_brick.utils [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:38:02 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Updating existing volume attachment record: 3682b3c3-5851-4c1b-98f4-2540e435e3ef {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:38:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:38:11 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:38:11 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:38:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:14 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:38:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:38:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:38:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:38:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:38:14 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:38:14 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid 298fb1d1-b2b3-4809-9690-12f531a4ff10 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:38:14 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Updating instance_info_cache with network_info: [{"id": "4884888d-f202-47b6-be09-0e0cca7704e2", "address": "fa:16:3e:2f:df:54", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4884888d-f2", "ovs_interfaceid": "4884888d-f202-47b6-be09-0e0cca7704e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:38:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:38:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:38:16 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:38:16 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:38:16 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:38:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:19 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hPrzdmyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:38:20 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:38:20 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:38:20 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb00006-f3b3-4761-a31d-cf2fd2b5d42b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:38:20 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8897563c-d007-4936-82da-f9aa75659174]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794] added
Aug 26 19:38:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77236db-a32d-4002-b159-856abacfdbbf]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b5d2c9-98fd-4e5f-9abe-1b1d6b2a829f]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hPrzdmyi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hPrzdmyi" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c12aab-c135-4356-a9e5-6659e15bda8f]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hPrzdmyi'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1545e5c0-9e6c-4179-b3d6-22293f4f22cc]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4231c62-aa98-4ed5-acb6-2f17aa208c29]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 19:38:20 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 19:38:20 user nova-compute[73917]:  {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:38:20 user nova-compute[73917]: WARNING os_brick.initiator.connectors.iscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 19:38:20 user nova-compute[73917]: 
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8862ef-0aba-44b2-a9e0-cf99a6b2b1cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794, portal: 172.16.0.220,3260]
Aug 26 19:38:20 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794, portal: 172.16.0.220,3260] successful.
Aug 26 19:38:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b38fda-c25b-4eae-ac22-9e0c8d6cd2ed]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebe9ff9-0ea5-4b0c-a485-ba77f5180e51]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 (non-flash)
Aug 26 19:38:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 (non-flash)
Aug 26 19:38:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5910fa18-86ca-4d32-9ee6-5530ddd29b92]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:38:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:38:21 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:38:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:38:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:38:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:38:21 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:38:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:38:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:38:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:38:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hPrzdmyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.600s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] <== connect_volume: return (1601ms) {'type': 'block', 'scsi_wwn': '26163663939323964', 'path': '/dev/sdb'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163663939323964', 'path': '/dev/sdb'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:38:22 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:38:22 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:38:22 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8599MB free_disk=25.112869262695312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG nova.objects.instance [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lazy-loading 'flavor' on Instance uuid 298fb1d1-b2b3-4809-9690-12f531a4ff10 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 19:38:22 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:38:22 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 19:38:22 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:38:22 user nova-compute[73917]:   <serial>5ddfef62-83cb-4009-8664-5f9559b06794</serial>
Aug 26 19:38:22 user nova-compute[73917]: </disk>
Aug 26 19:38:22 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 298fb1d1-b2b3-4809-9690-12f531a4ff10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing inventories for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating ProviderTree inventory for provider d90ad23a-e063-4f0d-8341-c34e0141d16a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating inventory in ProviderTree for provider d90ad23a-e063-4f0d-8341-c34e0141d16a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing aggregate associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, aggregates: None {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing trait associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73917) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] No VIF found with MAC fa:16:3e:2f:df:54, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:38:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-9bd285fa-688c-4941-9416-60a21aa3a7df tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.621s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:38:23 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:38:23 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:38:25 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:38:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 19:38:25 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] There are 0 instances to clean {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 19:38:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-4605dfa1-17d8-441d-8d08-90fd5e9e0bdc req-ac0e3ea5-3b80-4491-b5ff-2676dfcd0360 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received event network-changed-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:38:26 user nova-compute[73917]: DEBUG nova.compute.manager [req-4605dfa1-17d8-441d-8d08-90fd5e9e0bdc req-ac0e3ea5-3b80-4491-b5ff-2676dfcd0360 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Refreshing instance network info cache due to event network-changed-4884888d-f202-47b6-be09-0e0cca7704e2. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:38:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4605dfa1-17d8-441d-8d08-90fd5e9e0bdc req-ac0e3ea5-3b80-4491-b5ff-2676dfcd0360 service nova] Acquiring lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:38:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4605dfa1-17d8-441d-8d08-90fd5e9e0bdc req-ac0e3ea5-3b80-4491-b5ff-2676dfcd0360 service nova] Acquired lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:38:26 user nova-compute[73917]: DEBUG nova.network.neutron [req-4605dfa1-17d8-441d-8d08-90fd5e9e0bdc req-ac0e3ea5-3b80-4491-b5ff-2676dfcd0360 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Refreshing network info cache for port 4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:38:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:38:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:38:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:38:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:38:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:26 user nova-compute[73917]: DEBUG nova.network.neutron [req-4605dfa1-17d8-441d-8d08-90fd5e9e0bdc req-ac0e3ea5-3b80-4491-b5ff-2676dfcd0360 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Updated VIF entry in instance network info cache for port 4884888d-f202-47b6-be09-0e0cca7704e2. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:38:26 user nova-compute[73917]: DEBUG nova.network.neutron [req-4605dfa1-17d8-441d-8d08-90fd5e9e0bdc req-ac0e3ea5-3b80-4491-b5ff-2676dfcd0360 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Updating instance_info_cache with network_info: [{"id": "4884888d-f202-47b6-be09-0e0cca7704e2", "address": "fa:16:3e:2f:df:54", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4884888d-f2", "ovs_interfaceid": "4884888d-f202-47b6-be09-0e0cca7704e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:38:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4605dfa1-17d8-441d-8d08-90fd5e9e0bdc req-ac0e3ea5-3b80-4491-b5ff-2676dfcd0360 service nova] Releasing lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:38:28 user nova-compute[73917]: DEBUG nova.compute.manager [req-6d58dd1e-1a5e-49fc-a32e-0a0717518411 req-390434ab-468a-490a-ac85-6d74dc4bd26f service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received event network-changed-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:38:28 user nova-compute[73917]: DEBUG nova.compute.manager [req-6d58dd1e-1a5e-49fc-a32e-0a0717518411 req-390434ab-468a-490a-ac85-6d74dc4bd26f service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Refreshing instance network info cache due to event network-changed-4884888d-f202-47b6-be09-0e0cca7704e2. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:38:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d58dd1e-1a5e-49fc-a32e-0a0717518411 req-390434ab-468a-490a-ac85-6d74dc4bd26f service nova] Acquiring lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:38:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d58dd1e-1a5e-49fc-a32e-0a0717518411 req-390434ab-468a-490a-ac85-6d74dc4bd26f service nova] Acquired lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:38:28 user nova-compute[73917]: DEBUG nova.network.neutron [req-6d58dd1e-1a5e-49fc-a32e-0a0717518411 req-390434ab-468a-490a-ac85-6d74dc4bd26f service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Refreshing network info cache for port 4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:38:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8cdcd082-da2f-4f13-a30b-ff6c54ee9bb4 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "298fb1d1-b2b3-4809-9690-12f531a4ff10" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:38:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8cdcd082-da2f-4f13-a30b-ff6c54ee9bb4 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:38:28 user nova-compute[73917]: INFO nova.compute.manager [None req-8cdcd082-da2f-4f13-a30b-ff6c54ee9bb4 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Rebooting instance
Aug 26 19:38:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8cdcd082-da2f-4f13-a30b-ff6c54ee9bb4 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:38:28 user nova-compute[73917]: DEBUG nova.network.neutron [req-6d58dd1e-1a5e-49fc-a32e-0a0717518411 req-390434ab-468a-490a-ac85-6d74dc4bd26f service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Updated VIF entry in instance network info cache for port 4884888d-f202-47b6-be09-0e0cca7704e2. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:38:28 user nova-compute[73917]: DEBUG nova.network.neutron [req-6d58dd1e-1a5e-49fc-a32e-0a0717518411 req-390434ab-468a-490a-ac85-6d74dc4bd26f service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Updating instance_info_cache with network_info: [{"id": "4884888d-f202-47b6-be09-0e0cca7704e2", "address": "fa:16:3e:2f:df:54", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4884888d-f2", "ovs_interfaceid": "4884888d-f202-47b6-be09-0e0cca7704e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:38:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6d58dd1e-1a5e-49fc-a32e-0a0717518411 req-390434ab-468a-490a-ac85-6d74dc4bd26f service nova] Releasing lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:38:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8cdcd082-da2f-4f13-a30b-ff6c54ee9bb4 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquired lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:38:28 user nova-compute[73917]: DEBUG nova.network.neutron [None req-8cdcd082-da2f-4f13-a30b-ff6c54ee9bb4 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:38:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:29 user nova-compute[73917]: DEBUG nova.network.neutron [None req-8cdcd082-da2f-4f13-a30b-ff6c54ee9bb4 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Updating instance_info_cache with network_info: [{"id": "4884888d-f202-47b6-be09-0e0cca7704e2", "address": "fa:16:3e:2f:df:54", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4884888d-f2", "ovs_interfaceid": "4884888d-f202-47b6-be09-0e0cca7704e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:38:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8cdcd082-da2f-4f13-a30b-ff6c54ee9bb4 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Releasing lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:38:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-8cdcd082-da2f-4f13-a30b-ff6c54ee9bb4 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:38:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-c188d411-bd3c-45f3-a791-83b84cb3599c req-7da9e135-992f-4feb-8c10-549e7db5d108 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received event network-vif-unplugged-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:38:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c188d411-bd3c-45f3-a791-83b84cb3599c req-7da9e135-992f-4feb-8c10-549e7db5d108 service nova] Acquiring lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:38:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c188d411-bd3c-45f3-a791-83b84cb3599c req-7da9e135-992f-4feb-8c10-549e7db5d108 service nova] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:38:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c188d411-bd3c-45f3-a791-83b84cb3599c req-7da9e135-992f-4feb-8c10-549e7db5d108 service nova] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:38:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-c188d411-bd3c-45f3-a791-83b84cb3599c req-7da9e135-992f-4feb-8c10-549e7db5d108 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] No waiting events found dispatching network-vif-unplugged-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:38:31 user nova-compute[73917]: WARNING nova.compute.manager [req-c188d411-bd3c-45f3-a791-83b84cb3599c req-7da9e135-992f-4feb-8c10-549e7db5d108 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received unexpected event network-vif-unplugged-4884888d-f202-47b6-be09-0e0cca7704e2 for instance with vm_state active and task_state reboot_started.
Aug 26 19:38:32 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-8cdcd082-da2f-4f13-a30b-ff6c54ee9bb4 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Instance shutdown successfully.
Aug 26 19:38:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-ae119917-f859-4533-b11f-84ff5dbe6a1d req-f0c6eeee-1349-4f00-9c93-d343dfc86e77 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received event network-vif-plugged-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:38:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ae119917-f859-4533-b11f-84ff5dbe6a1d req-f0c6eeee-1349-4f00-9c93-d343dfc86e77 service nova] Acquiring lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:38:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ae119917-f859-4533-b11f-84ff5dbe6a1d req-f0c6eeee-1349-4f00-9c93-d343dfc86e77 service nova] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:38:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ae119917-f859-4533-b11f-84ff5dbe6a1d req-f0c6eeee-1349-4f00-9c93-d343dfc86e77 service nova] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:38:34 user nova-compute[73917]: DEBUG nova.compute.manager [req-ae119917-f859-4533-b11f-84ff5dbe6a1d req-f0c6eeee-1349-4f00-9c93-d343dfc86e77 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] No waiting events found dispatching network-vif-plugged-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:38:34 user nova-compute[73917]: WARNING nova.compute.manager [req-ae119917-f859-4533-b11f-84ff5dbe6a1d req-f0c6eeee-1349-4f00-9c93-d343dfc86e77 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received unexpected event network-vif-plugged-4884888d-f202-47b6-be09-0e0cca7704e2 for instance with vm_state active and task_state reboot_started.
Aug 26 19:38:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-829674d3-f541-486f-a204-38231c409266 req-77784a2e-2e77-4db3-ac81-d9a67e0b6f01 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received event network-vif-plugged-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:38:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-829674d3-f541-486f-a204-38231c409266 req-77784a2e-2e77-4db3-ac81-d9a67e0b6f01 service nova] Acquiring lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:38:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-829674d3-f541-486f-a204-38231c409266 req-77784a2e-2e77-4db3-ac81-d9a67e0b6f01 service nova] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:38:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-829674d3-f541-486f-a204-38231c409266 req-77784a2e-2e77-4db3-ac81-d9a67e0b6f01 service nova] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:38:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-829674d3-f541-486f-a204-38231c409266 req-77784a2e-2e77-4db3-ac81-d9a67e0b6f01 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] No waiting events found dispatching network-vif-plugged-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:38:36 user nova-compute[73917]: WARNING nova.compute.manager [req-829674d3-f541-486f-a204-38231c409266 req-77784a2e-2e77-4db3-ac81-d9a67e0b6f01 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received unexpected event network-vif-plugged-4884888d-f202-47b6-be09-0e0cca7704e2 for instance with vm_state active and task_state reboot_started.
Aug 26 19:38:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-829674d3-f541-486f-a204-38231c409266 req-77784a2e-2e77-4db3-ac81-d9a67e0b6f01 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received event network-vif-plugged-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:38:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-829674d3-f541-486f-a204-38231c409266 req-77784a2e-2e77-4db3-ac81-d9a67e0b6f01 service nova] Acquiring lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:38:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-829674d3-f541-486f-a204-38231c409266 req-77784a2e-2e77-4db3-ac81-d9a67e0b6f01 service nova] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:38:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-829674d3-f541-486f-a204-38231c409266 req-77784a2e-2e77-4db3-ac81-d9a67e0b6f01 service nova] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:38:36 user nova-compute[73917]: DEBUG nova.compute.manager [req-829674d3-f541-486f-a204-38231c409266 req-77784a2e-2e77-4db3-ac81-d9a67e0b6f01 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] No waiting events found dispatching network-vif-plugged-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:38:36 user nova-compute[73917]: WARNING nova.compute.manager [req-829674d3-f541-486f-a204-38231c409266 req-77784a2e-2e77-4db3-ac81-d9a67e0b6f01 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received unexpected event network-vif-plugged-4884888d-f202-47b6-be09-0e0cca7704e2 for instance with vm_state active and task_state reboot_started.
Aug 26 19:38:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Removed pending event for 298fb1d1-b2b3-4809-9690-12f531a4ff10 due to event {{(pid=73917) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 19:38:36 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078716.1808248, 298fb1d1-b2b3-4809-9690-12f531a4ff10 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:38:36 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] VM Resumed (Lifecycle Event)
Aug 26 19:38:36 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Instance running successfully.
Aug 26 19:38:36 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-8cdcd082-da2f-4f13-a30b-ff6c54ee9bb4 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Instance soft rebooted successfully.
Aug 26 19:38:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-8cdcd082-da2f-4f13-a30b-ff6c54ee9bb4 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:38:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:38:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:38:36 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 26 19:38:36 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078716.1823611, 298fb1d1-b2b3-4809-9690-12f531a4ff10 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:38:36 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] VM Started (Lifecycle Event)
Aug 26 19:38:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-8cdcd082-da2f-4f13-a30b-ff6c54ee9bb4 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.396s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:38:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:38:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:38:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:38:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquiring lock "71c539b7-f142-4762-8566-4c11babae575" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "71c539b7-f142-4762-8566-4c11babae575" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:39:09 user nova-compute[73917]: INFO nova.compute.manager [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Unshelving
Aug 26 19:39:09 user nova-compute[73917]: INFO nova.virt.block_device [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Booting with volume c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 at /dev/vda
Aug 26 19:39:09 user nova-compute[73917]: DEBUG os_brick.utils [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[74476522-e600-4396-a470-31fdb13f48dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3207d19-e264-46e0-910f-253de920ade1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89f8e0a-6bb0-4061-9eff-d191376d4676]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11bd546-c2ea-47a4-b59b-52aa90286f97]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:39:09 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:39:09 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bcc607-5a24-467a-959c-635ef5001673]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG os_brick.utils [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:39:09 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Updating existing volume attachment record: 7e66d9ef-568a-4f93-9067-5eaf56c1181e {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:39:11 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:39:11 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:39:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:14 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:39:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:39:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:39:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:39:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:39:14 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:39:14 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid 298fb1d1-b2b3-4809-9690-12f531a4ff10 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:39:14 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Updating instance_info_cache with network_info: [{"id": "4884888d-f202-47b6-be09-0e0cca7704e2", "address": "fa:16:3e:2f:df:54", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4884888d-f2", "ovs_interfaceid": "4884888d-f202-47b6-be09-0e0cca7704e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:39:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:39:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:39:15 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:39:16 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:39:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:39:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:39:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:39:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:39:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "e783bc58-74b8-453f-be05-08f0be586a79" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:39:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "e783bc58-74b8-453f-be05-08f0be586a79" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:39:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:39:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:39:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:39:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:39:16 user nova-compute[73917]: INFO nova.compute.claims [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Claim successful on node user
Aug 26 19:39:17 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:39:17 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:39:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:39:17 user nova-compute[73917]: DEBUG nova.compute.manager [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:39:17 user nova-compute[73917]: DEBUG nova.compute.manager [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:39:17 user nova-compute[73917]: DEBUG nova.network.neutron [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:39:17 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:39:17 user nova-compute[73917]: DEBUG nova.compute.manager [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:39:17 user nova-compute[73917]: INFO nova.virt.block_device [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Booting with volume snapshot 06df16e1-d44b-4c8c-b6e4-378514003734 at /dev/vda
Aug 26 19:39:17 user nova-compute[73917]: DEBUG nova.policy [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed6fbe4e41ef4849934362d43ef97754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6263f314fc43e8aa7a9e0b23f26162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:39:18 user nova-compute[73917]: DEBUG nova.network.neutron [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Successfully created port: 74f35329-f0f6-4294-854f-fd62597cef90 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:39:18 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:39:18 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:39:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:19 user nova-compute[73917]: DEBUG nova.network.neutron [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Successfully updated port: 74f35329-f0f6-4294-854f-fd62597cef90 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:39:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "refresh_cache-e783bc58-74b8-453f-be05-08f0be586a79" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:39:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquired lock "refresh_cache-e783bc58-74b8-453f-be05-08f0be586a79" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:39:19 user nova-compute[73917]: DEBUG nova.network.neutron [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:39:19 user nova-compute[73917]: DEBUG nova.network.neutron [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:39:19 user nova-compute[73917]: DEBUG nova.compute.manager [req-9b62ab53-acb1-4f45-aeea-95a912f285c6 req-c2f963e4-8a03-4212-a6c7-3d3658b39bbf service nova] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Received event network-changed-74f35329-f0f6-4294-854f-fd62597cef90 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:39:19 user nova-compute[73917]: DEBUG nova.compute.manager [req-9b62ab53-acb1-4f45-aeea-95a912f285c6 req-c2f963e4-8a03-4212-a6c7-3d3658b39bbf service nova] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Refreshing instance network info cache due to event network-changed-74f35329-f0f6-4294-854f-fd62597cef90. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:39:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9b62ab53-acb1-4f45-aeea-95a912f285c6 req-c2f963e4-8a03-4212-a6c7-3d3658b39bbf service nova] Acquiring lock "refresh_cache-e783bc58-74b8-453f-be05-08f0be586a79" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:39:20 user nova-compute[73917]: DEBUG nova.network.neutron [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Updating instance_info_cache with network_info: [{"id": "74f35329-f0f6-4294-854f-fd62597cef90", "address": "fa:16:3e:51:90:eb", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f35329-f0", "ovs_interfaceid": "74f35329-f0f6-4294-854f-fd62597cef90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:39:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Releasing lock "refresh_cache-e783bc58-74b8-453f-be05-08f0be586a79" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:39:20 user nova-compute[73917]: DEBUG nova.compute.manager [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Instance network_info: |[{"id": "74f35329-f0f6-4294-854f-fd62597cef90", "address": "fa:16:3e:51:90:eb", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f35329-f0", "ovs_interfaceid": "74f35329-f0f6-4294-854f-fd62597cef90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:39:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9b62ab53-acb1-4f45-aeea-95a912f285c6 req-c2f963e4-8a03-4212-a6c7-3d3658b39bbf service nova] Acquired lock "refresh_cache-e783bc58-74b8-453f-be05-08f0be586a79" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:39:20 user nova-compute[73917]: DEBUG nova.network.neutron [req-9b62ab53-acb1-4f45-aeea-95a912f285c6 req-c2f963e4-8a03-4212-a6c7-3d3658b39bbf service nova] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Refreshing network info cache for port 74f35329-f0f6-4294-854f-fd62597cef90 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:39:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:39:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:39:20 user nova-compute[73917]: DEBUG nova.objects.instance [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lazy-loading 'pci_requests' on Instance uuid 71c539b7-f142-4762-8566-4c11babae575 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:39:20 user nova-compute[73917]: DEBUG nova.objects.instance [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lazy-loading 'numa_topology' on Instance uuid 71c539b7-f142-4762-8566-4c11babae575 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:39:20 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:39:20 user nova-compute[73917]: INFO nova.compute.claims [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Claim successful on node user
Aug 26 19:39:20 user nova-compute[73917]: DEBUG nova.network.neutron [req-9b62ab53-acb1-4f45-aeea-95a912f285c6 req-c2f963e4-8a03-4212-a6c7-3d3658b39bbf service nova] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Updated VIF entry in instance network info cache for port 74f35329-f0f6-4294-854f-fd62597cef90. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:39:20 user nova-compute[73917]: DEBUG nova.network.neutron [req-9b62ab53-acb1-4f45-aeea-95a912f285c6 req-c2f963e4-8a03-4212-a6c7-3d3658b39bbf service nova] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Updating instance_info_cache with network_info: [{"id": "74f35329-f0f6-4294-854f-fd62597cef90", "address": "fa:16:3e:51:90:eb", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f35329-f0", "ovs_interfaceid": "74f35329-f0f6-4294-854f-fd62597cef90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:39:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9b62ab53-acb1-4f45-aeea-95a912f285c6 req-c2f963e4-8a03-4212-a6c7-3d3658b39bbf service nova] Releasing lock "refresh_cache-e783bc58-74b8-453f-be05-08f0be586a79" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:39:20 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:39:20 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:39:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:39:20 user nova-compute[73917]: INFO nova.network.neutron [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Updating port 7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 19:39:21 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:39:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquiring lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:39:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquired lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:39:21 user nova-compute[73917]: DEBUG nova.network.neutron [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:39:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-f424a8c9-4980-4d1a-be31-bfec7f5d6533 req-96bffd60-61e2-4627-94ae-405b97773d86 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received event network-changed-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:39:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-f424a8c9-4980-4d1a-be31-bfec7f5d6533 req-96bffd60-61e2-4627-94ae-405b97773d86 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Refreshing instance network info cache due to event network-changed-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:39:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f424a8c9-4980-4d1a-be31-bfec7f5d6533 req-96bffd60-61e2-4627-94ae-405b97773d86 service nova] Acquiring lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.network.neutron [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Updating instance_info_cache with network_info: [{"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Releasing lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:39:22 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Creating image(s)
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Did not create local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Ensure instance console log exists: /opt/stack/data/nova/instances/71c539b7-f142-4762-8566-4c11babae575/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Start _get_guest_xml network_info=[{"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'joznIWdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71c539b7-f142-4762-8566-4c11babae575', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4', 'serial': 'c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '7e66d9ef-568a-4f93-9067-5eaf56c1181e', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f424a8c9-4980-4d1a-be31-bfec7f5d6533 req-96bffd60-61e2-4627-94ae-405b97773d86 service nova] Acquired lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.network.neutron [req-f424a8c9-4980-4d1a-be31-bfec7f5d6533 req-96bffd60-61e2-4627-94ae-405b97773d86 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Refreshing network info cache for port 7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:39:22 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:39:22 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.objects.instance [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lazy-loading 'vcpu_model' on Instance uuid 71c539b7-f142-4762-8566-4c11babae575 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.objects.base [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Object Instance<71c539b7-f142-4762-8566-4c11babae575> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'joznIWdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:39:22 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:39:22 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:39:22 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc46cbc0-e15a-4b3f-b422-b8a04a02e001]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:39:22 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0a27c0-dc0c-4dca-9a8b-b978db7b8b48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4] added
Aug 26 19:39:22 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49cb968-0800-4882-8697-77f4b315efb1]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8346a2ec-b9f7-4b4a-9605-9f22dc4e76a8]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v joznIWdD {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v joznIWdD" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6bbe27-b79d-4317-b88d-22591f163855]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'joznIWdD'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7142e3bf-55ae-4d76-b3db-c86e9dd24e03]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b3a1f2-5f46-473e-b39d-f9b99c1ba21c]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 (non-flash)
Aug 26 19:39:22 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 (non-flash)
Aug 26 19:39:22 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed295213-485e-491d-a25d-637290b35060]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4, portal: 172.16.0.220,3260]
Aug 26 19:39:22 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4, portal: 172.16.0.220,3260] successful.
Aug 26 19:39:22 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[525c5a92-3fc5-4d37-8038-4d5cae6487b0]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e05c1a-f2e4-474b-840b-7974c1cbcea5]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 (non-flash)
Aug 26 19:39:22 user nova-compute[73917]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:39:22 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 (non-flash)
Aug 26 19:39:22 user nova-compute[73917]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:39:22 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20d528e-7e52-470b-ae40-0f8784bae4b3]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'joznIWdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.network.neutron [req-f424a8c9-4980-4d1a-be31-bfec7f5d6533 req-96bffd60-61e2-4627-94ae-405b97773d86 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Updated VIF entry in instance network info cache for port 7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG nova.network.neutron [req-f424a8c9-4980-4d1a-be31-bfec7f5d6533 req-96bffd60-61e2-4627-94ae-405b97773d86 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Updating instance_info_cache with network_info: [{"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:39:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-f424a8c9-4980-4d1a-be31-bfec7f5d6533 req-96bffd60-61e2-4627-94ae-405b97773d86 service nova] Releasing lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG os_brick.utils [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dd926d-0624-4b41-806c-5be0dce93cda]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a9a7dd-1c03-48f1-8c32-9e8469d8bc3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e7d67e-e718-48f1-b935-de3458ffdde8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c77761-190f-45ca-b39f-71cd1e7eb3c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:39:23 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33f0014-ca8e-41d7-aabd-443daa4bcd9c]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG os_brick.utils [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Updating existing volume attachment record: 7bb2131b-a63c-418e-8513-adbb7bb1548c {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26566326564626665', 'path': '/dev/sdc'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566326564626665', 'path': '/dev/sdc'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T19:35:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-763505391',display_name='tempest-TestShelveInstance-server-763505391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-763505391',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-280473212',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='be8fd28f327440e5a107e4b40d8c5aca',ramdisk_id='',reservation_id='r-sjp08okj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1743210450',owner_user_name='tempest-TestShelveInstance-1743210450-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:39:09Z,user_data=None,user_id='ef0552b4cc7c4f4d88ee36f9491bd3aa',uuid=71c539b7-f142-4762-8566-4c11babae575,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Converting VIF {"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44,network=Network(b51c4533-8ad8-4684-9c5b-7c2c64a80f0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc26e8e-d6') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG nova.objects.instance [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lazy-loading 'pci_devices' on Instance uuid 71c539b7-f142-4762-8566-4c11babae575 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG nova.objects.base [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Object Instance<71c539b7-f142-4762-8566-4c11babae575> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=73917) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:39:23 user nova-compute[73917]:   <uuid>71c539b7-f142-4762-8566-4c11babae575</uuid>
Aug 26 19:39:23 user nova-compute[73917]:   <name>instance-0000002d</name>
Aug 26 19:39:23 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:39:23 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:39:23 user nova-compute[73917]:   <metadata>
Aug 26 19:39:23 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:39:23 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:39:23 user nova-compute[73917]:       <nova:name>tempest-TestShelveInstance-server-763505391</nova:name>
Aug 26 19:39:23 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:39:22</nova:creationTime>
Aug 26 19:39:23 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:39:23 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:39:23 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:39:23 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:39:23 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:39:23 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:39:23 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:39:23 user nova-compute[73917]:       <nova:owner>
Aug 26 19:39:23 user nova-compute[73917]:         <nova:user uuid="ef0552b4cc7c4f4d88ee36f9491bd3aa">tempest-TestShelveInstance-1743210450-project-member</nova:user>
Aug 26 19:39:23 user nova-compute[73917]:         <nova:project uuid="be8fd28f327440e5a107e4b40d8c5aca">tempest-TestShelveInstance-1743210450</nova:project>
Aug 26 19:39:23 user nova-compute[73917]:       </nova:owner>
Aug 26 19:39:23 user nova-compute[73917]:       <nova:ports>
Aug 26 19:39:23 user nova-compute[73917]:         <nova:port uuid="7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44">
Aug 26 19:39:23 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 19:39:23 user nova-compute[73917]:         </nova:port>
Aug 26 19:39:23 user nova-compute[73917]:       </nova:ports>
Aug 26 19:39:23 user nova-compute[73917]:     </nova:instance>
Aug 26 19:39:23 user nova-compute[73917]:   </metadata>
Aug 26 19:39:23 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:39:23 user nova-compute[73917]:     <system>
Aug 26 19:39:23 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:39:23 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:39:23 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:39:23 user nova-compute[73917]:       <entry name="serial">71c539b7-f142-4762-8566-4c11babae575</entry>
Aug 26 19:39:23 user nova-compute[73917]:       <entry name="uuid">71c539b7-f142-4762-8566-4c11babae575</entry>
Aug 26 19:39:23 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:39:23 user nova-compute[73917]:     </system>
Aug 26 19:39:23 user nova-compute[73917]:   </sysinfo>
Aug 26 19:39:23 user nova-compute[73917]:   <os>
Aug 26 19:39:23 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:39:23 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:39:23 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:39:23 user nova-compute[73917]:   </os>
Aug 26 19:39:23 user nova-compute[73917]:   <features>
Aug 26 19:39:23 user nova-compute[73917]:     <acpi/>
Aug 26 19:39:23 user nova-compute[73917]:     <apic/>
Aug 26 19:39:23 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:39:23 user nova-compute[73917]:   </features>
Aug 26 19:39:23 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:39:23 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:39:23 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:39:23 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:39:23 user nova-compute[73917]:   </clock>
Aug 26 19:39:23 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:39:23 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:39:23 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:39:23 user nova-compute[73917]:   </cpu>
Aug 26 19:39:23 user nova-compute[73917]:   <devices>
Aug 26 19:39:23 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:39:23 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:39:23 user nova-compute[73917]:       <source dev="/dev/sdc"/>
Aug 26 19:39:23 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:39:23 user nova-compute[73917]:       <serial>c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4</serial>
Aug 26 19:39:23 user nova-compute[73917]:     </disk>
Aug 26 19:39:23 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:39:23 user nova-compute[73917]:       <mac address="fa:16:3e:95:69:f8"/>
Aug 26 19:39:23 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:39:23 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:39:23 user nova-compute[73917]:       <target dev="tap7cc26e8e-d6"/>
Aug 26 19:39:23 user nova-compute[73917]:     </interface>
Aug 26 19:39:23 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:39:23 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/71c539b7-f142-4762-8566-4c11babae575/console.log" append="off"/>
Aug 26 19:39:23 user nova-compute[73917]:     </serial>
Aug 26 19:39:23 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:39:23 user nova-compute[73917]:     <video>
Aug 26 19:39:23 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:39:23 user nova-compute[73917]:     </video>
Aug 26 19:39:23 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:39:23 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:39:23 user nova-compute[73917]:     </rng>
Aug 26 19:39:23 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:39:23 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:39:23 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:39:23 user nova-compute[73917]:     </memballoon>
Aug 26 19:39:23 user nova-compute[73917]:   </devices>
Aug 26 19:39:23 user nova-compute[73917]: </domain>
Aug 26 19:39:23 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T19:35:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-763505391',display_name='tempest-TestShelveInstance-server-763505391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-763505391',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-280473212',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='be8fd28f327440e5a107e4b40d8c5aca',ramdisk_id='',reservation_id='r-sjp08okj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1743210450',owner_user_name='tempest-TestShelveInstance-1743210450-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:39:09Z,user_data=None,user_id='ef0552b4cc7c4f4d88ee36f9491bd3aa',uuid=71c539b7-f142-4762-8566-4c11babae575,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Converting VIF {"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44,network=Network(b51c4533-8ad8-4684-9c5b-7c2c64a80f0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc26e8e-d6') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG os_vif [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44,network=Network(b51c4533-8ad8-4684-9c5b-7c2c64a80f0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc26e8e-d6') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cc26e8e-d6, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7cc26e8e-d6, col_values=(('external_ids', {'iface-id': '7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:69:f8', 'vm-uuid': '71c539b7-f142-4762-8566-4c11babae575'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:23 user nova-compute[73917]: INFO os_vif [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44,network=Network(b51c4533-8ad8-4684-9c5b-7c2c64a80f0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc26e8e-d6')
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] No VIF found with MAC fa:16:3e:95:69:f8, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:23 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:39:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:24 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:39:24 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:39:24 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8582MB free_disk=25.107894897460938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:39:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:39:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:39:24 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 298fb1d1-b2b3-4809-9690-12f531a4ff10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:39:24 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 71c539b7-f142-4762-8566-4c11babae575] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (d90ad23a-e063-4f0d-8341-c34e0141d16a): {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Aug 26 19:39:24 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance e783bc58-74b8-453f-be05-08f0be586a79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:39:24 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:39:24 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:39:24 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:39:24 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:39:24 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:39:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:39:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-22a89dd6-9c7b-4959-b982-01de9d06b0c2 req-94fc133d-4a2a-49d3-bff3-86318d070b87 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received event network-vif-plugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:39:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-22a89dd6-9c7b-4959-b982-01de9d06b0c2 req-94fc133d-4a2a-49d3-bff3-86318d070b87 service nova] Acquiring lock "71c539b7-f142-4762-8566-4c11babae575-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:39:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-22a89dd6-9c7b-4959-b982-01de9d06b0c2 req-94fc133d-4a2a-49d3-bff3-86318d070b87 service nova] Lock "71c539b7-f142-4762-8566-4c11babae575-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:39:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-22a89dd6-9c7b-4959-b982-01de9d06b0c2 req-94fc133d-4a2a-49d3-bff3-86318d070b87 service nova] Lock "71c539b7-f142-4762-8566-4c11babae575-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:39:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-22a89dd6-9c7b-4959-b982-01de9d06b0c2 req-94fc133d-4a2a-49d3-bff3-86318d070b87 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] No waiting events found dispatching network-vif-plugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:39:25 user nova-compute[73917]: WARNING nova.compute.manager [req-22a89dd6-9c7b-4959-b982-01de9d06b0c2 req-94fc133d-4a2a-49d3-bff3-86318d070b87 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received unexpected event network-vif-plugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 19:39:25 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:39:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:27 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078767.230886, 71c539b7-f142-4762-8566-4c11babae575 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:39:27 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 71c539b7-f142-4762-8566-4c11babae575] VM Resumed (Lifecycle Event)
Aug 26 19:39:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-43db90de-29eb-451f-bec3-67dee6542d0c req-a6ac0c4b-c05b-4685-ba13-5da8bfa642fe service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received event network-vif-plugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:39:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-43db90de-29eb-451f-bec3-67dee6542d0c req-a6ac0c4b-c05b-4685-ba13-5da8bfa642fe service nova] Acquiring lock "71c539b7-f142-4762-8566-4c11babae575-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:39:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-43db90de-29eb-451f-bec3-67dee6542d0c req-a6ac0c4b-c05b-4685-ba13-5da8bfa642fe service nova] Lock "71c539b7-f142-4762-8566-4c11babae575-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:39:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-43db90de-29eb-451f-bec3-67dee6542d0c req-a6ac0c4b-c05b-4685-ba13-5da8bfa642fe service nova] Lock "71c539b7-f142-4762-8566-4c11babae575-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:39:27 user nova-compute[73917]: DEBUG nova.compute.manager [req-43db90de-29eb-451f-bec3-67dee6542d0c req-a6ac0c4b-c05b-4685-ba13-5da8bfa642fe service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] No waiting events found dispatching network-vif-plugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:39:27 user nova-compute[73917]: WARNING nova.compute.manager [req-43db90de-29eb-451f-bec3-67dee6542d0c req-a6ac0c4b-c05b-4685-ba13-5da8bfa642fe service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received unexpected event network-vif-plugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 19:39:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:39:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:39:27 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 71c539b7-f142-4762-8566-4c11babae575] Instance spawned successfully.
Aug 26 19:39:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:39:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 71c539b7-f142-4762-8566-4c11babae575] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:39:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 71c539b7-f142-4762-8566-4c11babae575] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:39:27 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 71c539b7-f142-4762-8566-4c11babae575] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:39:27 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078767.2321372, 71c539b7-f142-4762-8566-4c11babae575 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:39:27 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 71c539b7-f142-4762-8566-4c11babae575] VM Started (Lifecycle Event)
Aug 26 19:39:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 71c539b7-f142-4762-8566-4c11babae575] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:39:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 71c539b7-f142-4762-8566-4c11babae575] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:39:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-79a805e6-8e66-4041-a02d-3a84853050ae tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "71c539b7-f142-4762-8566-4c11babae575" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.168s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:39:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:34 user nova-compute[73917]: DEBUG nova.compute.manager [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:39:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:39:34 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Creating image(s)
Aug 26 19:39:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Did not create local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 19:39:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Ensure instance console log exists: /opt/stack/data/nova/instances/e783bc58-74b8-453f-be05-08f0be586a79/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:39:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:39:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:39:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:39:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Start _get_guest_xml network_info=[{"id": "74f35329-f0f6-4294-854f-fd62597cef90", "address": "fa:16:3e:51:90:eb", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f35329-f0", "ovs_interfaceid": "74f35329-f0f6-4294-854f-fd62597cef90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJDkMbfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e783bc58-74b8-453f-be05-08f0be586a79', 'attached_at': '', 'detached_at': '', 'volume_id': '8a06d0ba-533d-4034-9264-c64e41f267c3', 'serial': '8a06d0ba-533d-4034-9264-c64e41f267c3'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '7bb2131b-a63c-418e-8513-adbb7bb1548c', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:39:34 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:39:34 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:39:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJDkMbfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:39:35 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:39:35 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:39:35 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0359b0db-83a0-476e-ab4a-42768eb79208]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:39:35 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1ad110-446f-4e62-8508-d2c568d66693]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3] added
Aug 26 19:39:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[21148de5-479f-4370-8c23-3f73f4affbba]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cc5f46-c294-4e35-824a-e7c994b76cf2]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CJDkMbfh {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CJDkMbfh" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e89c76a-cd26-4080-9fda-f9609e22f902]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CJDkMbfh'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c552d28-ef12-4dda-9dda-831c7be0e967]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc3437d-253b-4db7-a925-76cfefb2f1dd]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20d307f-303d-4703-a49f-eb22482870b5 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 (non-flash)
Aug 26 19:39:35 user nova-compute[73917]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:39:35 user nova-compute[73917]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20d307f-303d-4703-a49f-eb22482870b5 (non-flash)
Aug 26 19:39:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 (non-flash)
Aug 26 19:39:35 user nova-compute[73917]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:39:35 user nova-compute[73917]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20d307f-303d-4703-a49f-eb22482870b5 (non-flash)
Aug 26 19:39:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[015e976d-bc91-46d1-a69e-c074642b85fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3, portal: 172.16.0.220,3260]
Aug 26 19:39:35 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3, portal: 172.16.0.220,3260] successful.
Aug 26 19:39:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d950e44d-639c-4d36-86a4-86b9a0f0bed5]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8558fa-26a2-454f-87e4-e9cae3e5573d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20d307f-303d-4703-a49f-eb22482870b5 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 (non-flash)
Aug 26 19:39:35 user nova-compute[73917]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:39:35 user nova-compute[73917]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20d307f-303d-4703-a49f-eb22482870b5 (non-flash)
Aug 26 19:39:35 user nova-compute[73917]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 (non-flash)
Aug 26 19:39:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 (non-flash)
Aug 26 19:39:35 user nova-compute[73917]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:39:35 user nova-compute[73917]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20d307f-303d-4703-a49f-eb22482870b5 (non-flash)
Aug 26 19:39:35 user nova-compute[73917]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 (non-flash)
Aug 26 19:39:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] HCTL ('36', '-', '-', 0) found on session 57 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57b3b5f-eb8b-4f52-aad5-8ecca60285f6]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Searching for a device in session 57 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:39:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJDkMbfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26662643533313835', 'path': '/dev/sde'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662643533313835', 'path': '/dev/sde'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-562663829',display_name='tempest-TestVolumeBootPattern-server-562663829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-562663829',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a6263f314fc43e8aa7a9e0b23f26162',ramdisk_id='',reservation_id='r-uks3xjtf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-534408973',owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:39:17Z,user_data=None,user_id='ed6fbe4e41ef4849934362d43ef97754',uuid=e783bc58-74b8-453f-be05-08f0be586a79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74f35329-f0f6-4294-854f-fd62597cef90", "address": "fa:16:3e:51:90:eb", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f35329-f0", "ovs_interfaceid": "74f35329-f0f6-4294-854f-fd62597cef90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converting VIF {"id": "74f35329-f0f6-4294-854f-fd62597cef90", "address": "fa:16:3e:51:90:eb", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f35329-f0", "ovs_interfaceid": "74f35329-f0f6-4294-854f-fd62597cef90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:90:eb,bridge_name='br-int',has_traffic_filtering=True,id=74f35329-f0f6-4294-854f-fd62597cef90,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f35329-f0') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG nova.objects.instance [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lazy-loading 'pci_devices' on Instance uuid e783bc58-74b8-453f-be05-08f0be586a79 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:39:36 user nova-compute[73917]:   <uuid>e783bc58-74b8-453f-be05-08f0be586a79</uuid>
Aug 26 19:39:36 user nova-compute[73917]:   <name>instance-0000002f</name>
Aug 26 19:39:36 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:39:36 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:39:36 user nova-compute[73917]:   <metadata>
Aug 26 19:39:36 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:39:36 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:39:36 user nova-compute[73917]:       <nova:name>tempest-TestVolumeBootPattern-server-562663829</nova:name>
Aug 26 19:39:36 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:39:34</nova:creationTime>
Aug 26 19:39:36 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:39:36 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:39:36 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:39:36 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:39:36 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:39:36 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:39:36 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:39:36 user nova-compute[73917]:       <nova:owner>
Aug 26 19:39:36 user nova-compute[73917]:         <nova:user uuid="ed6fbe4e41ef4849934362d43ef97754">tempest-TestVolumeBootPattern-534408973-project-member</nova:user>
Aug 26 19:39:36 user nova-compute[73917]:         <nova:project uuid="7a6263f314fc43e8aa7a9e0b23f26162">tempest-TestVolumeBootPattern-534408973</nova:project>
Aug 26 19:39:36 user nova-compute[73917]:       </nova:owner>
Aug 26 19:39:36 user nova-compute[73917]:       <nova:ports>
Aug 26 19:39:36 user nova-compute[73917]:         <nova:port uuid="74f35329-f0f6-4294-854f-fd62597cef90">
Aug 26 19:39:36 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 19:39:36 user nova-compute[73917]:         </nova:port>
Aug 26 19:39:36 user nova-compute[73917]:       </nova:ports>
Aug 26 19:39:36 user nova-compute[73917]:     </nova:instance>
Aug 26 19:39:36 user nova-compute[73917]:   </metadata>
Aug 26 19:39:36 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:39:36 user nova-compute[73917]:     <system>
Aug 26 19:39:36 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:39:36 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:39:36 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:39:36 user nova-compute[73917]:       <entry name="serial">e783bc58-74b8-453f-be05-08f0be586a79</entry>
Aug 26 19:39:36 user nova-compute[73917]:       <entry name="uuid">e783bc58-74b8-453f-be05-08f0be586a79</entry>
Aug 26 19:39:36 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:39:36 user nova-compute[73917]:     </system>
Aug 26 19:39:36 user nova-compute[73917]:   </sysinfo>
Aug 26 19:39:36 user nova-compute[73917]:   <os>
Aug 26 19:39:36 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:39:36 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:39:36 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:39:36 user nova-compute[73917]:   </os>
Aug 26 19:39:36 user nova-compute[73917]:   <features>
Aug 26 19:39:36 user nova-compute[73917]:     <acpi/>
Aug 26 19:39:36 user nova-compute[73917]:     <apic/>
Aug 26 19:39:36 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:39:36 user nova-compute[73917]:   </features>
Aug 26 19:39:36 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:39:36 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:39:36 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:39:36 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:39:36 user nova-compute[73917]:   </clock>
Aug 26 19:39:36 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:39:36 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:39:36 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:39:36 user nova-compute[73917]:   </cpu>
Aug 26 19:39:36 user nova-compute[73917]:   <devices>
Aug 26 19:39:36 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:39:36 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:39:36 user nova-compute[73917]:       <source dev="/dev/sde"/>
Aug 26 19:39:36 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:39:36 user nova-compute[73917]:       <serial>8a06d0ba-533d-4034-9264-c64e41f267c3</serial>
Aug 26 19:39:36 user nova-compute[73917]:     </disk>
Aug 26 19:39:36 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:39:36 user nova-compute[73917]:       <mac address="fa:16:3e:51:90:eb"/>
Aug 26 19:39:36 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:39:36 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:39:36 user nova-compute[73917]:       <target dev="tap74f35329-f0"/>
Aug 26 19:39:36 user nova-compute[73917]:     </interface>
Aug 26 19:39:36 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:39:36 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/e783bc58-74b8-453f-be05-08f0be586a79/console.log" append="off"/>
Aug 26 19:39:36 user nova-compute[73917]:     </serial>
Aug 26 19:39:36 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:39:36 user nova-compute[73917]:     <video>
Aug 26 19:39:36 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:39:36 user nova-compute[73917]:     </video>
Aug 26 19:39:36 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:39:36 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:39:36 user nova-compute[73917]:     </rng>
Aug 26 19:39:36 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:39:36 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:39:36 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:39:36 user nova-compute[73917]:     </memballoon>
Aug 26 19:39:36 user nova-compute[73917]:   </devices>
Aug 26 19:39:36 user nova-compute[73917]: </domain>
Aug 26 19:39:36 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-562663829',display_name='tempest-TestVolumeBootPattern-server-562663829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-562663829',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a6263f314fc43e8aa7a9e0b23f26162',ramdisk_id='',reservation_id='r-uks3xjtf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-534408973',owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:39:17Z,user_data=None,user_id='ed6fbe4e41ef4849934362d43ef97754',uuid=e783bc58-74b8-453f-be05-08f0be586a79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74f35329-f0f6-4294-854f-fd62597cef90", "address": "fa:16:3e:51:90:eb", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f35329-f0", "ovs_interfaceid": "74f35329-f0f6-4294-854f-fd62597cef90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converting VIF {"id": "74f35329-f0f6-4294-854f-fd62597cef90", "address": "fa:16:3e:51:90:eb", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f35329-f0", "ovs_interfaceid": "74f35329-f0f6-4294-854f-fd62597cef90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:90:eb,bridge_name='br-int',has_traffic_filtering=True,id=74f35329-f0f6-4294-854f-fd62597cef90,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f35329-f0') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG os_vif [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:90:eb,bridge_name='br-int',has_traffic_filtering=True,id=74f35329-f0f6-4294-854f-fd62597cef90,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f35329-f0') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74f35329-f0, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74f35329-f0, col_values=(('external_ids', {'iface-id': '74f35329-f0f6-4294-854f-fd62597cef90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:90:eb', 'vm-uuid': 'e783bc58-74b8-453f-be05-08f0be586a79'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:36 user nova-compute[73917]: INFO os_vif [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:90:eb,bridge_name='br-int',has_traffic_filtering=True,id=74f35329-f0f6-4294-854f-fd62597cef90,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f35329-f0')
Aug 26 19:39:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:39:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] No VIF found with MAC fa:16:3e:51:90:eb, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:39:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:38 user nova-compute[73917]: DEBUG nova.compute.manager [req-ceed477d-7da3-4d84-989c-a7331c10f046 req-44eb590b-a0b7-4fc8-b781-2eec94b345ab service nova] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Received event network-vif-plugged-74f35329-f0f6-4294-854f-fd62597cef90 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:39:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ceed477d-7da3-4d84-989c-a7331c10f046 req-44eb590b-a0b7-4fc8-b781-2eec94b345ab service nova] Acquiring lock "e783bc58-74b8-453f-be05-08f0be586a79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:39:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ceed477d-7da3-4d84-989c-a7331c10f046 req-44eb590b-a0b7-4fc8-b781-2eec94b345ab service nova] Lock "e783bc58-74b8-453f-be05-08f0be586a79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:39:38 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-ceed477d-7da3-4d84-989c-a7331c10f046 req-44eb590b-a0b7-4fc8-b781-2eec94b345ab service nova] Lock "e783bc58-74b8-453f-be05-08f0be586a79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:39:38 user nova-compute[73917]: DEBUG nova.compute.manager [req-ceed477d-7da3-4d84-989c-a7331c10f046 req-44eb590b-a0b7-4fc8-b781-2eec94b345ab service nova] [instance: e783bc58-74b8-453f-be05-08f0be586a79] No waiting events found dispatching network-vif-plugged-74f35329-f0f6-4294-854f-fd62597cef90 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:39:38 user nova-compute[73917]: WARNING nova.compute.manager [req-ceed477d-7da3-4d84-989c-a7331c10f046 req-44eb590b-a0b7-4fc8-b781-2eec94b345ab service nova] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Received unexpected event network-vif-plugged-74f35329-f0f6-4294-854f-fd62597cef90 for instance with vm_state building and task_state spawning.
Aug 26 19:39:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:39 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078779.8683417, e783bc58-74b8-453f-be05-08f0be586a79 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:39:39 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: e783bc58-74b8-453f-be05-08f0be586a79] VM Resumed (Lifecycle Event)
Aug 26 19:39:39 user nova-compute[73917]: DEBUG nova.compute.manager [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:39:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:39:39 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Instance spawned successfully.
Aug 26 19:39:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:39:39 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:39:39 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:39:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:39:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:39:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:39:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:39:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:39:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:39:39 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: e783bc58-74b8-453f-be05-08f0be586a79] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:39:39 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078779.8710434, e783bc58-74b8-453f-be05-08f0be586a79 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:39:39 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: e783bc58-74b8-453f-be05-08f0be586a79] VM Started (Lifecycle Event)
Aug 26 19:39:39 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:39:39 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:39:39 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: e783bc58-74b8-453f-be05-08f0be586a79] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:39:39 user nova-compute[73917]: INFO nova.compute.manager [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Took 5.01 seconds to spawn the instance on the hypervisor.
Aug 26 19:39:39 user nova-compute[73917]: DEBUG nova.compute.manager [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:39:40 user nova-compute[73917]: INFO nova.compute.manager [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Took 23.17 seconds to build instance.
Aug 26 19:39:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-19d9d2c9-a3d6-4d45-a94d-92251998f1a8 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "e783bc58-74b8-453f-be05-08f0be586a79" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.254s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:39:40 user nova-compute[73917]: DEBUG nova.compute.manager [req-d8763b20-7585-47da-abf2-d5a8507c6cf0 req-9b1c48bf-26be-477c-a73f-7c59480df630 service nova] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Received event network-vif-plugged-74f35329-f0f6-4294-854f-fd62597cef90 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:39:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d8763b20-7585-47da-abf2-d5a8507c6cf0 req-9b1c48bf-26be-477c-a73f-7c59480df630 service nova] Acquiring lock "e783bc58-74b8-453f-be05-08f0be586a79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:39:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d8763b20-7585-47da-abf2-d5a8507c6cf0 req-9b1c48bf-26be-477c-a73f-7c59480df630 service nova] Lock "e783bc58-74b8-453f-be05-08f0be586a79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:39:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d8763b20-7585-47da-abf2-d5a8507c6cf0 req-9b1c48bf-26be-477c-a73f-7c59480df630 service nova] Lock "e783bc58-74b8-453f-be05-08f0be586a79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:39:40 user nova-compute[73917]: DEBUG nova.compute.manager [req-d8763b20-7585-47da-abf2-d5a8507c6cf0 req-9b1c48bf-26be-477c-a73f-7c59480df630 service nova] [instance: e783bc58-74b8-453f-be05-08f0be586a79] No waiting events found dispatching network-vif-plugged-74f35329-f0f6-4294-854f-fd62597cef90 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:39:40 user nova-compute[73917]: WARNING nova.compute.manager [req-d8763b20-7585-47da-abf2-d5a8507c6cf0 req-9b1c48bf-26be-477c-a73f-7c59480df630 service nova] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Received unexpected event network-vif-plugged-74f35329-f0f6-4294-854f-fd62597cef90 for instance with vm_state active and task_state None.
Aug 26 19:39:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:39:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:40:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:40:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:40:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:40:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:40:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:40:13 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:40:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:40:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:40:14 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:40:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:40:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:40:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:40:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:40:14 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:40:14 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid 298fb1d1-b2b3-4809-9690-12f531a4ff10 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:40:14 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Updating instance_info_cache with network_info: [{"id": "4884888d-f202-47b6-be09-0e0cca7704e2", "address": "fa:16:3e:2f:df:54", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4884888d-f2", "ovs_interfaceid": "4884888d-f202-47b6-be09-0e0cca7704e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:40:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:40:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:40:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:40:17 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:40:20 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:40:20 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:40:20 user nova-compute[73917]: DEBUG nova.compute.manager [req-bd31eb91-4a87-4507-b128-65c694e3a508 req-65260b0c-51eb-4ef7-bf18-96055c6d860b service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received event network-changed-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:40:20 user nova-compute[73917]: DEBUG nova.compute.manager [req-bd31eb91-4a87-4507-b128-65c694e3a508 req-65260b0c-51eb-4ef7-bf18-96055c6d860b service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Refreshing instance network info cache due to event network-changed-4884888d-f202-47b6-be09-0e0cca7704e2. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:40:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-bd31eb91-4a87-4507-b128-65c694e3a508 req-65260b0c-51eb-4ef7-bf18-96055c6d860b service nova] Acquiring lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:40:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-bd31eb91-4a87-4507-b128-65c694e3a508 req-65260b0c-51eb-4ef7-bf18-96055c6d860b service nova] Acquired lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:40:20 user nova-compute[73917]: DEBUG nova.network.neutron [req-bd31eb91-4a87-4507-b128-65c694e3a508 req-65260b0c-51eb-4ef7-bf18-96055c6d860b service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Refreshing network info cache for port 4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:40:21 user nova-compute[73917]: DEBUG nova.network.neutron [req-bd31eb91-4a87-4507-b128-65c694e3a508 req-65260b0c-51eb-4ef7-bf18-96055c6d860b service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Updated VIF entry in instance network info cache for port 4884888d-f202-47b6-be09-0e0cca7704e2. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:40:21 user nova-compute[73917]: DEBUG nova.network.neutron [req-bd31eb91-4a87-4507-b128-65c694e3a508 req-65260b0c-51eb-4ef7-bf18-96055c6d860b service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Updating instance_info_cache with network_info: [{"id": "4884888d-f202-47b6-be09-0e0cca7704e2", "address": "fa:16:3e:2f:df:54", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4884888d-f2", "ovs_interfaceid": "4884888d-f202-47b6-be09-0e0cca7704e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:40:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-bd31eb91-4a87-4507-b128-65c694e3a508 req-65260b0c-51eb-4ef7-bf18-96055c6d860b service nova] Releasing lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:40:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:40:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:40:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-197441a4-0ab8-404d-ac76-e46ed93287e4 req-69ca9927-93c1-4b9c-adb3-01616c5602b9 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received event network-changed-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:40:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-197441a4-0ab8-404d-ac76-e46ed93287e4 req-69ca9927-93c1-4b9c-adb3-01616c5602b9 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Refreshing instance network info cache due to event network-changed-4884888d-f202-47b6-be09-0e0cca7704e2. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:40:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-197441a4-0ab8-404d-ac76-e46ed93287e4 req-69ca9927-93c1-4b9c-adb3-01616c5602b9 service nova] Acquiring lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:40:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-197441a4-0ab8-404d-ac76-e46ed93287e4 req-69ca9927-93c1-4b9c-adb3-01616c5602b9 service nova] Acquired lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:40:21 user nova-compute[73917]: DEBUG nova.network.neutron [req-197441a4-0ab8-404d-ac76-e46ed93287e4 req-69ca9927-93c1-4b9c-adb3-01616c5602b9 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Refreshing network info cache for port 4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "298fb1d1-b2b3-4809-9690-12f531a4ff10" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:40:22 user nova-compute[73917]: INFO nova.compute.manager [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Detaching volume 5ddfef62-83cb-4009-8664-5f9559b06794
Aug 26 19:40:22 user nova-compute[73917]: INFO nova.virt.block_device [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Attempting to driver detach volume 5ddfef62-83cb-4009-8664-5f9559b06794 from mountpoint /dev/vdb
Aug 26 19:40:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Attempting to detach device vdb from instance 298fb1d1-b2b3-4809-9690-12f531a4ff10 from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:40:22 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:40:22 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 19:40:22 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:40:22 user nova-compute[73917]:   <serial>5ddfef62-83cb-4009-8664-5f9559b06794</serial>
Aug 26 19:40:22 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:40:22 user nova-compute[73917]: </disk>
Aug 26 19:40:22 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:40:22 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Successfully detached device vdb from instance 298fb1d1-b2b3-4809-9690-12f531a4ff10 from the persistent domain config.
Aug 26 19:40:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 298fb1d1-b2b3-4809-9690-12f531a4ff10 from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 19:40:22 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:40:22 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 19:40:22 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 19:40:22 user nova-compute[73917]:   <serial>5ddfef62-83cb-4009-8664-5f9559b06794</serial>
Aug 26 19:40:22 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 19:40:22 user nova-compute[73917]: </disk>
Aug 26 19:40:22 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG nova.network.neutron [req-197441a4-0ab8-404d-ac76-e46ed93287e4 req-69ca9927-93c1-4b9c-adb3-01616c5602b9 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Updated VIF entry in instance network info cache for port 4884888d-f202-47b6-be09-0e0cca7704e2. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG nova.network.neutron [req-197441a4-0ab8-404d-ac76-e46ed93287e4 req-69ca9927-93c1-4b9c-adb3-01616c5602b9 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Updating instance_info_cache with network_info: [{"id": "4884888d-f202-47b6-be09-0e0cca7704e2", "address": "fa:16:3e:2f:df:54", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4884888d-f2", "ovs_interfaceid": "4884888d-f202-47b6-be09-0e0cca7704e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-197441a4-0ab8-404d-ac76-e46ed93287e4 req-69ca9927-93c1-4b9c-adb3-01616c5602b9 service nova] Releasing lock "refresh_cache-298fb1d1-b2b3-4809-9690-12f531a4ff10" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693078822.5977397, 298fb1d1-b2b3-4809-9690-12f531a4ff10 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 298fb1d1-b2b3-4809-9690-12f531a4ff10 {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 19:40:22 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Successfully detached device vdb from instance 298fb1d1-b2b3-4809-9690-12f531a4ff10 from the live domain config.
Aug 26 19:40:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hPrzdmyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:40:22 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:40:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d12123b-8f1d-45db-90a0-b5ef55a02a62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[52818d61-b472-4cd6-850a-e015924b7a6b]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 (non-flash)
Aug 26 19:40:22 user nova-compute[73917]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:40:22 user nova-compute[73917]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 (non-flash)
Aug 26 19:40:22 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 (non-flash)
Aug 26 19:40:22 user nova-compute[73917]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:40:22 user nova-compute[73917]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 (non-flash)
Aug 26 19:40:22 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b786ae0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794'): ({'sdb'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Removing single pathed devices sdb {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bc3537-872e-48b9-be67-a806fafad580]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad077aaf-c94b-4ec1-8565-229fea98ca8e]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Flushing IO for device /dev/sdb {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d7bb59-f6c6-41c1-857a-3d1274e4464c]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5727ab52-3719-45c1-b6a3-f13adbfc867d]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3aea27-78b5-4dfa-8669-914026483ebd]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[148f7ff8-7f81-4a6b-bc1e-06161a8156fe]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794, portal: 172.16.0.220,3260]
Aug 26 19:40:22 user nova-compute[73917]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794, portal: 172.16.0.220,3260] successful.
Aug 26 19:40:22 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddfef62-83cb-4009-8664-5f9559b06794 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c031bb86-33e7-49cd-80f3-d5cd66fd4ddb]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] <== disconnect_volume: return (276ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:40:22 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:40:23 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:40:23 user nova-compute[73917]: DEBUG nova.objects.instance [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lazy-loading 'flavor' on Instance uuid 298fb1d1-b2b3-4809-9690-12f531a4ff10 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:40:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-bb09db2e-12e2-4238-b0c5-6b381e92728c tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.638s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:40:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:40:25 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:40:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:40:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:40:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:40:25 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:40:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:40:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:40:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:40:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:40:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:40:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:40:26 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:40:26 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:40:26 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8318MB free_disk=25.096969604492188GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:40:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:40:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:40:26 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 298fb1d1-b2b3-4809-9690-12f531a4ff10 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:40:26 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 71c539b7-f142-4762-8566-4c11babae575 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:40:26 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance e783bc58-74b8-453f-be05-08f0be586a79 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:40:26 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:40:26 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:40:26 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:40:26 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:40:26 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:40:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:40:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:40:27 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:40:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:40:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:40:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:40:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:40:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:40:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:40:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:40:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:40:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:40:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:40:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:40:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:40:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:40:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:40:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:40:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:40:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:40:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:40:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:40:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:40:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:40:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:40:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:40:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:40:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:40:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:41:00 user nova-compute[73917]: DEBUG nova.compute.manager [req-318b475d-e258-49c9-940e-17ef8c903c04 req-36c8aef0-5c7c-443e-87bb-92dcaf3496da service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received event network-changed-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:41:00 user nova-compute[73917]: DEBUG nova.compute.manager [req-318b475d-e258-49c9-940e-17ef8c903c04 req-36c8aef0-5c7c-443e-87bb-92dcaf3496da service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Refreshing instance network info cache due to event network-changed-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:41:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-318b475d-e258-49c9-940e-17ef8c903c04 req-36c8aef0-5c7c-443e-87bb-92dcaf3496da service nova] Acquiring lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:41:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-318b475d-e258-49c9-940e-17ef8c903c04 req-36c8aef0-5c7c-443e-87bb-92dcaf3496da service nova] Acquired lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:41:00 user nova-compute[73917]: DEBUG nova.network.neutron [req-318b475d-e258-49c9-940e-17ef8c903c04 req-36c8aef0-5c7c-443e-87bb-92dcaf3496da service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Refreshing network info cache for port 7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:41:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquiring lock "71c539b7-f142-4762-8566-4c11babae575" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:41:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "71c539b7-f142-4762-8566-4c11babae575" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:41:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquiring lock "71c539b7-f142-4762-8566-4c11babae575-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:41:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "71c539b7-f142-4762-8566-4c11babae575-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:41:00 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "71c539b7-f142-4762-8566-4c11babae575-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:41:00 user nova-compute[73917]: INFO nova.compute.manager [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Terminating instance
Aug 26 19:41:00 user nova-compute[73917]: DEBUG nova.compute.manager [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:41:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:00 user nova-compute[73917]: DEBUG nova.network.neutron [req-318b475d-e258-49c9-940e-17ef8c903c04 req-36c8aef0-5c7c-443e-87bb-92dcaf3496da service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Updated VIF entry in instance network info cache for port 7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:41:00 user nova-compute[73917]: DEBUG nova.network.neutron [req-318b475d-e258-49c9-940e-17ef8c903c04 req-36c8aef0-5c7c-443e-87bb-92dcaf3496da service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Updating instance_info_cache with network_info: [{"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-318b475d-e258-49c9-940e-17ef8c903c04 req-36c8aef0-5c7c-443e-87bb-92dcaf3496da service nova] Releasing lock "refresh_cache-71c539b7-f142-4762-8566-4c11babae575" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:41:01 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 71c539b7-f142-4762-8566-4c11babae575] Instance destroyed successfully.
Aug 26 19:41:01 user nova-compute[73917]: DEBUG nova.objects.instance [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lazy-loading 'resources' on Instance uuid 71c539b7-f142-4762-8566-4c11babae575 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T19:35:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-763505391',display_name='tempest-TestShelveInstance-server-763505391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-763505391',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxbkAEeRNNUpdupl0HezplQPbflafoItcKeJ0Ucl0BfkXiH6vy+3IUyX/ALUXHuqugKl6m7l882KSOE6pvTef/tI2FBrQ6NVEM1houUOr21Vgs5eN2qSDUqPQyYkJP8Xg==',key_name='tempest-TestShelveInstance-280473212',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:39:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be8fd28f327440e5a107e4b40d8c5aca',ramdisk_id='',reservation_id='r-sjp08okj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1743210450',owner_user_name='tempest-TestShelveInstance-1743210450-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:39:27Z,user_data=None,user_id='ef0552b4cc7c4f4d88ee36f9491bd3aa',uuid=71c539b7-f142-4762-8566-4c11babae575,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Converting VIF {"id": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "address": "fa:16:3e:95:69:f8", "network": {"id": "b51c4533-8ad8-4684-9c5b-7c2c64a80f0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1261205633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be8fd28f327440e5a107e4b40d8c5aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc26e8e-d6", "ovs_interfaceid": "7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44,network=Network(b51c4533-8ad8-4684-9c5b-7c2c64a80f0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc26e8e-d6') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG os_vif [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44,network=Network(b51c4533-8ad8-4684-9c5b-7c2c64a80f0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc26e8e-d6') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cc26e8e-d6, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:01 user nova-compute[73917]: INFO os_vif [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:69:f8,bridge_name='br-int',has_traffic_filtering=True,id=7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44,network=Network(b51c4533-8ad8-4684-9c5b-7c2c64a80f0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc26e8e-d6')
Aug 26 19:41:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'joznIWdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:41:01 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:41:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[71362780-3d51-4e25-be48-d4aa36491868]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b870d94-dd98-4caf-958a-924023b304da]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:41:01 user nova-compute[73917]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 (non-flash)
Aug 26 19:41:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 (non-flash)
Aug 26 19:41:01 user nova-compute[73917]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 (non-flash)
Aug 26 19:41:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b983d7760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4'): ({'sdc'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Removing single pathed devices sdc {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b12fb0-6a3f-4c43-b613-e5a4a403241b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2486dbf-6c9c-4374-a1f7-e705b5411e2b]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Flushing IO for device /dev/sdc {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d101144d-672e-4d9e-bcf7-eb47665d5d21]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[af351922-1fb7-44ac-966b-ffeae38d998b]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26566326564626665', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f827caa9', '/dev/disk/by-id/scsi-1SCST_BIOf827caa9-ef2edbfe383463db') {{(pid=85467) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e6c0a0-e0e3-4ba2-b4cd-bf3a4a595d75]: (4, None) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc033ab6-1791-41d2-90e3-98c1aed64bdc]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.186s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c88a514-4122-419e-a211-762bf01a5421]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4, portal: 172.16.0.220,3260]
Aug 26 19:41:01 user nova-compute[73917]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4, portal: 172.16.0.220,3260] successful.
Aug 26 19:41:01 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[db64253c-ea80-44c5-b76f-15d200873e97]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] <== disconnect_volume: return (420ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:41:01 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Deleting instance files /opt/stack/data/nova/instances/71c539b7-f142-4762-8566-4c11babae575_del
Aug 26 19:41:01 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Deletion of /opt/stack/data/nova/instances/71c539b7-f142-4762-8566-4c11babae575_del complete
Aug 26 19:41:01 user nova-compute[73917]: INFO nova.compute.manager [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Took 1.29 seconds to destroy the instance on the hypervisor.
Aug 26 19:41:01 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 71c539b7-f142-4762-8566-4c11babae575] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:41:01 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 71c539b7-f142-4762-8566-4c11babae575] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:41:02 user nova-compute[73917]: DEBUG nova.compute.manager [req-8ef472a6-61fb-4389-a156-ca641f53bcb8 req-eccb4529-8595-4752-9968-76158a48bcfa service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received event network-vif-unplugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:41:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8ef472a6-61fb-4389-a156-ca641f53bcb8 req-eccb4529-8595-4752-9968-76158a48bcfa service nova] Acquiring lock "71c539b7-f142-4762-8566-4c11babae575-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:41:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8ef472a6-61fb-4389-a156-ca641f53bcb8 req-eccb4529-8595-4752-9968-76158a48bcfa service nova] Lock "71c539b7-f142-4762-8566-4c11babae575-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:41:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8ef472a6-61fb-4389-a156-ca641f53bcb8 req-eccb4529-8595-4752-9968-76158a48bcfa service nova] Lock "71c539b7-f142-4762-8566-4c11babae575-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:41:02 user nova-compute[73917]: DEBUG nova.compute.manager [req-8ef472a6-61fb-4389-a156-ca641f53bcb8 req-eccb4529-8595-4752-9968-76158a48bcfa service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] No waiting events found dispatching network-vif-unplugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:41:02 user nova-compute[73917]: DEBUG nova.compute.manager [req-8ef472a6-61fb-4389-a156-ca641f53bcb8 req-eccb4529-8595-4752-9968-76158a48bcfa service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received event network-vif-unplugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:41:02 user nova-compute[73917]: DEBUG nova.compute.manager [req-8ef472a6-61fb-4389-a156-ca641f53bcb8 req-eccb4529-8595-4752-9968-76158a48bcfa service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received event network-vif-plugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:41:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8ef472a6-61fb-4389-a156-ca641f53bcb8 req-eccb4529-8595-4752-9968-76158a48bcfa service nova] Acquiring lock "71c539b7-f142-4762-8566-4c11babae575-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:41:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8ef472a6-61fb-4389-a156-ca641f53bcb8 req-eccb4529-8595-4752-9968-76158a48bcfa service nova] Lock "71c539b7-f142-4762-8566-4c11babae575-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:41:02 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8ef472a6-61fb-4389-a156-ca641f53bcb8 req-eccb4529-8595-4752-9968-76158a48bcfa service nova] Lock "71c539b7-f142-4762-8566-4c11babae575-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:41:02 user nova-compute[73917]: DEBUG nova.compute.manager [req-8ef472a6-61fb-4389-a156-ca641f53bcb8 req-eccb4529-8595-4752-9968-76158a48bcfa service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] No waiting events found dispatching network-vif-plugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:41:02 user nova-compute[73917]: WARNING nova.compute.manager [req-8ef472a6-61fb-4389-a156-ca641f53bcb8 req-eccb4529-8595-4752-9968-76158a48bcfa service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received unexpected event network-vif-plugged-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 for instance with vm_state active and task_state deleting.
Aug 26 19:41:02 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 71c539b7-f142-4762-8566-4c11babae575] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:41:02 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 71c539b7-f142-4762-8566-4c11babae575] Took 0.82 seconds to deallocate network for instance.
Aug 26 19:41:03 user nova-compute[73917]: INFO nova.compute.manager [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Took 0.75 seconds to detach 1 volumes for instance.
Aug 26 19:41:03 user nova-compute[73917]: DEBUG nova.compute.manager [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] [instance: 71c539b7-f142-4762-8566-4c11babae575] Deleting volume: c2ff4f0d-6e2b-4520-afd9-4b60044a6bc4 {{(pid=73917) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 19:41:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:41:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:41:03 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:41:03 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:41:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:41:03 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Deleted allocations for instance 71c539b7-f142-4762-8566-4c11babae575
Aug 26 19:41:03 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fab6f141-c9a6-4def-b24e-cd6b9496c0c7 tempest-TestShelveInstance-1743210450 tempest-TestShelveInstance-1743210450-project-member] Lock "71c539b7-f142-4762-8566-4c11babae575" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.470s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:41:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:04 user nova-compute[73917]: DEBUG nova.compute.manager [req-8c889c18-293f-4402-a455-b2c24f8e284f req-3d0a1555-c9dd-4a67-89ce-cade2437acd3 service nova] [instance: 71c539b7-f142-4762-8566-4c11babae575] Received event network-vif-deleted-7cc26e8e-d653-43c9-87bb-3ecdd3e8ed44 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:41:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "e783bc58-74b8-453f-be05-08f0be586a79" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:41:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "e783bc58-74b8-453f-be05-08f0be586a79" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:41:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "e783bc58-74b8-453f-be05-08f0be586a79-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:41:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "e783bc58-74b8-453f-be05-08f0be586a79-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:41:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "e783bc58-74b8-453f-be05-08f0be586a79-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:41:07 user nova-compute[73917]: INFO nova.compute.manager [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Terminating instance
Aug 26 19:41:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:41:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:07 user nova-compute[73917]: DEBUG nova.compute.manager [req-31412710-977a-4436-94dd-850a824298e6 req-05d2b7d3-8040-4ec0-8b48-4e3763254bb7 service nova] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Received event network-vif-unplugged-74f35329-f0f6-4294-854f-fd62597cef90 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:41:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-31412710-977a-4436-94dd-850a824298e6 req-05d2b7d3-8040-4ec0-8b48-4e3763254bb7 service nova] Acquiring lock "e783bc58-74b8-453f-be05-08f0be586a79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:41:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-31412710-977a-4436-94dd-850a824298e6 req-05d2b7d3-8040-4ec0-8b48-4e3763254bb7 service nova] Lock "e783bc58-74b8-453f-be05-08f0be586a79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:41:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-31412710-977a-4436-94dd-850a824298e6 req-05d2b7d3-8040-4ec0-8b48-4e3763254bb7 service nova] Lock "e783bc58-74b8-453f-be05-08f0be586a79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:41:07 user nova-compute[73917]: DEBUG nova.compute.manager [req-31412710-977a-4436-94dd-850a824298e6 req-05d2b7d3-8040-4ec0-8b48-4e3763254bb7 service nova] [instance: e783bc58-74b8-453f-be05-08f0be586a79] No waiting events found dispatching network-vif-unplugged-74f35329-f0f6-4294-854f-fd62597cef90 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:41:07 user nova-compute[73917]: DEBUG nova.compute.manager [req-31412710-977a-4436-94dd-850a824298e6 req-05d2b7d3-8040-4ec0-8b48-4e3763254bb7 service nova] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Received event network-vif-unplugged-74f35329-f0f6-4294-854f-fd62597cef90 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:08 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Instance destroyed successfully.
Aug 26 19:41:08 user nova-compute[73917]: DEBUG nova.objects.instance [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lazy-loading 'resources' on Instance uuid e783bc58-74b8-453f-be05-08f0be586a79 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-562663829',display_name='tempest-TestVolumeBootPattern-server-562663829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-562663829',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:39:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a6263f314fc43e8aa7a9e0b23f26162',ramdisk_id='',reservation_id='r-uks3xjtf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-534408973',owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:39:40Z,user_data=None,user_id='ed6fbe4e41ef4849934362d43ef97754',uuid=e783bc58-74b8-453f-be05-08f0be586a79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74f35329-f0f6-4294-854f-fd62597cef90", "address": "fa:16:3e:51:90:eb", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f35329-f0", "ovs_interfaceid": "74f35329-f0f6-4294-854f-fd62597cef90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converting VIF {"id": "74f35329-f0f6-4294-854f-fd62597cef90", "address": "fa:16:3e:51:90:eb", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f35329-f0", "ovs_interfaceid": "74f35329-f0f6-4294-854f-fd62597cef90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:90:eb,bridge_name='br-int',has_traffic_filtering=True,id=74f35329-f0f6-4294-854f-fd62597cef90,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f35329-f0') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG os_vif [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:90:eb,bridge_name='br-int',has_traffic_filtering=True,id=74f35329-f0f6-4294-854f-fd62597cef90,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f35329-f0') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74f35329-f0, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:41:08 user nova-compute[73917]: INFO os_vif [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:90:eb,bridge_name='br-int',has_traffic_filtering=True,id=74f35329-f0f6-4294-854f-fd62597cef90,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f35329-f0')
Aug 26 19:41:08 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJDkMbfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:41:08 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:41:08 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[39815ecf-87a4-4bcc-a043-0e899f0d652e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bf0346-825a-4f20-9936-a398542f5f14]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 (non-flash)
Aug 26 19:41:08 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 (non-flash)
Aug 26 19:41:08 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6bb52c32e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3'): ({'sde'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Removing single pathed devices sde {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b1bb7b-dce4-4fbf-87c9-07b80dfa7f80]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1f1a5e-6a43-4a68-83c2-082a6e32f948]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Flushing IO for device /dev/sde {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cb0aa9-d2e2-4b37-992c-d829d430ed85]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[21162f4f-735d-4ee5-ad3a-5d97e36e5f25]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] SCSI volumes sde have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a7d222-b25c-44b4-98f7-4dbaae6e4b09]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7723be-1d3b-4e81-9a20-f2592ccfb41c]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3, portal: 172.16.0.220,3260]
Aug 26 19:41:08 user nova-compute[73917]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3, portal: 172.16.0.220,3260] successful.
Aug 26 19:41:08 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a06d0ba-533d-4034-9264-c64e41f267c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2293465-a368-4cf2-a4f8-52891fac1a74]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] <== disconnect_volume: return (311ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:41:08 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Deleting instance files /opt/stack/data/nova/instances/e783bc58-74b8-453f-be05-08f0be586a79_del
Aug 26 19:41:08 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Deletion of /opt/stack/data/nova/instances/e783bc58-74b8-453f-be05-08f0be586a79_del complete
Aug 26 19:41:08 user nova-compute[73917]: INFO nova.compute.manager [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 26 19:41:08 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:41:08 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: e783bc58-74b8-453f-be05-08f0be586a79] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:41:09 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:41:09 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Took 0.46 seconds to deallocate network for instance.
Aug 26 19:41:09 user nova-compute[73917]: DEBUG nova.compute.manager [req-d32f7d28-4d05-4b3d-928e-8eb2484c63ad req-460c6324-0c78-4c4f-935b-d4d0e2e9032e service nova] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Received event network-vif-deleted-74f35329-f0f6-4294-854f-fd62597cef90 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:41:10 user nova-compute[73917]: DEBUG nova.compute.manager [req-896696fa-891a-4918-89ce-c0cee1680b9e req-af30164a-e023-4439-9144-c268fe989dda service nova] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Received event network-vif-plugged-74f35329-f0f6-4294-854f-fd62597cef90 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:41:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-896696fa-891a-4918-89ce-c0cee1680b9e req-af30164a-e023-4439-9144-c268fe989dda service nova] Acquiring lock "e783bc58-74b8-453f-be05-08f0be586a79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:41:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-896696fa-891a-4918-89ce-c0cee1680b9e req-af30164a-e023-4439-9144-c268fe989dda service nova] Lock "e783bc58-74b8-453f-be05-08f0be586a79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:41:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-896696fa-891a-4918-89ce-c0cee1680b9e req-af30164a-e023-4439-9144-c268fe989dda service nova] Lock "e783bc58-74b8-453f-be05-08f0be586a79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:41:10 user nova-compute[73917]: DEBUG nova.compute.manager [req-896696fa-891a-4918-89ce-c0cee1680b9e req-af30164a-e023-4439-9144-c268fe989dda service nova] [instance: e783bc58-74b8-453f-be05-08f0be586a79] No waiting events found dispatching network-vif-plugged-74f35329-f0f6-4294-854f-fd62597cef90 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:41:10 user nova-compute[73917]: WARNING nova.compute.manager [req-896696fa-891a-4918-89ce-c0cee1680b9e req-af30164a-e023-4439-9144-c268fe989dda service nova] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Received unexpected event network-vif-plugged-74f35329-f0f6-4294-854f-fd62597cef90 for instance with vm_state active and task_state deleting.
Aug 26 19:41:10 user nova-compute[73917]: INFO nova.compute.manager [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Took 0.86 seconds to detach 1 volumes for instance.
Aug 26 19:41:10 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Deleting volume: 8a06d0ba-533d-4034-9264-c64e41f267c3 {{(pid=73917) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 19:41:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:41:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:41:10 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:41:10 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:41:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:41:10 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Deleted allocations for instance e783bc58-74b8-453f-be05-08f0be586a79
Aug 26 19:41:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-b737434d-c057-47ce-855a-bef13fbc73f6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "e783bc58-74b8-453f-be05-08f0be586a79" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.933s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:41:13 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:41:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:41:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:16 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693078861.2240832, 71c539b7-f142-4762-8566-4c11babae575 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:41:16 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 71c539b7-f142-4762-8566-4c11babae575] VM Stopped (Lifecycle Event)
Aug 26 19:41:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-65e08454-af0f-460a-bd8e-7ce8d556f541 None None] [instance: 71c539b7-f142-4762-8566-4c11babae575] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:41:16 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:41:16 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:41:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:41:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Didn't find any instances for network info cache update. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 19:41:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:41:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:41:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:41:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:41:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "298fb1d1-b2b3-4809-9690-12f531a4ff10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:41:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:41:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:41:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:41:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:41:18 user nova-compute[73917]: INFO nova.compute.manager [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Terminating instance
Aug 26 19:41:18 user nova-compute[73917]: DEBUG nova.compute.manager [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:41:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG nova.compute.manager [req-9b64ba1d-4a0c-446e-9ca9-51860a39f897 req-a29868a7-3cf0-49ed-8f2b-a6a67c57cb11 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received event network-vif-unplugged-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9b64ba1d-4a0c-446e-9ca9-51860a39f897 req-a29868a7-3cf0-49ed-8f2b-a6a67c57cb11 service nova] Acquiring lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9b64ba1d-4a0c-446e-9ca9-51860a39f897 req-a29868a7-3cf0-49ed-8f2b-a6a67c57cb11 service nova] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9b64ba1d-4a0c-446e-9ca9-51860a39f897 req-a29868a7-3cf0-49ed-8f2b-a6a67c57cb11 service nova] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG nova.compute.manager [req-9b64ba1d-4a0c-446e-9ca9-51860a39f897 req-a29868a7-3cf0-49ed-8f2b-a6a67c57cb11 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] No waiting events found dispatching network-vif-unplugged-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG nova.compute.manager [req-9b64ba1d-4a0c-446e-9ca9-51860a39f897 req-a29868a7-3cf0-49ed-8f2b-a6a67c57cb11 service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received event network-vif-unplugged-4884888d-f202-47b6-be09-0e0cca7704e2 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:19 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Instance destroyed successfully.
Aug 26 19:41:19 user nova-compute[73917]: DEBUG nova.objects.instance [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lazy-loading 'resources' on Instance uuid 298fb1d1-b2b3-4809-9690-12f531a4ff10 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:36:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-959693260',display_name='tempest-TestMinimumBasicScenario-server-959693260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-959693260',id=46,image_ref='dd993060-0bae-4efa-ada4-489511d9ff49',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrq6awz0xaQ2iMY3gdPadD/sqxiKk+FD1mWFaDKAhAIG3+b8d2fT+ykqYC2UK463dCUIFOXQEA8HYDhZyEA55eUMGfLpNHDKTpfbrdyyqKsMjsK7jW73n9kwIJ0ijhtzw==',key_name='tempest-TestMinimumBasicScenario-1995240937',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:36:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70c87f2fad4648bf90baef68e16d6a5e',ramdisk_id='',reservation_id='r-ur0oekb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd993060-0bae-4efa-ada4-489511d9ff49',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1764501925',owner_user_name='tempest-TestMinimumBasicScenario-1764501925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:38:36Z,user_data=None,user_id='00d8fe7c07284b06985746a92c11f518',uuid=298fb1d1-b2b3-4809-9690-12f531a4ff10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4884888d-f202-47b6-be09-0e0cca7704e2", "address": "fa:16:3e:2f:df:54", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4884888d-f2", "ovs_interfaceid": "4884888d-f202-47b6-be09-0e0cca7704e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Converting VIF {"id": "4884888d-f202-47b6-be09-0e0cca7704e2", "address": "fa:16:3e:2f:df:54", "network": {"id": "9eaab367-1e99-407e-a6e6-086a3c52bf15", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1332970732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70c87f2fad4648bf90baef68e16d6a5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4884888d-f2", "ovs_interfaceid": "4884888d-f202-47b6-be09-0e0cca7704e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:df:54,bridge_name='br-int',has_traffic_filtering=True,id=4884888d-f202-47b6-be09-0e0cca7704e2,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4884888d-f2') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG os_vif [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:df:54,bridge_name='br-int',has_traffic_filtering=True,id=4884888d-f202-47b6-be09-0e0cca7704e2,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4884888d-f2') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4884888d-f2, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:41:19 user nova-compute[73917]: INFO os_vif [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:df:54,bridge_name='br-int',has_traffic_filtering=True,id=4884888d-f202-47b6-be09-0e0cca7704e2,network=Network(9eaab367-1e99-407e-a6e6-086a3c52bf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4884888d-f2')
Aug 26 19:41:19 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Deleting instance files /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10_del
Aug 26 19:41:19 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Deletion of /opt/stack/data/nova/instances/298fb1d1-b2b3-4809-9690-12f531a4ff10_del complete
Aug 26 19:41:19 user nova-compute[73917]: INFO nova.compute.manager [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 26 19:41:19 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:41:19 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:41:20 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:41:20 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Took 0.44 seconds to deallocate network for instance.
Aug 26 19:41:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:41:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:41:20 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:41:20 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:41:20 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:41:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:41:20 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Deleted allocations for instance 298fb1d1-b2b3-4809-9690-12f531a4ff10
Aug 26 19:41:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-53151f5c-af78-4a1c-9680-5d265ef4bb17 tempest-TestMinimumBasicScenario-1764501925 tempest-TestMinimumBasicScenario-1764501925-project-member] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.589s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:41:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-24ed5619-ba70-4839-b5a9-d88679d0678e req-0e9c7a26-28ee-46dc-a1a3-aa4252ae37ca service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received event network-vif-plugged-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:41:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-24ed5619-ba70-4839-b5a9-d88679d0678e req-0e9c7a26-28ee-46dc-a1a3-aa4252ae37ca service nova] Acquiring lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:41:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-24ed5619-ba70-4839-b5a9-d88679d0678e req-0e9c7a26-28ee-46dc-a1a3-aa4252ae37ca service nova] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:41:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-24ed5619-ba70-4839-b5a9-d88679d0678e req-0e9c7a26-28ee-46dc-a1a3-aa4252ae37ca service nova] Lock "298fb1d1-b2b3-4809-9690-12f531a4ff10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:41:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-24ed5619-ba70-4839-b5a9-d88679d0678e req-0e9c7a26-28ee-46dc-a1a3-aa4252ae37ca service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] No waiting events found dispatching network-vif-plugged-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:41:21 user nova-compute[73917]: WARNING nova.compute.manager [req-24ed5619-ba70-4839-b5a9-d88679d0678e req-0e9c7a26-28ee-46dc-a1a3-aa4252ae37ca service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received unexpected event network-vif-plugged-4884888d-f202-47b6-be09-0e0cca7704e2 for instance with vm_state deleted and task_state None.
Aug 26 19:41:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-24ed5619-ba70-4839-b5a9-d88679d0678e req-0e9c7a26-28ee-46dc-a1a3-aa4252ae37ca service nova] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Received event network-vif-deleted-4884888d-f202-47b6-be09-0e0cca7704e2 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:41:22 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:41:22 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:41:23 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:41:23 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693078868.4040306, e783bc58-74b8-453f-be05-08f0be586a79 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:41:23 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: e783bc58-74b8-453f-be05-08f0be586a79] VM Stopped (Lifecycle Event)
Aug 26 19:41:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2966e599-ad50-4e28-866a-1d2b7f227370 None None] [instance: e783bc58-74b8-453f-be05-08f0be586a79] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:41:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:25 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:41:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:41:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:41:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:41:25 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:41:25 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:41:25 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:41:25 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8797MB free_disk=25.123504638671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:41:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:41:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:41:25 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:41:25 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:41:25 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:41:25 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:41:25 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:41:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:41:27 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:41:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:34 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693078879.6628296, 298fb1d1-b2b3-4809-9690-12f531a4ff10 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:41:34 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] VM Stopped (Lifecycle Event)
Aug 26 19:41:34 user nova-compute[73917]: DEBUG nova.compute.manager [None req-f1ba1dad-9ce3-4326-ac66-d6b3a4ed5d24 None None] [instance: 298fb1d1-b2b3-4809-9690-12f531a4ff10] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:41:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:41:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:41:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:41:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:41:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:42:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:13 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:42:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:42:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:17 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:42:17 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:42:17 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:42:17 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Didn't find any instances for network info cache update. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 19:42:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:20 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:42:22 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:42:22 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:42:23 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:42:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "f785be09-b4b9-414a-80d2-fc11f7480648" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:42:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "f785be09-b4b9-414a-80d2-fc11f7480648" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:42:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:42:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:42:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:42:23 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:42:23 user nova-compute[73917]: INFO nova.compute.claims [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Claim successful on node user
Aug 26 19:42:24 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.175s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG nova.network.neutron [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:42:24 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:42:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:42:24 user nova-compute[73917]: INFO nova.virt.block_device [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Booting with volume c0b1e863-b5b4-4840-9967-df04b2c7864d at /dev/vda
Aug 26 19:42:24 user nova-compute[73917]: DEBUG nova.policy [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed6fbe4e41ef4849934362d43ef97754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6263f314fc43e8aa7a9e0b23f26162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG os_brick.utils [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[23554b56-eb40-4527-9674-99e27da2b42b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d23c499-7854-49bc-b16b-3e20d6e6ead6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc393630-d8cc-4c8a-9d99-35ef94a9ed1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b21f28c-569a-4841-97f9-6c94e0dd8b2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:42:24 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:42:24 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcebfd6-84bd-4630-a842-6f436929d34c]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG os_brick.utils [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Updating existing volume attachment record: db43f7a1-64ac-4fd0-81c3-8f9f2faacf5c {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:42:24 user nova-compute[73917]: DEBUG nova.network.neutron [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Successfully created port: 06e65463-8cb5-49a8-ab9b-958fd7b7f89b {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:42:25 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:42:25 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:42:25 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8912MB free_disk=25.161113739013672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG nova.network.neutron [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Successfully updated port: 06e65463-8cb5-49a8-ab9b-958fd7b7f89b {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "refresh_cache-f785be09-b4b9-414a-80d2-fc11f7480648" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquired lock "refresh_cache-f785be09-b4b9-414a-80d2-fc11f7480648" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG nova.network.neutron [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f785be09-b4b9-414a-80d2-fc11f7480648 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-b9e5a9df-25a0-49f9-8ffd-bd2398ed5ef4 req-c475f6a0-03ac-4f09-af54-f708ed6b7af3 service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Received event network-changed-06e65463-8cb5-49a8-ab9b-958fd7b7f89b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG nova.compute.manager [req-b9e5a9df-25a0-49f9-8ffd-bd2398ed5ef4 req-c475f6a0-03ac-4f09-af54-f708ed6b7af3 service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Refreshing instance network info cache due to event network-changed-06e65463-8cb5-49a8-ab9b-958fd7b7f89b. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9e5a9df-25a0-49f9-8ffd-bd2398ed5ef4 req-c475f6a0-03ac-4f09-af54-f708ed6b7af3 service nova] Acquiring lock "refresh_cache-f785be09-b4b9-414a-80d2-fc11f7480648" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG nova.network.neutron [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:42:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:42:26 user nova-compute[73917]: DEBUG nova.network.neutron [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Updating instance_info_cache with network_info: [{"id": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "address": "fa:16:3e:3b:a7:6c", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e65463-8c", "ovs_interfaceid": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:42:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Releasing lock "refresh_cache-f785be09-b4b9-414a-80d2-fc11f7480648" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:42:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Instance network_info: |[{"id": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "address": "fa:16:3e:3b:a7:6c", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e65463-8c", "ovs_interfaceid": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:42:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9e5a9df-25a0-49f9-8ffd-bd2398ed5ef4 req-c475f6a0-03ac-4f09-af54-f708ed6b7af3 service nova] Acquired lock "refresh_cache-f785be09-b4b9-414a-80d2-fc11f7480648" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:42:26 user nova-compute[73917]: DEBUG nova.network.neutron [req-b9e5a9df-25a0-49f9-8ffd-bd2398ed5ef4 req-c475f6a0-03ac-4f09-af54-f708ed6b7af3 service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Refreshing network info cache for port 06e65463-8cb5-49a8-ab9b-958fd7b7f89b {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:42:26 user nova-compute[73917]: DEBUG nova.network.neutron [req-b9e5a9df-25a0-49f9-8ffd-bd2398ed5ef4 req-c475f6a0-03ac-4f09-af54-f708ed6b7af3 service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Updated VIF entry in instance network info cache for port 06e65463-8cb5-49a8-ab9b-958fd7b7f89b. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:42:26 user nova-compute[73917]: DEBUG nova.network.neutron [req-b9e5a9df-25a0-49f9-8ffd-bd2398ed5ef4 req-c475f6a0-03ac-4f09-af54-f708ed6b7af3 service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Updating instance_info_cache with network_info: [{"id": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "address": "fa:16:3e:3b:a7:6c", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e65463-8c", "ovs_interfaceid": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:42:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9e5a9df-25a0-49f9-8ffd-bd2398ed5ef4 req-c475f6a0-03ac-4f09-af54-f708ed6b7af3 service nova] Releasing lock "refresh_cache-f785be09-b4b9-414a-80d2-fc11f7480648" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:42:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:42:29 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:42:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:42:34 user nova-compute[73917]: DEBUG nova.compute.manager [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:42:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:42:34 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Creating image(s)
Aug 26 19:42:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Did not create local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 19:42:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Ensure instance console log exists: /opt/stack/data/nova/instances/f785be09-b4b9-414a-80d2-fc11f7480648/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:42:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:42:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:42:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:42:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Start _get_guest_xml network_info=[{"id": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "address": "fa:16:3e:3b:a7:6c", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e65463-8c", "ovs_interfaceid": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoNfWxdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f785be09-b4b9-414a-80d2-fc11f7480648', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0b1e863-b5b4-4840-9967-df04b2c7864d', 'serial': 'c0b1e863-b5b4-4840-9967-df04b2c7864d'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'db43f7a1-64ac-4fd0-81c3-8f9f2faacf5c', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:42:35 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:42:35 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:42:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoNfWxdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:42:35 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:42:35 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:42:35 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[04719418-7361-4706-865c-09e8398c3a5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:42:35 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b9bd42-113a-4a2d-a62f-66d6d5b3a72a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d] added
Aug 26 19:42:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[052a8539-73cf-4f58-b11e-b89588ecb074]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4534d855-fe7b-4bcf-92bd-831e5225f7c1]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UoNfWxdv {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UoNfWxdv" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2821afba-2e04-4b26-9317-fcf481b09eef]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UoNfWxdv'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc048a7d-4465-4722-9f4e-f1d2107a14bf]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[db590672-fd0d-4556-aadf-5ab86b4431ab]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 19:42:35 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 19:42:35 user nova-compute[73917]:  {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:42:35 user nova-compute[73917]: WARNING os_brick.initiator.connectors.iscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 19:42:35 user nova-compute[73917]: 
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e234164b-510a-481f-ba36-27f46bd39982]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d, portal: 172.16.0.220,3260]
Aug 26 19:42:35 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d, portal: 172.16.0.220,3260] successful.
Aug 26 19:42:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c00504-4db3-4dc1-b04a-91a27a835a2c]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[900b3777-1029-425c-9a13-f18eb1ce5509]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d (non-flash)
Aug 26 19:42:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d (non-flash)
Aug 26 19:42:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5186002e-e2a0-40cc-9ea8-2e43dc0554cb]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:42:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoNfWxdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23334353161383037', 'path': '/dev/sdb'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334353161383037', 'path': '/dev/sdb'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:42:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-145050299',display_name='tempest-TestVolumeBootPattern-volume-backed-server-145050299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-145050299',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArG16KWE0zIOWqhR4AduIVAFqXEU7C2wzmjgGhMiq6JvhIDoa/P51UMVM0gQj3yRtURvw7IaQb/n0b9Z7F7gvz9fBJ78yjOFhtR+DYBQ01QajXniWrLC4PQh0LnXbo8uw==',key_name='tempest-keypair-1415645027',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a6263f314fc43e8aa7a9e0b23f26162',ramdisk_id='',reservation_id='r-9vtbd8ag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-534408973',owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:42:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed6fbe4e41ef4849934362d43ef97754',uuid=f785be09-b4b9-414a-80d2-fc11f7480648,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "address": "fa:16:3e:3b:a7:6c", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e65463-8c", "ovs_interfaceid": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converting VIF {"id": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "address": "fa:16:3e:3b:a7:6c", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e65463-8c", "ovs_interfaceid": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a7:6c,bridge_name='br-int',has_traffic_filtering=True,id=06e65463-8cb5-49a8-ab9b-958fd7b7f89b,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e65463-8c') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG nova.objects.instance [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lazy-loading 'pci_devices' on Instance uuid f785be09-b4b9-414a-80d2-fc11f7480648 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:42:36 user nova-compute[73917]:   <uuid>f785be09-b4b9-414a-80d2-fc11f7480648</uuid>
Aug 26 19:42:36 user nova-compute[73917]:   <name>instance-00000030</name>
Aug 26 19:42:36 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:42:36 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:42:36 user nova-compute[73917]:   <metadata>
Aug 26 19:42:36 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:42:36 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:42:36 user nova-compute[73917]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-145050299</nova:name>
Aug 26 19:42:36 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:42:35</nova:creationTime>
Aug 26 19:42:36 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:42:36 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:42:36 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:42:36 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:42:36 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:42:36 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:42:36 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:42:36 user nova-compute[73917]:       <nova:owner>
Aug 26 19:42:36 user nova-compute[73917]:         <nova:user uuid="ed6fbe4e41ef4849934362d43ef97754">tempest-TestVolumeBootPattern-534408973-project-member</nova:user>
Aug 26 19:42:36 user nova-compute[73917]:         <nova:project uuid="7a6263f314fc43e8aa7a9e0b23f26162">tempest-TestVolumeBootPattern-534408973</nova:project>
Aug 26 19:42:36 user nova-compute[73917]:       </nova:owner>
Aug 26 19:42:36 user nova-compute[73917]:       <nova:ports>
Aug 26 19:42:36 user nova-compute[73917]:         <nova:port uuid="06e65463-8cb5-49a8-ab9b-958fd7b7f89b">
Aug 26 19:42:36 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 19:42:36 user nova-compute[73917]:         </nova:port>
Aug 26 19:42:36 user nova-compute[73917]:       </nova:ports>
Aug 26 19:42:36 user nova-compute[73917]:     </nova:instance>
Aug 26 19:42:36 user nova-compute[73917]:   </metadata>
Aug 26 19:42:36 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:42:36 user nova-compute[73917]:     <system>
Aug 26 19:42:36 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:42:36 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:42:36 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:42:36 user nova-compute[73917]:       <entry name="serial">f785be09-b4b9-414a-80d2-fc11f7480648</entry>
Aug 26 19:42:36 user nova-compute[73917]:       <entry name="uuid">f785be09-b4b9-414a-80d2-fc11f7480648</entry>
Aug 26 19:42:36 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:42:36 user nova-compute[73917]:     </system>
Aug 26 19:42:36 user nova-compute[73917]:   </sysinfo>
Aug 26 19:42:36 user nova-compute[73917]:   <os>
Aug 26 19:42:36 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:42:36 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:42:36 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:42:36 user nova-compute[73917]:   </os>
Aug 26 19:42:36 user nova-compute[73917]:   <features>
Aug 26 19:42:36 user nova-compute[73917]:     <acpi/>
Aug 26 19:42:36 user nova-compute[73917]:     <apic/>
Aug 26 19:42:36 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:42:36 user nova-compute[73917]:   </features>
Aug 26 19:42:36 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:42:36 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:42:36 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:42:36 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:42:36 user nova-compute[73917]:   </clock>
Aug 26 19:42:36 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:42:36 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:42:36 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:42:36 user nova-compute[73917]:   </cpu>
Aug 26 19:42:36 user nova-compute[73917]:   <devices>
Aug 26 19:42:36 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:42:36 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:42:36 user nova-compute[73917]:       <source dev="/dev/sdb"/>
Aug 26 19:42:36 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:42:36 user nova-compute[73917]:       <serial>c0b1e863-b5b4-4840-9967-df04b2c7864d</serial>
Aug 26 19:42:36 user nova-compute[73917]:     </disk>
Aug 26 19:42:36 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:42:36 user nova-compute[73917]:       <mac address="fa:16:3e:3b:a7:6c"/>
Aug 26 19:42:36 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:42:36 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:42:36 user nova-compute[73917]:       <target dev="tap06e65463-8c"/>
Aug 26 19:42:36 user nova-compute[73917]:     </interface>
Aug 26 19:42:36 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:42:36 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/f785be09-b4b9-414a-80d2-fc11f7480648/console.log" append="off"/>
Aug 26 19:42:36 user nova-compute[73917]:     </serial>
Aug 26 19:42:36 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:42:36 user nova-compute[73917]:     <video>
Aug 26 19:42:36 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:42:36 user nova-compute[73917]:     </video>
Aug 26 19:42:36 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:42:36 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:42:36 user nova-compute[73917]:     </rng>
Aug 26 19:42:36 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:42:36 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:42:36 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:42:36 user nova-compute[73917]:     </memballoon>
Aug 26 19:42:36 user nova-compute[73917]:   </devices>
Aug 26 19:42:36 user nova-compute[73917]: </domain>
Aug 26 19:42:36 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:42:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-145050299',display_name='tempest-TestVolumeBootPattern-volume-backed-server-145050299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-145050299',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArG16KWE0zIOWqhR4AduIVAFqXEU7C2wzmjgGhMiq6JvhIDoa/P51UMVM0gQj3yRtURvw7IaQb/n0b9Z7F7gvz9fBJ78yjOFhtR+DYBQ01QajXniWrLC4PQh0LnXbo8uw==',key_name='tempest-keypair-1415645027',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a6263f314fc43e8aa7a9e0b23f26162',ramdisk_id='',reservation_id='r-9vtbd8ag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-534408973',owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:42:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed6fbe4e41ef4849934362d43ef97754',uuid=f785be09-b4b9-414a-80d2-fc11f7480648,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "address": "fa:16:3e:3b:a7:6c", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e65463-8c", "ovs_interfaceid": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converting VIF {"id": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "address": "fa:16:3e:3b:a7:6c", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e65463-8c", "ovs_interfaceid": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a7:6c,bridge_name='br-int',has_traffic_filtering=True,id=06e65463-8cb5-49a8-ab9b-958fd7b7f89b,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e65463-8c') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG os_vif [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a7:6c,bridge_name='br-int',has_traffic_filtering=True,id=06e65463-8cb5-49a8-ab9b-958fd7b7f89b,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e65463-8c') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06e65463-8c, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06e65463-8c, col_values=(('external_ids', {'iface-id': '06e65463-8cb5-49a8-ab9b-958fd7b7f89b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:a7:6c', 'vm-uuid': 'f785be09-b4b9-414a-80d2-fc11f7480648'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:36 user nova-compute[73917]: INFO os_vif [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a7:6c,bridge_name='br-int',has_traffic_filtering=True,id=06e65463-8cb5-49a8-ab9b-958fd7b7f89b,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e65463-8c')
Aug 26 19:42:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:42:36 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] No VIF found with MAC fa:16:3e:3b:a7:6c, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:42:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:37 user nova-compute[73917]: DEBUG nova.compute.manager [req-9589b3c1-7155-4a37-a52f-976d3c3ee8b4 req-1f76c5ba-9a37-4dce-95ea-961ee20ccbef service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Received event network-vif-plugged-06e65463-8cb5-49a8-ab9b-958fd7b7f89b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:42:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9589b3c1-7155-4a37-a52f-976d3c3ee8b4 req-1f76c5ba-9a37-4dce-95ea-961ee20ccbef service nova] Acquiring lock "f785be09-b4b9-414a-80d2-fc11f7480648-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:42:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9589b3c1-7155-4a37-a52f-976d3c3ee8b4 req-1f76c5ba-9a37-4dce-95ea-961ee20ccbef service nova] Lock "f785be09-b4b9-414a-80d2-fc11f7480648-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:42:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9589b3c1-7155-4a37-a52f-976d3c3ee8b4 req-1f76c5ba-9a37-4dce-95ea-961ee20ccbef service nova] Lock "f785be09-b4b9-414a-80d2-fc11f7480648-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:42:37 user nova-compute[73917]: DEBUG nova.compute.manager [req-9589b3c1-7155-4a37-a52f-976d3c3ee8b4 req-1f76c5ba-9a37-4dce-95ea-961ee20ccbef service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] No waiting events found dispatching network-vif-plugged-06e65463-8cb5-49a8-ab9b-958fd7b7f89b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:42:37 user nova-compute[73917]: WARNING nova.compute.manager [req-9589b3c1-7155-4a37-a52f-976d3c3ee8b4 req-1f76c5ba-9a37-4dce-95ea-961ee20ccbef service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Received unexpected event network-vif-plugged-06e65463-8cb5-49a8-ab9b-958fd7b7f89b for instance with vm_state building and task_state spawning.
Aug 26 19:42:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:39 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078959.6954088, f785be09-b4b9-414a-80d2-fc11f7480648 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:42:39 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] VM Resumed (Lifecycle Event)
Aug 26 19:42:39 user nova-compute[73917]: DEBUG nova.compute.manager [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:42:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:42:39 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Instance spawned successfully.
Aug 26 19:42:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:42:39 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:42:39 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:42:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:42:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:42:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:42:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:42:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:42:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:42:39 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:42:39 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693078959.696787, f785be09-b4b9-414a-80d2-fc11f7480648 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:42:39 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] VM Started (Lifecycle Event)
Aug 26 19:42:39 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:42:39 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:42:39 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:42:39 user nova-compute[73917]: INFO nova.compute.manager [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Took 4.81 seconds to spawn the instance on the hypervisor.
Aug 26 19:42:39 user nova-compute[73917]: DEBUG nova.compute.manager [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:42:39 user nova-compute[73917]: INFO nova.compute.manager [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Took 16.01 seconds to build instance.
Aug 26 19:42:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-43e2479a-3c1b-486e-9a8d-34f5d938144b tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "f785be09-b4b9-414a-80d2-fc11f7480648" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.092s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:42:39 user nova-compute[73917]: DEBUG nova.compute.manager [req-c909ea6d-3926-4337-9478-e639449ed97c req-c121912e-0a2f-4767-b809-84d542db91fc service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Received event network-vif-plugged-06e65463-8cb5-49a8-ab9b-958fd7b7f89b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:42:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c909ea6d-3926-4337-9478-e639449ed97c req-c121912e-0a2f-4767-b809-84d542db91fc service nova] Acquiring lock "f785be09-b4b9-414a-80d2-fc11f7480648-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:42:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c909ea6d-3926-4337-9478-e639449ed97c req-c121912e-0a2f-4767-b809-84d542db91fc service nova] Lock "f785be09-b4b9-414a-80d2-fc11f7480648-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:42:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c909ea6d-3926-4337-9478-e639449ed97c req-c121912e-0a2f-4767-b809-84d542db91fc service nova] Lock "f785be09-b4b9-414a-80d2-fc11f7480648-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:42:39 user nova-compute[73917]: DEBUG nova.compute.manager [req-c909ea6d-3926-4337-9478-e639449ed97c req-c121912e-0a2f-4767-b809-84d542db91fc service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] No waiting events found dispatching network-vif-plugged-06e65463-8cb5-49a8-ab9b-958fd7b7f89b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:42:39 user nova-compute[73917]: WARNING nova.compute.manager [req-c909ea6d-3926-4337-9478-e639449ed97c req-c121912e-0a2f-4767-b809-84d542db91fc service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Received unexpected event network-vif-plugged-06e65463-8cb5-49a8-ab9b-958fd7b7f89b for instance with vm_state active and task_state None.
Aug 26 19:42:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:44 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:42:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:42:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:42:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:42:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:42:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:42:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:42:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Verify base images {{(pid=73917) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 26 19:42:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73917) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 19:42:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] f785be09-b4b9-414a-80d2-fc11f7480648 is a valid instance name {{(pid=73917) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 19:42:44 user nova-compute[73917]: WARNING nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Unknown base file: /opt/stack/data/nova/instances/_base/695c3c85c9dab820408047df6ace8ae5eea18e2b
Aug 26 19:42:44 user nova-compute[73917]: WARNING nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5de966a3faf05f65d2c168268da87a37ce90d544
Aug 26 19:42:44 user nova-compute[73917]: WARNING nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cbc888d70f98f24d319e3634d973c66baab75c53
Aug 26 19:42:44 user nova-compute[73917]: WARNING nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2
Aug 26 19:42:44 user nova-compute[73917]: WARNING nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c945ac371e635510a61af6c987c17e4ab8c32c5d
Aug 26 19:42:44 user nova-compute[73917]: WARNING nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Unknown base file: /opt/stack/data/nova/instances/_base/09c8603eb9034e42faaee961f1867af3ea726519
Aug 26 19:42:44 user nova-compute[73917]: WARNING nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f
Aug 26 19:42:44 user nova-compute[73917]: WARNING nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a15323ee82a3bcab9aa06d020bc0524039708e62
Aug 26 19:42:44 user nova-compute[73917]: WARNING nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5dc0f4e2959123161326e2c98237673494d4d68b
Aug 26 19:42:44 user nova-compute[73917]: WARNING nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Unknown base file: /opt/stack/data/nova/instances/_base/443169b47763960834782dca0d9a58662f0bc9a3
Aug 26 19:42:44 user nova-compute[73917]: INFO nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Removable base files: /opt/stack/data/nova/instances/_base/695c3c85c9dab820408047df6ace8ae5eea18e2b /opt/stack/data/nova/instances/_base/5de966a3faf05f65d2c168268da87a37ce90d544 /opt/stack/data/nova/instances/_base/cbc888d70f98f24d319e3634d973c66baab75c53 /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 /opt/stack/data/nova/instances/_base/c945ac371e635510a61af6c987c17e4ab8c32c5d /opt/stack/data/nova/instances/_base/09c8603eb9034e42faaee961f1867af3ea726519 /opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f /opt/stack/data/nova/instances/_base/a15323ee82a3bcab9aa06d020bc0524039708e62 /opt/stack/data/nova/instances/_base/5dc0f4e2959123161326e2c98237673494d4d68b /opt/stack/data/nova/instances/_base/443169b47763960834782dca0d9a58662f0bc9a3
Aug 26 19:42:44 user nova-compute[73917]: INFO nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/695c3c85c9dab820408047df6ace8ae5eea18e2b
Aug 26 19:42:44 user nova-compute[73917]: INFO nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5de966a3faf05f65d2c168268da87a37ce90d544
Aug 26 19:42:44 user nova-compute[73917]: INFO nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cbc888d70f98f24d319e3634d973c66baab75c53
Aug 26 19:42:44 user nova-compute[73917]: INFO nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2
Aug 26 19:42:44 user nova-compute[73917]: INFO nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c945ac371e635510a61af6c987c17e4ab8c32c5d
Aug 26 19:42:44 user nova-compute[73917]: INFO nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/09c8603eb9034e42faaee961f1867af3ea726519
Aug 26 19:42:44 user nova-compute[73917]: INFO nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b1fedbf48dd65aa173b8f7c7389cc1f3639f996f
Aug 26 19:42:44 user nova-compute[73917]: INFO nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a15323ee82a3bcab9aa06d020bc0524039708e62
Aug 26 19:42:44 user nova-compute[73917]: INFO nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5dc0f4e2959123161326e2c98237673494d4d68b
Aug 26 19:42:44 user nova-compute[73917]: INFO nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/443169b47763960834782dca0d9a58662f0bc9a3
Aug 26 19:42:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Verification complete {{(pid=73917) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 26 19:42:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Verify swap images {{(pid=73917) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 26 19:42:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.imagecache [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Verify ephemeral images {{(pid=73917) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 26 19:42:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:42:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:43:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:43:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:43:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:43:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:43:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:43:15 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:43:15 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:43:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:43:19 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:43:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:43:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:43:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-f785be09-b4b9-414a-80d2-fc11f7480648" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:43:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-f785be09-b4b9-414a-80d2-fc11f7480648" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:43:19 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:43:19 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid f785be09-b4b9-414a-80d2-fc11f7480648 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:43:19 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Updating instance_info_cache with network_info: [{"id": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "address": "fa:16:3e:3b:a7:6c", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e65463-8c", "ovs_interfaceid": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:43:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-f785be09-b4b9-414a-80d2-fc11f7480648" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:43:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:43:20 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:43:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:43:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:43:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:43:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:43:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:43:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:43:22 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:43:22 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:43:22 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:43:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73917) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 19:43:24 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:43:25 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:43:25 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:43:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:43:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:43:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:43:25 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:43:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:43:25 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:43:25 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:43:25 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8769MB free_disk=25.159656524658203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:43:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:43:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:43:25 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f785be09-b4b9-414a-80d2-fc11f7480648 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:43:25 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:43:25 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:43:25 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing inventories for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 19:43:25 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating ProviderTree inventory for provider d90ad23a-e063-4f0d-8341-c34e0141d16a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 19:43:25 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating inventory in ProviderTree for provider d90ad23a-e063-4f0d-8341-c34e0141d16a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 19:43:26 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing aggregate associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, aggregates: None {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 19:43:26 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing trait associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 19:43:26 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:43:26 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:43:26 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:43:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:43:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:43:27 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:43:30 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:43:31 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:43:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 19:43:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] There are 0 instances to clean {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 19:43:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:43:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:43:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:43:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:43:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:43:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:43:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:43:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:43:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:43:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:43:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:43:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:44:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-8d15ff4f-2b39-414c-ba6e-83a30662e382 req-d6b94d5f-c39d-4472-9327-61d8393b48e3 service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Received event network-changed-06e65463-8cb5-49a8-ab9b-958fd7b7f89b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:44:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-8d15ff4f-2b39-414c-ba6e-83a30662e382 req-d6b94d5f-c39d-4472-9327-61d8393b48e3 service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Refreshing instance network info cache due to event network-changed-06e65463-8cb5-49a8-ab9b-958fd7b7f89b. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:44:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8d15ff4f-2b39-414c-ba6e-83a30662e382 req-d6b94d5f-c39d-4472-9327-61d8393b48e3 service nova] Acquiring lock "refresh_cache-f785be09-b4b9-414a-80d2-fc11f7480648" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:44:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8d15ff4f-2b39-414c-ba6e-83a30662e382 req-d6b94d5f-c39d-4472-9327-61d8393b48e3 service nova] Acquired lock "refresh_cache-f785be09-b4b9-414a-80d2-fc11f7480648" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:44:15 user nova-compute[73917]: DEBUG nova.network.neutron [req-8d15ff4f-2b39-414c-ba6e-83a30662e382 req-d6b94d5f-c39d-4472-9327-61d8393b48e3 service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Refreshing network info cache for port 06e65463-8cb5-49a8-ab9b-958fd7b7f89b {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:44:15 user nova-compute[73917]: DEBUG nova.network.neutron [req-8d15ff4f-2b39-414c-ba6e-83a30662e382 req-d6b94d5f-c39d-4472-9327-61d8393b48e3 service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Updated VIF entry in instance network info cache for port 06e65463-8cb5-49a8-ab9b-958fd7b7f89b. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:44:15 user nova-compute[73917]: DEBUG nova.network.neutron [req-8d15ff4f-2b39-414c-ba6e-83a30662e382 req-d6b94d5f-c39d-4472-9327-61d8393b48e3 service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Updating instance_info_cache with network_info: [{"id": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "address": "fa:16:3e:3b:a7:6c", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e65463-8c", "ovs_interfaceid": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:44:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8d15ff4f-2b39-414c-ba6e-83a30662e382 req-d6b94d5f-c39d-4472-9327-61d8393b48e3 service nova] Releasing lock "refresh_cache-f785be09-b4b9-414a-80d2-fc11f7480648" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:44:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:44:17 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:44:17 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:44:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:19 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:44:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:44:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:44:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-f785be09-b4b9-414a-80d2-fc11f7480648" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:44:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-f785be09-b4b9-414a-80d2-fc11f7480648" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:44:19 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:44:19 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid f785be09-b4b9-414a-80d2-fc11f7480648 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:44:19 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Updating instance_info_cache with network_info: [{"id": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "address": "fa:16:3e:3b:a7:6c", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e65463-8c", "ovs_interfaceid": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:44:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-f785be09-b4b9-414a-80d2-fc11f7480648" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:44:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:44:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:23 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:44:23 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:44:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:25 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:44:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "afc847a8-d28c-48a4-bc27-78acd52c78aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:44:27 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:44:27 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:44:27 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8767MB free_disk=25.158660888671875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f785be09-b4b9-414a-80d2-fc11f7480648 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance afc847a8-d28c-48a4-bc27-78acd52c78aa has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.065s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:44:27 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:44:27 user nova-compute[73917]: INFO nova.compute.claims [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Claim successful on node user
Aug 26 19:44:28 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:44:28 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:44:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.201s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:44:28 user nova-compute[73917]: DEBUG nova.compute.manager [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:44:28 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:44:28 user nova-compute[73917]: DEBUG nova.compute.manager [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:44:28 user nova-compute[73917]: DEBUG nova.network.neutron [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:44:28 user nova-compute[73917]: DEBUG nova.compute.manager [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:44:28 user nova-compute[73917]: INFO nova.virt.block_device [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Booting with volume snapshot 84c422e0-46df-49df-8988-1ac4b7ba7d29 at /dev/vda
Aug 26 19:44:28 user nova-compute[73917]: DEBUG nova.policy [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed6fbe4e41ef4849934362d43ef97754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6263f314fc43e8aa7a9e0b23f26162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:44:28 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:44:29 user nova-compute[73917]: DEBUG nova.network.neutron [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Successfully created port: ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:44:30 user nova-compute[73917]: DEBUG nova.network.neutron [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Successfully updated port: ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:44:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "refresh_cache-afc847a8-d28c-48a4-bc27-78acd52c78aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:44:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquired lock "refresh_cache-afc847a8-d28c-48a4-bc27-78acd52c78aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:44:30 user nova-compute[73917]: DEBUG nova.network.neutron [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:44:30 user nova-compute[73917]: DEBUG nova.network.neutron [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:44:30 user nova-compute[73917]: DEBUG nova.compute.manager [req-117eece0-9eb5-4384-a6ff-3b1338e4b8b5 req-16693766-4251-4799-a229-9f9f3002731a service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Received event network-changed-ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:44:30 user nova-compute[73917]: DEBUG nova.compute.manager [req-117eece0-9eb5-4384-a6ff-3b1338e4b8b5 req-16693766-4251-4799-a229-9f9f3002731a service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Refreshing instance network info cache due to event network-changed-ba6d03f1-5496-4959-8b52-df859840f28e. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:44:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-117eece0-9eb5-4384-a6ff-3b1338e4b8b5 req-16693766-4251-4799-a229-9f9f3002731a service nova] Acquiring lock "refresh_cache-afc847a8-d28c-48a4-bc27-78acd52c78aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:44:30 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:44:30 user nova-compute[73917]: DEBUG nova.network.neutron [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Updating instance_info_cache with network_info: [{"id": "ba6d03f1-5496-4959-8b52-df859840f28e", "address": "fa:16:3e:a9:6e:61", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6d03f1-54", "ovs_interfaceid": "ba6d03f1-5496-4959-8b52-df859840f28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:44:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Releasing lock "refresh_cache-afc847a8-d28c-48a4-bc27-78acd52c78aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:44:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Instance network_info: |[{"id": "ba6d03f1-5496-4959-8b52-df859840f28e", "address": "fa:16:3e:a9:6e:61", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6d03f1-54", "ovs_interfaceid": "ba6d03f1-5496-4959-8b52-df859840f28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:44:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-117eece0-9eb5-4384-a6ff-3b1338e4b8b5 req-16693766-4251-4799-a229-9f9f3002731a service nova] Acquired lock "refresh_cache-afc847a8-d28c-48a4-bc27-78acd52c78aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:44:30 user nova-compute[73917]: DEBUG nova.network.neutron [req-117eece0-9eb5-4384-a6ff-3b1338e4b8b5 req-16693766-4251-4799-a229-9f9f3002731a service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Refreshing network info cache for port ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:44:30 user nova-compute[73917]: DEBUG nova.network.neutron [req-117eece0-9eb5-4384-a6ff-3b1338e4b8b5 req-16693766-4251-4799-a229-9f9f3002731a service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Updated VIF entry in instance network info cache for port ba6d03f1-5496-4959-8b52-df859840f28e. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:44:30 user nova-compute[73917]: DEBUG nova.network.neutron [req-117eece0-9eb5-4384-a6ff-3b1338e4b8b5 req-16693766-4251-4799-a229-9f9f3002731a service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Updating instance_info_cache with network_info: [{"id": "ba6d03f1-5496-4959-8b52-df859840f28e", "address": "fa:16:3e:a9:6e:61", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6d03f1-54", "ovs_interfaceid": "ba6d03f1-5496-4959-8b52-df859840f28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:44:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-117eece0-9eb5-4384-a6ff-3b1338e4b8b5 req-16693766-4251-4799-a229-9f9f3002731a service nova] Releasing lock "refresh_cache-afc847a8-d28c-48a4-bc27-78acd52c78aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:44:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:44:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:44:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:44:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:44:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:44:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:33 user nova-compute[73917]: DEBUG os_brick.utils [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:44:33 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:44:33 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:44:33 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cc5dba-15e1-4b5b-9b51-ce7c85e96a87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:44:33 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:44:33 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:44:33 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[436bebe4-3641-43c8-8018-c9baa0f75a33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:44:33 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:44:33 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:44:33 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[685c6f7b-8aee-4173-88e3-9064ff52f478]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:44:33 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c2b08c-bfcd-4854-9b86-74d3b4f6e7aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:44:33 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:44:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:44:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:44:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:44:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:44:34 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:44:34 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a510bdf8-362e-459d-bfcb-89bf5b630c1e]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:44:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:44:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:44:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:44:34 user nova-compute[73917]: DEBUG os_brick.utils [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:44:34 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Updating existing volume attachment record: fb03d9cd-93bd-48ba-bceb-d6964d2c0cf8 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:44:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:39 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:44:39 user nova-compute[73917]: WARNING nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] While synchronizing instance power states, found 2 instances in the database and 1 instances on the hypervisor.
Aug 26 19:44:39 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid f785be09-b4b9-414a-80d2-fc11f7480648 {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:44:39 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid afc847a8-d28c-48a4-bc27-78acd52c78aa {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:44:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "f785be09-b4b9-414a-80d2-fc11f7480648" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:44:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "f785be09-b4b9-414a-80d2-fc11f7480648" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:44:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "afc847a8-d28c-48a4-bc27-78acd52c78aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:44:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "f785be09-b4b9-414a-80d2-fc11f7480648" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:44:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:44:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:44:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:44:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:44:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:44:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.compute.manager [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:44:44 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Creating image(s)
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Did not create local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Ensure instance console log exists: /opt/stack/data/nova/instances/afc847a8-d28c-48a4-bc27-78acd52c78aa/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Start _get_guest_xml network_info=[{"id": "ba6d03f1-5496-4959-8b52-df859840f28e", "address": "fa:16:3e:a9:6e:61", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6d03f1-54", "ovs_interfaceid": "ba6d03f1-5496-4959-8b52-df859840f28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T19:44:16Z,direct_url=<?>,disk_format='qcow2',id=ba361b67-d3b8-4682-9818-4599ca1b444d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-997642932',owner='7a6263f314fc43e8aa7a9e0b23f26162',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T19:44:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wHQpPvJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'afc847a8-d28c-48a4-bc27-78acd52c78aa', 'attached_at': '', 'detached_at': '', 'volume_id': 'b39e8856-c751-426e-9f55-42e77d53a2b9', 'serial': 'b39e8856-c751-426e-9f55-42e77d53a2b9'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'fb03d9cd-93bd-48ba-bceb-d6964d2c0cf8', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:44:44 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:44:44 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T19:44:16Z,direct_url=<?>,disk_format='qcow2',id=ba361b67-d3b8-4682-9818-4599ca1b444d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-997642932',owner='7a6263f314fc43e8aa7a9e0b23f26162',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T19:44:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wHQpPvJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:44:44 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:44:44 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:44:44 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b4b5ee-45b7-4e5a-9028-50a0e0a69cf7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:44:44 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9c5591-f305-4486-8e0d-4712e06a3a9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9] added
Aug 26 19:44:44 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea3a060-1c87-4c04-924c-09a6bc7c53b0]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f5267d-3057-40c2-af8b-e34c4f8a5c20]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wHQpPvJf {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wHQpPvJf" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9d23fb-a974-4975-ac80-013fb4ed0bad]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wHQpPvJf'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[18066e86-499d-4532-9c90-cb817667a05a]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2106e51b-78e3-4e59-92ac-812a7e5c2f12]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d (non-flash)
Aug 26 19:44:44 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d (non-flash)
Aug 26 19:44:44 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[26abf4f3-87f8-40cc-83af-aa3010201501]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9, portal: 172.16.0.220,3260]
Aug 26 19:44:44 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9, portal: 172.16.0.220,3260] successful.
Aug 26 19:44:44 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d97090b-b492-47f6-81ed-05396c94c8aa]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad4d240-3477-4e3e-8bcf-86abcce36251]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d (non-flash)
Aug 26 19:44:44 user nova-compute[73917]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 (non-flash)
Aug 26 19:44:44 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d (non-flash)
Aug 26 19:44:44 user nova-compute[73917]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 (non-flash)
Aug 26 19:44:44 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[960c7b40-cc5f-4a84-bc67-8dbe4cfb4c86]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:44:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wHQpPvJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:44:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:44:45 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23864666530633532', 'path': '/dev/sdc'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:44:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864666530633532', 'path': '/dev/sdc'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:44:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:44:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-228676325',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-228676325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-228676325',id=49,image_ref='ba361b67-d3b8-4682-9818-4599ca1b444d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIs0oeqXcVrZNlG/7KVCMddDvbDY/Mz/kfJxzHMO5Sm/BvB3/43A14P61MiRq2O393UHCMQ2nlRc3PRr3+nw/beKoVwBo43vExCYc4Ko1q6sk3FpIOtZEuPcVM1Vp3T3OQ==',key_name='tempest-keypair-104109663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a6263f314fc43e8aa7a9e0b23f26162',ramdisk_id='',reservation_id='r-rrkr5x7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-534408973',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-534408973',owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:44:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed6fbe4e41ef4849934362d43ef97754',uuid=afc847a8-d28c-48a4-bc27-78acd52c78aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba6d03f1-5496-4959-8b52-df859840f28e", "address": "fa:16:3e:a9:6e:61", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6d03f1-54", "ovs_interfaceid": "ba6d03f1-5496-4959-8b52-df859840f28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:44:45 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converting VIF {"id": "ba6d03f1-5496-4959-8b52-df859840f28e", "address": "fa:16:3e:a9:6e:61", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6d03f1-54", "ovs_interfaceid": "ba6d03f1-5496-4959-8b52-df859840f28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:44:45 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:61,bridge_name='br-int',has_traffic_filtering=True,id=ba6d03f1-5496-4959-8b52-df859840f28e,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6d03f1-54') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:44:45 user nova-compute[73917]: DEBUG nova.objects.instance [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lazy-loading 'pci_devices' on Instance uuid afc847a8-d28c-48a4-bc27-78acd52c78aa {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:44:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:44:45 user nova-compute[73917]:   <uuid>afc847a8-d28c-48a4-bc27-78acd52c78aa</uuid>
Aug 26 19:44:45 user nova-compute[73917]:   <name>instance-00000031</name>
Aug 26 19:44:45 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:44:45 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:44:45 user nova-compute[73917]:   <metadata>
Aug 26 19:44:45 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:44:45 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:44:45 user nova-compute[73917]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-228676325</nova:name>
Aug 26 19:44:45 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:44:44</nova:creationTime>
Aug 26 19:44:45 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:44:45 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:44:45 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:44:45 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:44:45 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:44:45 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:44:45 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:44:45 user nova-compute[73917]:       <nova:owner>
Aug 26 19:44:45 user nova-compute[73917]:         <nova:user uuid="ed6fbe4e41ef4849934362d43ef97754">tempest-TestVolumeBootPattern-534408973-project-member</nova:user>
Aug 26 19:44:45 user nova-compute[73917]:         <nova:project uuid="7a6263f314fc43e8aa7a9e0b23f26162">tempest-TestVolumeBootPattern-534408973</nova:project>
Aug 26 19:44:45 user nova-compute[73917]:       </nova:owner>
Aug 26 19:44:45 user nova-compute[73917]:       <nova:root type="image" uuid="ba361b67-d3b8-4682-9818-4599ca1b444d"/>
Aug 26 19:44:45 user nova-compute[73917]:       <nova:ports>
Aug 26 19:44:45 user nova-compute[73917]:         <nova:port uuid="ba6d03f1-5496-4959-8b52-df859840f28e">
Aug 26 19:44:45 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 19:44:45 user nova-compute[73917]:         </nova:port>
Aug 26 19:44:45 user nova-compute[73917]:       </nova:ports>
Aug 26 19:44:45 user nova-compute[73917]:     </nova:instance>
Aug 26 19:44:45 user nova-compute[73917]:   </metadata>
Aug 26 19:44:45 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:44:45 user nova-compute[73917]:     <system>
Aug 26 19:44:45 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:44:45 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:44:45 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:44:45 user nova-compute[73917]:       <entry name="serial">afc847a8-d28c-48a4-bc27-78acd52c78aa</entry>
Aug 26 19:44:45 user nova-compute[73917]:       <entry name="uuid">afc847a8-d28c-48a4-bc27-78acd52c78aa</entry>
Aug 26 19:44:45 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:44:45 user nova-compute[73917]:     </system>
Aug 26 19:44:45 user nova-compute[73917]:   </sysinfo>
Aug 26 19:44:45 user nova-compute[73917]:   <os>
Aug 26 19:44:45 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:44:45 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:44:45 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:44:45 user nova-compute[73917]:   </os>
Aug 26 19:44:45 user nova-compute[73917]:   <features>
Aug 26 19:44:45 user nova-compute[73917]:     <acpi/>
Aug 26 19:44:45 user nova-compute[73917]:     <apic/>
Aug 26 19:44:45 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:44:45 user nova-compute[73917]:   </features>
Aug 26 19:44:45 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:44:45 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:44:45 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:44:45 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:44:45 user nova-compute[73917]:   </clock>
Aug 26 19:44:45 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:44:45 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:44:45 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:44:45 user nova-compute[73917]:   </cpu>
Aug 26 19:44:45 user nova-compute[73917]:   <devices>
Aug 26 19:44:45 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:44:45 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:44:45 user nova-compute[73917]:       <source dev="/dev/sdc"/>
Aug 26 19:44:45 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:44:45 user nova-compute[73917]:       <serial>b39e8856-c751-426e-9f55-42e77d53a2b9</serial>
Aug 26 19:44:45 user nova-compute[73917]:     </disk>
Aug 26 19:44:45 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:44:45 user nova-compute[73917]:       <mac address="fa:16:3e:a9:6e:61"/>
Aug 26 19:44:45 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:44:45 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:44:45 user nova-compute[73917]:       <target dev="tapba6d03f1-54"/>
Aug 26 19:44:45 user nova-compute[73917]:     </interface>
Aug 26 19:44:45 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:44:45 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/afc847a8-d28c-48a4-bc27-78acd52c78aa/console.log" append="off"/>
Aug 26 19:44:45 user nova-compute[73917]:     </serial>
Aug 26 19:44:45 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:44:45 user nova-compute[73917]:     <video>
Aug 26 19:44:45 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:44:45 user nova-compute[73917]:     </video>
Aug 26 19:44:45 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:44:45 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:44:45 user nova-compute[73917]:     </rng>
Aug 26 19:44:45 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:44:45 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:44:45 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:44:45 user nova-compute[73917]:     </memballoon>
Aug 26 19:44:45 user nova-compute[73917]:   </devices>
Aug 26 19:44:45 user nova-compute[73917]: </domain>
Aug 26 19:44:45 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:44:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:44:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-228676325',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-228676325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-228676325',id=49,image_ref='ba361b67-d3b8-4682-9818-4599ca1b444d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIs0oeqXcVrZNlG/7KVCMddDvbDY/Mz/kfJxzHMO5Sm/BvB3/43A14P61MiRq2O393UHCMQ2nlRc3PRr3+nw/beKoVwBo43vExCYc4Ko1q6sk3FpIOtZEuPcVM1Vp3T3OQ==',key_name='tempest-keypair-104109663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a6263f314fc43e8aa7a9e0b23f26162',ramdisk_id='',reservation_id='r-rrkr5x7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-534408973',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-534408973',owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:44:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed6fbe4e41ef4849934362d43ef97754',uuid=afc847a8-d28c-48a4-bc27-78acd52c78aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba6d03f1-5496-4959-8b52-df859840f28e", "address": "fa:16:3e:a9:6e:61", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6d03f1-54", "ovs_interfaceid": "ba6d03f1-5496-4959-8b52-df859840f28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:44:46 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converting VIF {"id": "ba6d03f1-5496-4959-8b52-df859840f28e", "address": "fa:16:3e:a9:6e:61", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6d03f1-54", "ovs_interfaceid": "ba6d03f1-5496-4959-8b52-df859840f28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:44:46 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:61,bridge_name='br-int',has_traffic_filtering=True,id=ba6d03f1-5496-4959-8b52-df859840f28e,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6d03f1-54') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:44:46 user nova-compute[73917]: DEBUG os_vif [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:61,bridge_name='br-int',has_traffic_filtering=True,id=ba6d03f1-5496-4959-8b52-df859840f28e,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6d03f1-54') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:44:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:44:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:44:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba6d03f1-54, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:44:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba6d03f1-54, col_values=(('external_ids', {'iface-id': 'ba6d03f1-5496-4959-8b52-df859840f28e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:6e:61', 'vm-uuid': 'afc847a8-d28c-48a4-bc27-78acd52c78aa'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:44:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:44:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:46 user nova-compute[73917]: INFO os_vif [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:61,bridge_name='br-int',has_traffic_filtering=True,id=ba6d03f1-5496-4959-8b52-df859840f28e,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6d03f1-54')
Aug 26 19:44:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:44:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] No VIF found with MAC fa:16:3e:a9:6e:61, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:44:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:47 user nova-compute[73917]: DEBUG nova.compute.manager [req-d3ef6e09-7f15-46ae-8931-e933f9fe213f req-24ea17df-4455-445e-9912-db0b94d36ea0 service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Received event network-vif-plugged-ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:44:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d3ef6e09-7f15-46ae-8931-e933f9fe213f req-24ea17df-4455-445e-9912-db0b94d36ea0 service nova] Acquiring lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:44:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d3ef6e09-7f15-46ae-8931-e933f9fe213f req-24ea17df-4455-445e-9912-db0b94d36ea0 service nova] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:44:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d3ef6e09-7f15-46ae-8931-e933f9fe213f req-24ea17df-4455-445e-9912-db0b94d36ea0 service nova] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:44:47 user nova-compute[73917]: DEBUG nova.compute.manager [req-d3ef6e09-7f15-46ae-8931-e933f9fe213f req-24ea17df-4455-445e-9912-db0b94d36ea0 service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] No waiting events found dispatching network-vif-plugged-ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:44:47 user nova-compute[73917]: WARNING nova.compute.manager [req-d3ef6e09-7f15-46ae-8931-e933f9fe213f req-24ea17df-4455-445e-9912-db0b94d36ea0 service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Received unexpected event network-vif-plugged-ba6d03f1-5496-4959-8b52-df859840f28e for instance with vm_state building and task_state spawning.
Aug 26 19:44:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:49 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693079089.5150003, afc847a8-d28c-48a4-bc27-78acd52c78aa => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:44:49 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] VM Resumed (Lifecycle Event)
Aug 26 19:44:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:44:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:44:49 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Instance spawned successfully.
Aug 26 19:44:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:44:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:44:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:44:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:44:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:44:49 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:44:49 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693079089.516427, afc847a8-d28c-48a4-bc27-78acd52c78aa => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:44:49 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] VM Started (Lifecycle Event)
Aug 26 19:44:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:44:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:44:49 user nova-compute[73917]: INFO nova.compute.manager [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Took 5.02 seconds to spawn the instance on the hypervisor.
Aug 26 19:44:49 user nova-compute[73917]: DEBUG nova.compute.manager [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:44:49 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:44:49 user nova-compute[73917]: DEBUG nova.compute.manager [req-9db3000a-73a9-4f66-9778-c406fdfae6d6 req-6c42fe8c-2f58-446c-9a45-0eb449219e0c service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Received event network-vif-plugged-ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:44:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9db3000a-73a9-4f66-9778-c406fdfae6d6 req-6c42fe8c-2f58-446c-9a45-0eb449219e0c service nova] Acquiring lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:44:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9db3000a-73a9-4f66-9778-c406fdfae6d6 req-6c42fe8c-2f58-446c-9a45-0eb449219e0c service nova] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:44:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9db3000a-73a9-4f66-9778-c406fdfae6d6 req-6c42fe8c-2f58-446c-9a45-0eb449219e0c service nova] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:44:49 user nova-compute[73917]: DEBUG nova.compute.manager [req-9db3000a-73a9-4f66-9778-c406fdfae6d6 req-6c42fe8c-2f58-446c-9a45-0eb449219e0c service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] No waiting events found dispatching network-vif-plugged-ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:44:49 user nova-compute[73917]: WARNING nova.compute.manager [req-9db3000a-73a9-4f66-9778-c406fdfae6d6 req-6c42fe8c-2f58-446c-9a45-0eb449219e0c service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Received unexpected event network-vif-plugged-ba6d03f1-5496-4959-8b52-df859840f28e for instance with vm_state building and task_state spawning.
Aug 26 19:44:49 user nova-compute[73917]: INFO nova.compute.manager [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Took 21.82 seconds to build instance.
Aug 26 19:44:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-60f8b9f3-814e-443c-a71b-92a26c523597 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.935s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:44:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 10.360s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:44:49 user nova-compute[73917]: INFO nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 26 19:44:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:44:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:44:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:45:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:45:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:45:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:45:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:45:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:45:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:45:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:45:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:45:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:45:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:45:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:45:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:45:17 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:45:17 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:45:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:45:19 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:45:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:45:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:45:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-f785be09-b4b9-414a-80d2-fc11f7480648" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:45:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-f785be09-b4b9-414a-80d2-fc11f7480648" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:45:19 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:45:19 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid f785be09-b4b9-414a-80d2-fc11f7480648 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:45:19 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Updating instance_info_cache with network_info: [{"id": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "address": "fa:16:3e:3b:a7:6c", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e65463-8c", "ovs_interfaceid": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:45:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-f785be09-b4b9-414a-80d2-fc11f7480648" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:45:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:45:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:45:21 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:45:23 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:45:23 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:45:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:45:27 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:45:27 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:45:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:45:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:45:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:45:27 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:45:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:45:27 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:45:27 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:45:27 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:45:27 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8694MB free_disk=25.156936645507812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:45:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:45:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:45:27 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f785be09-b4b9-414a-80d2-fc11f7480648 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:45:27 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance afc847a8-d28c-48a4-bc27-78acd52c78aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:45:27 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:45:27 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:45:27 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:45:27 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:45:28 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:45:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:45:30 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:45:30 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:45:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:45:32 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:45:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:45:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:45:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:45:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:45:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:45:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:45:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:45:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:45:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:45:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:46:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:46:18 user nova-compute[73917]: DEBUG nova.compute.manager [req-9c24d85c-94db-4a6d-a9b8-77d4c63656df req-bde50ace-0faa-4396-a57e-59f058a3863f service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Received event network-changed-ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:46:18 user nova-compute[73917]: DEBUG nova.compute.manager [req-9c24d85c-94db-4a6d-a9b8-77d4c63656df req-bde50ace-0faa-4396-a57e-59f058a3863f service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Refreshing instance network info cache due to event network-changed-ba6d03f1-5496-4959-8b52-df859840f28e. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:46:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9c24d85c-94db-4a6d-a9b8-77d4c63656df req-bde50ace-0faa-4396-a57e-59f058a3863f service nova] Acquiring lock "refresh_cache-afc847a8-d28c-48a4-bc27-78acd52c78aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:46:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9c24d85c-94db-4a6d-a9b8-77d4c63656df req-bde50ace-0faa-4396-a57e-59f058a3863f service nova] Acquired lock "refresh_cache-afc847a8-d28c-48a4-bc27-78acd52c78aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:46:18 user nova-compute[73917]: DEBUG nova.network.neutron [req-9c24d85c-94db-4a6d-a9b8-77d4c63656df req-bde50ace-0faa-4396-a57e-59f058a3863f service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Refreshing network info cache for port ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:46:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:19 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:46:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:46:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-afc847a8-d28c-48a4-bc27-78acd52c78aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:46:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "afc847a8-d28c-48a4-bc27-78acd52c78aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:46:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:46:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:46:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:46:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:46:19 user nova-compute[73917]: INFO nova.compute.manager [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Terminating instance
Aug 26 19:46:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:46:19 user nova-compute[73917]: DEBUG nova.network.neutron [req-9c24d85c-94db-4a6d-a9b8-77d4c63656df req-bde50ace-0faa-4396-a57e-59f058a3863f service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Updated VIF entry in instance network info cache for port ba6d03f1-5496-4959-8b52-df859840f28e. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:46:19 user nova-compute[73917]: DEBUG nova.network.neutron [req-9c24d85c-94db-4a6d-a9b8-77d4c63656df req-bde50ace-0faa-4396-a57e-59f058a3863f service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Updating instance_info_cache with network_info: [{"id": "ba6d03f1-5496-4959-8b52-df859840f28e", "address": "fa:16:3e:a9:6e:61", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6d03f1-54", "ovs_interfaceid": "ba6d03f1-5496-4959-8b52-df859840f28e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:46:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-9c24d85c-94db-4a6d-a9b8-77d4c63656df req-bde50ace-0faa-4396-a57e-59f058a3863f service nova] Releasing lock "refresh_cache-afc847a8-d28c-48a4-bc27-78acd52c78aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:46:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-afc847a8-d28c-48a4-bc27-78acd52c78aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:46:19 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:46:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG nova.compute.manager [req-6b7a9af8-93ae-4936-84a3-975b69c46226 req-6adeabab-f5a5-4368-8402-c83059402710 service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Received event network-vif-unplugged-ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6b7a9af8-93ae-4936-84a3-975b69c46226 req-6adeabab-f5a5-4368-8402-c83059402710 service nova] Acquiring lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6b7a9af8-93ae-4936-84a3-975b69c46226 req-6adeabab-f5a5-4368-8402-c83059402710 service nova] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-6b7a9af8-93ae-4936-84a3-975b69c46226 req-6adeabab-f5a5-4368-8402-c83059402710 service nova] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG nova.compute.manager [req-6b7a9af8-93ae-4936-84a3-975b69c46226 req-6adeabab-f5a5-4368-8402-c83059402710 service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] No waiting events found dispatching network-vif-unplugged-ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG nova.compute.manager [req-6b7a9af8-93ae-4936-84a3-975b69c46226 req-6adeabab-f5a5-4368-8402-c83059402710 service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Received event network-vif-unplugged-ba6d03f1-5496-4959-8b52-df859840f28e for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:20 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Instance destroyed successfully.
Aug 26 19:46:20 user nova-compute[73917]: DEBUG nova.objects.instance [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lazy-loading 'resources' on Instance uuid afc847a8-d28c-48a4-bc27-78acd52c78aa {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:44:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-228676325',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-228676325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-228676325',id=49,image_ref='ba361b67-d3b8-4682-9818-4599ca1b444d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIs0oeqXcVrZNlG/7KVCMddDvbDY/Mz/kfJxzHMO5Sm/BvB3/43A14P61MiRq2O393UHCMQ2nlRc3PRr3+nw/beKoVwBo43vExCYc4Ko1q6sk3FpIOtZEuPcVM1Vp3T3OQ==',key_name='tempest-keypair-104109663',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:44:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a6263f314fc43e8aa7a9e0b23f26162',ramdisk_id='',reservation_id='r-rrkr5x7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-534408973',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-534408973',owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:44:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed6fbe4e41ef4849934362d43ef97754',uuid=afc847a8-d28c-48a4-bc27-78acd52c78aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba6d03f1-5496-4959-8b52-df859840f28e", "address": "fa:16:3e:a9:6e:61", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6d03f1-54", "ovs_interfaceid": "ba6d03f1-5496-4959-8b52-df859840f28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converting VIF {"id": "ba6d03f1-5496-4959-8b52-df859840f28e", "address": "fa:16:3e:a9:6e:61", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6d03f1-54", "ovs_interfaceid": "ba6d03f1-5496-4959-8b52-df859840f28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:61,bridge_name='br-int',has_traffic_filtering=True,id=ba6d03f1-5496-4959-8b52-df859840f28e,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6d03f1-54') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG os_vif [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:61,bridge_name='br-int',has_traffic_filtering=True,id=ba6d03f1-5496-4959-8b52-df859840f28e,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6d03f1-54') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba6d03f1-54, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:46:20 user nova-compute[73917]: INFO os_vif [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:61,bridge_name='br-int',has_traffic_filtering=True,id=ba6d03f1-5496-4959-8b52-df859840f28e,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6d03f1-54')
Aug 26 19:46:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wHQpPvJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:46:20 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:46:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ef8ac9-377e-4cb5-a8d8-264023d0df94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7b9a18-b1ee-4848-a16c-b8b843b55eee]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d (non-flash)
Aug 26 19:46:20 user nova-compute[73917]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 (non-flash)
Aug 26 19:46:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d (non-flash)
Aug 26 19:46:20 user nova-compute[73917]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 (non-flash)
Aug 26 19:46:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b7870b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9'): ({'sdc'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Removing single pathed devices sdc {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0669bebd-cc54-4fb8-a1d3-87ef2fcabb0f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5fec10-8d90-417e-a3f9-6e2db9772752]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Flushing IO for device /dev/sdc {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6626435d-385a-4e0b-a9c9-326d44176d4d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Updating instance_info_cache with network_info: [{"id": "ba6d03f1-5496-4959-8b52-df859840f28e", "address": "fa:16:3e:a9:6e:61", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6d03f1-54", "ovs_interfaceid": "ba6d03f1-5496-4959-8b52-df859840f28e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-afc847a8-d28c-48a4-bc27-78acd52c78aa" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf772e5-7e1d-47ed-b566-379d1895d50f]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23864666530633532', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8992c5f7', '/dev/disk/by-id/scsi-1SCST_BIO8992c5f7-8dfe0c52dedaefcb') {{(pid=85467) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6f8a35-89fb-4287-a1a7-6304dab39316]: (4, None) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[00692576-923e-4d01-b1cb-b29e31fd09fb]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef2f98a-8240-4135-ae6c-4ed8a8fbb31d]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9, portal: 172.16.0.220,3260]
Aug 26 19:46:20 user nova-compute[73917]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9, portal: 172.16.0.220,3260] successful.
Aug 26 19:46:20 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39e8856-c751-426e-9f55-42e77d53a2b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4edecf3-0fed-498f-8594-736a4fc4fef1]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] <== disconnect_volume: return (322ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:46:20 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Deleting instance files /opt/stack/data/nova/instances/afc847a8-d28c-48a4-bc27-78acd52c78aa_del
Aug 26 19:46:20 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Deletion of /opt/stack/data/nova/instances/afc847a8-d28c-48a4-bc27-78acd52c78aa_del complete
Aug 26 19:46:20 user nova-compute[73917]: INFO nova.compute.manager [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 26 19:46:20 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:46:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Received event network-vif-plugged-ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:46:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] Acquiring lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:46:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:46:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:46:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] No waiting events found dispatching network-vif-plugged-ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:46:22 user nova-compute[73917]: WARNING nova.compute.manager [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Received unexpected event network-vif-plugged-ba6d03f1-5496-4959-8b52-df859840f28e for instance with vm_state active and task_state deleting.
Aug 26 19:46:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Received event network-vif-plugged-ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:46:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] Acquiring lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:46:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:46:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:46:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] No waiting events found dispatching network-vif-plugged-ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:46:22 user nova-compute[73917]: WARNING nova.compute.manager [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Received unexpected event network-vif-plugged-ba6d03f1-5496-4959-8b52-df859840f28e for instance with vm_state active and task_state deleting.
Aug 26 19:46:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Received event network-vif-plugged-ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:46:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] Acquiring lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:46:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:46:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:46:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] No waiting events found dispatching network-vif-plugged-ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:46:22 user nova-compute[73917]: WARNING nova.compute.manager [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Received unexpected event network-vif-plugged-ba6d03f1-5496-4959-8b52-df859840f28e for instance with vm_state active and task_state deleting.
Aug 26 19:46:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Received event network-vif-unplugged-ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:46:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] Acquiring lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:46:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:46:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:46:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] No waiting events found dispatching network-vif-unplugged-ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:46:22 user nova-compute[73917]: DEBUG nova.compute.manager [req-0a29557c-68ee-412c-ac9a-ee0df940b953 req-a8604d96-2a40-4451-b069-a46c647e434f service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Received event network-vif-unplugged-ba6d03f1-5496-4959-8b52-df859840f28e for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:46:22 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:46:22 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Took 1.57 seconds to deallocate network for instance.
Aug 26 19:46:23 user nova-compute[73917]: INFO nova.compute.manager [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Took 0.78 seconds to detach 1 volumes for instance.
Aug 26 19:46:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Deleting volume: b39e8856-c751-426e-9f55-42e77d53a2b9 {{(pid=73917) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 19:46:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:46:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:46:23 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:46:23 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:46:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:46:23 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Deleted allocations for instance afc847a8-d28c-48a4-bc27-78acd52c78aa
Aug 26 19:46:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-03d42fbe-5996-43e7-bd10-9f58e76533c6 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.996s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:46:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-a9334cda-8cc2-4ead-8bb1-8498879acc20 req-db8bd39e-8c52-4aab-9bd1-6aa2e5daf06c service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Received event network-vif-plugged-ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:46:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a9334cda-8cc2-4ead-8bb1-8498879acc20 req-db8bd39e-8c52-4aab-9bd1-6aa2e5daf06c service nova] Acquiring lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:46:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a9334cda-8cc2-4ead-8bb1-8498879acc20 req-db8bd39e-8c52-4aab-9bd1-6aa2e5daf06c service nova] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:46:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a9334cda-8cc2-4ead-8bb1-8498879acc20 req-db8bd39e-8c52-4aab-9bd1-6aa2e5daf06c service nova] Lock "afc847a8-d28c-48a4-bc27-78acd52c78aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:46:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-a9334cda-8cc2-4ead-8bb1-8498879acc20 req-db8bd39e-8c52-4aab-9bd1-6aa2e5daf06c service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] No waiting events found dispatching network-vif-plugged-ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:46:24 user nova-compute[73917]: WARNING nova.compute.manager [req-a9334cda-8cc2-4ead-8bb1-8498879acc20 req-db8bd39e-8c52-4aab-9bd1-6aa2e5daf06c service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Received unexpected event network-vif-plugged-ba6d03f1-5496-4959-8b52-df859840f28e for instance with vm_state deleted and task_state None.
Aug 26 19:46:24 user nova-compute[73917]: DEBUG nova.compute.manager [req-a9334cda-8cc2-4ead-8bb1-8498879acc20 req-db8bd39e-8c52-4aab-9bd1-6aa2e5daf06c service nova] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Received event network-vif-deleted-ba6d03f1-5496-4959-8b52-df859840f28e {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:46:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:25 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:46:25 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:46:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:28 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:46:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:46:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:46:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:46:28 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:46:28 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:46:28 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:46:28 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:46:28 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8765MB free_disk=25.148189544677734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:46:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:46:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:46:28 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance f785be09-b4b9-414a-80d2-fc11f7480648 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:46:28 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:46:28 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:46:28 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:46:28 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:46:28 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:46:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:46:29 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:46:30 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:46:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:46:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:46:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:46:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:46:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:31 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:46:32 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:46:35 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693079180.3576624, afc847a8-d28c-48a4-bc27-78acd52c78aa => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:46:35 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] VM Stopped (Lifecycle Event)
Aug 26 19:46:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-52c8b876-64e2-40c8-833a-0ef013ae9172 None None] [instance: afc847a8-d28c-48a4-bc27-78acd52c78aa] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:46:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:46:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:46:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:47:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:47:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:47:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:47:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:47:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:47:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:47:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:47:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:47:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:47:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "f785be09-b4b9-414a-80d2-fc11f7480648" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:47:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "f785be09-b4b9-414a-80d2-fc11f7480648" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:47:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "f785be09-b4b9-414a-80d2-fc11f7480648-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:47:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "f785be09-b4b9-414a-80d2-fc11f7480648-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:47:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "f785be09-b4b9-414a-80d2-fc11f7480648-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:47:16 user nova-compute[73917]: INFO nova.compute.manager [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Terminating instance
Aug 26 19:47:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:47:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:47:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:47:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:47:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:47:16 user nova-compute[73917]: DEBUG nova.compute.manager [req-a48f0836-e17e-440a-a021-780f0b682eaa req-edcf1afc-0efc-48ea-af9c-c37b54fff0ce service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Received event network-vif-unplugged-06e65463-8cb5-49a8-ab9b-958fd7b7f89b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:47:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a48f0836-e17e-440a-a021-780f0b682eaa req-edcf1afc-0efc-48ea-af9c-c37b54fff0ce service nova] Acquiring lock "f785be09-b4b9-414a-80d2-fc11f7480648-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:47:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a48f0836-e17e-440a-a021-780f0b682eaa req-edcf1afc-0efc-48ea-af9c-c37b54fff0ce service nova] Lock "f785be09-b4b9-414a-80d2-fc11f7480648-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:47:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a48f0836-e17e-440a-a021-780f0b682eaa req-edcf1afc-0efc-48ea-af9c-c37b54fff0ce service nova] Lock "f785be09-b4b9-414a-80d2-fc11f7480648-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:47:16 user nova-compute[73917]: DEBUG nova.compute.manager [req-a48f0836-e17e-440a-a021-780f0b682eaa req-edcf1afc-0efc-48ea-af9c-c37b54fff0ce service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] No waiting events found dispatching network-vif-unplugged-06e65463-8cb5-49a8-ab9b-958fd7b7f89b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:47:16 user nova-compute[73917]: DEBUG nova.compute.manager [req-a48f0836-e17e-440a-a021-780f0b682eaa req-edcf1afc-0efc-48ea-af9c-c37b54fff0ce service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Received event network-vif-unplugged-06e65463-8cb5-49a8-ab9b-958fd7b7f89b for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:47:17 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Instance destroyed successfully.
Aug 26 19:47:17 user nova-compute[73917]: DEBUG nova.objects.instance [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lazy-loading 'resources' on Instance uuid f785be09-b4b9-414a-80d2-fc11f7480648 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:42:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-145050299',display_name='tempest-TestVolumeBootPattern-volume-backed-server-145050299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-145050299',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArG16KWE0zIOWqhR4AduIVAFqXEU7C2wzmjgGhMiq6JvhIDoa/P51UMVM0gQj3yRtURvw7IaQb/n0b9Z7F7gvz9fBJ78yjOFhtR+DYBQ01QajXniWrLC4PQh0LnXbo8uw==',key_name='tempest-keypair-1415645027',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:42:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a6263f314fc43e8aa7a9e0b23f26162',ramdisk_id='',reservation_id='r-9vtbd8ag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-534408973',owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:42:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed6fbe4e41ef4849934362d43ef97754',uuid=f785be09-b4b9-414a-80d2-fc11f7480648,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "address": "fa:16:3e:3b:a7:6c", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e65463-8c", "ovs_interfaceid": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converting VIF {"id": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "address": "fa:16:3e:3b:a7:6c", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e65463-8c", "ovs_interfaceid": "06e65463-8cb5-49a8-ab9b-958fd7b7f89b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:a7:6c,bridge_name='br-int',has_traffic_filtering=True,id=06e65463-8cb5-49a8-ab9b-958fd7b7f89b,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e65463-8c') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG os_vif [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:a7:6c,bridge_name='br-int',has_traffic_filtering=True,id=06e65463-8cb5-49a8-ab9b-958fd7b7f89b,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e65463-8c') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06e65463-8c, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:47:17 user nova-compute[73917]: INFO os_vif [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:a7:6c,bridge_name='br-int',has_traffic_filtering=True,id=06e65463-8cb5-49a8-ab9b-958fd7b7f89b,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e65463-8c')
Aug 26 19:47:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoNfWxdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:47:17 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:47:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[08932369-32ba-4cc0-b12a-e135a5b78744]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[184b367b-6bc8-4d4d-8f11-e30fc940be42]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d (non-flash)
Aug 26 19:47:17 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d (non-flash)
Aug 26 19:47:17 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b78565f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d'): ({'sdb'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Removing single pathed devices sdb {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[33521fbc-0e6a-4449-9f58-da90ed0a5b02]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dc26d3-357c-4658-80ac-8c1fe726574a]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Flushing IO for device /dev/sdb {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdacd5c-dc44-4e7d-971d-262cb4714edb]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[042dab42-095a-48f0-8641-e7c98b657aa1]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_cd67e0e4', '/dev/disk/by-id/scsi-23334353161383037', '/dev/disk/by-id/scsi-1SCST_BIOcd67e0e4-3451a8079270d48a') {{(pid=85467) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc75b4a-16d0-4a1e-8a5a-9aad5ab61166]: (4, None) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f95677-1eaf-4fad-a2c0-7c2d3c8c2704]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[73252929-055b-4019-bf54-a02517a34f18]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d, portal: 172.16.0.220,3260]
Aug 26 19:47:17 user nova-compute[73917]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d, portal: 172.16.0.220,3260] successful.
Aug 26 19:47:17 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0b1e863-b5b4-4840-9967-df04b2c7864d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35c5940-251a-40b1-8439-2574f973e11d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] <== disconnect_volume: return (254ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:47:17 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Deleting instance files /opt/stack/data/nova/instances/f785be09-b4b9-414a-80d2-fc11f7480648_del
Aug 26 19:47:17 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Deletion of /opt/stack/data/nova/instances/f785be09-b4b9-414a-80d2-fc11f7480648_del complete
Aug 26 19:47:17 user nova-compute[73917]: INFO nova.compute.manager [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 26 19:47:17 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:47:17 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:47:18 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:47:18 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Took 0.83 seconds to deallocate network for instance.
Aug 26 19:47:18 user nova-compute[73917]: DEBUG nova.compute.manager [req-c4f62dbd-155c-4558-a5d4-e449c8660c03 req-9e39a1b5-f77f-41af-97c7-ec337e120604 service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Received event network-vif-plugged-06e65463-8cb5-49a8-ab9b-958fd7b7f89b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:47:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c4f62dbd-155c-4558-a5d4-e449c8660c03 req-9e39a1b5-f77f-41af-97c7-ec337e120604 service nova] Acquiring lock "f785be09-b4b9-414a-80d2-fc11f7480648-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:47:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c4f62dbd-155c-4558-a5d4-e449c8660c03 req-9e39a1b5-f77f-41af-97c7-ec337e120604 service nova] Lock "f785be09-b4b9-414a-80d2-fc11f7480648-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:47:18 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-c4f62dbd-155c-4558-a5d4-e449c8660c03 req-9e39a1b5-f77f-41af-97c7-ec337e120604 service nova] Lock "f785be09-b4b9-414a-80d2-fc11f7480648-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:47:18 user nova-compute[73917]: DEBUG nova.compute.manager [req-c4f62dbd-155c-4558-a5d4-e449c8660c03 req-9e39a1b5-f77f-41af-97c7-ec337e120604 service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] No waiting events found dispatching network-vif-plugged-06e65463-8cb5-49a8-ab9b-958fd7b7f89b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:47:18 user nova-compute[73917]: WARNING nova.compute.manager [req-c4f62dbd-155c-4558-a5d4-e449c8660c03 req-9e39a1b5-f77f-41af-97c7-ec337e120604 service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Received unexpected event network-vif-plugged-06e65463-8cb5-49a8-ab9b-958fd7b7f89b for instance with vm_state active and task_state deleting.
Aug 26 19:47:18 user nova-compute[73917]: DEBUG nova.compute.manager [req-c4f62dbd-155c-4558-a5d4-e449c8660c03 req-9e39a1b5-f77f-41af-97c7-ec337e120604 service nova] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Received event network-vif-deleted-06e65463-8cb5-49a8-ab9b-958fd7b7f89b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:47:19 user nova-compute[73917]: INFO nova.compute.manager [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Took 0.74 seconds to detach 1 volumes for instance.
Aug 26 19:47:19 user nova-compute[73917]: DEBUG nova.compute.manager [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Deleting volume: c0b1e863-b5b4-4840-9967-df04b2c7864d {{(pid=73917) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 19:47:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:47:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:47:19 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:47:19 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:47:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.104s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:47:19 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Deleted allocations for instance f785be09-b4b9-414a-80d2-fc11f7480648
Aug 26 19:47:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-13437ad6-d0da-4a7d-a1f4-56aaf7f63797 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "f785be09-b4b9-414a-80d2-fc11f7480648" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.025s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:47:20 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:47:20 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:47:20 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:47:20 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Didn't find any instances for network info cache update. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 19:47:20 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:47:20 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:47:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:47:24 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:47:26 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:47:26 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:47:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:47:30 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:47:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:47:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:47:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:47:30 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:47:30 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:47:30 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:47:30 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8919MB free_disk=25.147323608398438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:47:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:47:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:47:30 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:47:30 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:47:30 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:47:30 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:47:30 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:47:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:47:31 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:47:31 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:47:32 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693079237.1032023, f785be09-b4b9-414a-80d2-fc11f7480648 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:47:32 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] VM Stopped (Lifecycle Event)
Aug 26 19:47:32 user nova-compute[73917]: DEBUG nova.compute.manager [None req-b00e1f1b-100b-4bdd-8634-d3336b6b613b None None] [instance: f785be09-b4b9-414a-80d2-fc11f7480648] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:47:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:47:32 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:47:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:47:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:47:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:47:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:47:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:47:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:47:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:47:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:47:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:47:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:47:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:47:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:47:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:47:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:47:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:47:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:48:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:48:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:48:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:48:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:48:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:48:21 user nova-compute[73917]: INFO nova.compute.claims [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Claim successful on node user
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Skipping network cache update for instance because it is Building. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Didn't find any instances for network info cache update. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.189s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG nova.network.neutron [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:48:21 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:48:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:48:21 user nova-compute[73917]: INFO nova.virt.block_device [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Booting with volume 22b72135-dd05-40c9-980e-9e71448e7e85 at /dev/vda
Aug 26 19:48:21 user nova-compute[73917]: DEBUG os_brick.utils [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG nova.policy [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed6fbe4e41ef4849934362d43ef97754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6263f314fc43e8aa7a9e0b23f26162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[388ccf31-fd93-45ed-b138-9d720bd66a1e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafb291d-135e-4ec6-b97b-91c04f077b7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a40880-e5eb-4d61-9ebf-ffdcec942e75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36fcba6-a5e6-4d8f-9661-f4642f980bbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:48:21 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:48:21 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d31d8a3-6e0c-408b-81a7-16f3e3aafa87]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG os_brick.utils [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:48:21 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Updating existing volume attachment record: 5cb6f62d-32aa-4d5c-a151-92962dcc67aa {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:48:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:22 user nova-compute[73917]: DEBUG nova.network.neutron [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Successfully created port: 37ab4546-3a47-4e0f-815a-db3528624a7b {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:48:22 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:48:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:48:23 user nova-compute[73917]: DEBUG nova.network.neutron [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Successfully updated port: 37ab4546-3a47-4e0f-815a-db3528624a7b {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:48:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "refresh_cache-26bf9ef7-292c-45b4-a02c-dc3b075c5274" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:48:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquired lock "refresh_cache-26bf9ef7-292c-45b4-a02c-dc3b075c5274" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:48:23 user nova-compute[73917]: DEBUG nova.network.neutron [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:48:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-0304099c-b97d-45e7-990c-810c180e1769 req-3d5ddb6e-9318-4123-9d81-131520472c2a service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Received event network-changed-37ab4546-3a47-4e0f-815a-db3528624a7b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:48:23 user nova-compute[73917]: DEBUG nova.compute.manager [req-0304099c-b97d-45e7-990c-810c180e1769 req-3d5ddb6e-9318-4123-9d81-131520472c2a service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Refreshing instance network info cache due to event network-changed-37ab4546-3a47-4e0f-815a-db3528624a7b. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:48:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0304099c-b97d-45e7-990c-810c180e1769 req-3d5ddb6e-9318-4123-9d81-131520472c2a service nova] Acquiring lock "refresh_cache-26bf9ef7-292c-45b4-a02c-dc3b075c5274" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:48:23 user nova-compute[73917]: DEBUG nova.network.neutron [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:48:23 user nova-compute[73917]: DEBUG nova.network.neutron [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Updating instance_info_cache with network_info: [{"id": "37ab4546-3a47-4e0f-815a-db3528624a7b", "address": "fa:16:3e:e2:0a:ea", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ab4546-3a", "ovs_interfaceid": "37ab4546-3a47-4e0f-815a-db3528624a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:48:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Releasing lock "refresh_cache-26bf9ef7-292c-45b4-a02c-dc3b075c5274" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:48:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Instance network_info: |[{"id": "37ab4546-3a47-4e0f-815a-db3528624a7b", "address": "fa:16:3e:e2:0a:ea", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ab4546-3a", "ovs_interfaceid": "37ab4546-3a47-4e0f-815a-db3528624a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:48:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0304099c-b97d-45e7-990c-810c180e1769 req-3d5ddb6e-9318-4123-9d81-131520472c2a service nova] Acquired lock "refresh_cache-26bf9ef7-292c-45b4-a02c-dc3b075c5274" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:48:23 user nova-compute[73917]: DEBUG nova.network.neutron [req-0304099c-b97d-45e7-990c-810c180e1769 req-3d5ddb6e-9318-4123-9d81-131520472c2a service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Refreshing network info cache for port 37ab4546-3a47-4e0f-815a-db3528624a7b {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:48:23 user nova-compute[73917]: DEBUG nova.network.neutron [req-0304099c-b97d-45e7-990c-810c180e1769 req-3d5ddb6e-9318-4123-9d81-131520472c2a service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Updated VIF entry in instance network info cache for port 37ab4546-3a47-4e0f-815a-db3528624a7b. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:48:23 user nova-compute[73917]: DEBUG nova.network.neutron [req-0304099c-b97d-45e7-990c-810c180e1769 req-3d5ddb6e-9318-4123-9d81-131520472c2a service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Updating instance_info_cache with network_info: [{"id": "37ab4546-3a47-4e0f-815a-db3528624a7b", "address": "fa:16:3e:e2:0a:ea", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ab4546-3a", "ovs_interfaceid": "37ab4546-3a47-4e0f-815a-db3528624a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:48:23 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-0304099c-b97d-45e7-990c-810c180e1769 req-3d5ddb6e-9318-4123-9d81-131520472c2a service nova] Releasing lock "refresh_cache-26bf9ef7-292c-45b4-a02c-dc3b075c5274" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:48:24 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:48:26 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:48:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73917) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 19:48:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:48:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:48:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:48:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:48:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:27 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.compute.manager [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:48:32 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Creating image(s)
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Did not create local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Ensure instance console log exists: /opt/stack/data/nova/instances/26bf9ef7-292c-45b4-a02c-dc3b075c5274/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Start _get_guest_xml network_info=[{"id": "37ab4546-3a47-4e0f-815a-db3528624a7b", "address": "fa:16:3e:e2:0a:ea", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ab4546-3a", "ovs_interfaceid": "37ab4546-3a47-4e0f-815a-db3528624a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEUroyPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '26bf9ef7-292c-45b4-a02c-dc3b075c5274', 'attached_at': '', 'detached_at': '', 'volume_id': '22b72135-dd05-40c9-980e-9e71448e7e85', 'serial': '22b72135-dd05-40c9-980e-9e71448e7e85'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '5cb6f62d-32aa-4d5c-a151-92962dcc67aa', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:48:32 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:48:32 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEUroyPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:48:32 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:48:32 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:48:32 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:48:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[693bfb65-d772-42ff-8b0c-440b474ae32f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:48:32 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[eceb48da-52ba-4317-bb59-19822b340301]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85] added
Aug 26 19:48:32 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a0350a-8c12-431e-b82b-ad9358e5b35d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[309273e9-2b98-43bb-8302-16796e0bd7a1]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gEUroyPQ {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gEUroyPQ" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ab0af7-9456-4bd1-95a7-4706758f07e7]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gEUroyPQ'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[38083c63-1837-469d-b219-a3ac8140c5da]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[75866018-09c5-4de6-abdb-b6e202fe65dd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 19:48:32 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 19:48:32 user nova-compute[73917]:  {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:48:32 user nova-compute[73917]: WARNING os_brick.initiator.connectors.iscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 19:48:32 user nova-compute[73917]: 
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c71f182-8a35-4676-bf52-32691dea468b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85, portal: 172.16.0.220,3260]
Aug 26 19:48:32 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85, portal: 172.16.0.220,3260] successful.
Aug 26 19:48:32 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:48:32 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:48:32 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8929MB free_disk=25.145851135253906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[614ccdbf-c59f-47ff-bc2f-2378ddf64682]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a0305d-6a93-498b-ab17-f6b2bbb8a1cd]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)
Aug 26 19:48:32 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)
Aug 26 19:48:32 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.535s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2e39be-4b00-460e-a232-441e73e41e81]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 26bf9ef7-292c-45b4-a02c-dc3b075c5274 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing inventories for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating ProviderTree inventory for provider d90ad23a-e063-4f0d-8341-c34e0141d16a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating inventory in ProviderTree for provider d90ad23a-e063-4f0d-8341-c34e0141d16a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing aggregate associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, aggregates: None {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing trait associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:48:32 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEUroyPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.567s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] <== connect_volume: return (1568ms) {'type': 'block', 'scsi_wwn': '23962383362653765', 'path': '/dev/sdb'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962383362653765', 'path': '/dev/sdb'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1355368441',display_name='tempest-TestVolumeBootPattern-server-1355368441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1355368441',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqOTuWaVQuR1bJ4mXv25/X0179C/SIJgYNBbfkXIuPGnpXFoY3qyn53WKpsBuWyeYwqkadyQdEa1ypBhwuuI/YSnnWyuuNyjACHQ3vbFr+8kYRNqgtXOUIeLTy7CgMupw==',key_name='tempest-TestVolumeBootPattern-1387621208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a6263f314fc43e8aa7a9e0b23f26162',ramdisk_id='',reservation_id='r-qwzlvtpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-534408973',owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:48:22Z,user_data=None,user_id='ed6fbe4e41ef4849934362d43ef97754',uuid=26bf9ef7-292c-45b4-a02c-dc3b075c5274,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37ab4546-3a47-4e0f-815a-db3528624a7b", "address": "fa:16:3e:e2:0a:ea", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ab4546-3a", "ovs_interfaceid": "37ab4546-3a47-4e0f-815a-db3528624a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converting VIF {"id": "37ab4546-3a47-4e0f-815a-db3528624a7b", "address": "fa:16:3e:e2:0a:ea", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ab4546-3a", "ovs_interfaceid": "37ab4546-3a47-4e0f-815a-db3528624a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0a:ea,bridge_name='br-int',has_traffic_filtering=True,id=37ab4546-3a47-4e0f-815a-db3528624a7b,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ab4546-3a') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG nova.objects.instance [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lazy-loading 'pci_devices' on Instance uuid 26bf9ef7-292c-45b4-a02c-dc3b075c5274 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:48:33 user nova-compute[73917]:   <uuid>26bf9ef7-292c-45b4-a02c-dc3b075c5274</uuid>
Aug 26 19:48:33 user nova-compute[73917]:   <name>instance-00000032</name>
Aug 26 19:48:33 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:48:33 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:48:33 user nova-compute[73917]:   <metadata>
Aug 26 19:48:33 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:48:33 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:48:33 user nova-compute[73917]:       <nova:name>tempest-TestVolumeBootPattern-server-1355368441</nova:name>
Aug 26 19:48:33 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:48:32</nova:creationTime>
Aug 26 19:48:33 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:48:33 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:48:33 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:48:33 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:48:33 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:48:33 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:48:33 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:48:33 user nova-compute[73917]:       <nova:owner>
Aug 26 19:48:33 user nova-compute[73917]:         <nova:user uuid="ed6fbe4e41ef4849934362d43ef97754">tempest-TestVolumeBootPattern-534408973-project-member</nova:user>
Aug 26 19:48:33 user nova-compute[73917]:         <nova:project uuid="7a6263f314fc43e8aa7a9e0b23f26162">tempest-TestVolumeBootPattern-534408973</nova:project>
Aug 26 19:48:33 user nova-compute[73917]:       </nova:owner>
Aug 26 19:48:33 user nova-compute[73917]:       <nova:ports>
Aug 26 19:48:33 user nova-compute[73917]:         <nova:port uuid="37ab4546-3a47-4e0f-815a-db3528624a7b">
Aug 26 19:48:33 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 19:48:33 user nova-compute[73917]:         </nova:port>
Aug 26 19:48:33 user nova-compute[73917]:       </nova:ports>
Aug 26 19:48:33 user nova-compute[73917]:     </nova:instance>
Aug 26 19:48:33 user nova-compute[73917]:   </metadata>
Aug 26 19:48:33 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:48:33 user nova-compute[73917]:     <system>
Aug 26 19:48:33 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:48:33 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:48:33 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:48:33 user nova-compute[73917]:       <entry name="serial">26bf9ef7-292c-45b4-a02c-dc3b075c5274</entry>
Aug 26 19:48:33 user nova-compute[73917]:       <entry name="uuid">26bf9ef7-292c-45b4-a02c-dc3b075c5274</entry>
Aug 26 19:48:33 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:48:33 user nova-compute[73917]:     </system>
Aug 26 19:48:33 user nova-compute[73917]:   </sysinfo>
Aug 26 19:48:33 user nova-compute[73917]:   <os>
Aug 26 19:48:33 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:48:33 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:48:33 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:48:33 user nova-compute[73917]:   </os>
Aug 26 19:48:33 user nova-compute[73917]:   <features>
Aug 26 19:48:33 user nova-compute[73917]:     <acpi/>
Aug 26 19:48:33 user nova-compute[73917]:     <apic/>
Aug 26 19:48:33 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:48:33 user nova-compute[73917]:   </features>
Aug 26 19:48:33 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:48:33 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:48:33 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:48:33 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:48:33 user nova-compute[73917]:   </clock>
Aug 26 19:48:33 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:48:33 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:48:33 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:48:33 user nova-compute[73917]:   </cpu>
Aug 26 19:48:33 user nova-compute[73917]:   <devices>
Aug 26 19:48:33 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:48:33 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:48:33 user nova-compute[73917]:       <source dev="/dev/sdb"/>
Aug 26 19:48:33 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:48:33 user nova-compute[73917]:       <serial>22b72135-dd05-40c9-980e-9e71448e7e85</serial>
Aug 26 19:48:33 user nova-compute[73917]:     </disk>
Aug 26 19:48:33 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:48:33 user nova-compute[73917]:       <mac address="fa:16:3e:e2:0a:ea"/>
Aug 26 19:48:33 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:48:33 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:48:33 user nova-compute[73917]:       <target dev="tap37ab4546-3a"/>
Aug 26 19:48:33 user nova-compute[73917]:     </interface>
Aug 26 19:48:33 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:48:33 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/26bf9ef7-292c-45b4-a02c-dc3b075c5274/console.log" append="off"/>
Aug 26 19:48:33 user nova-compute[73917]:     </serial>
Aug 26 19:48:33 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:48:33 user nova-compute[73917]:     <video>
Aug 26 19:48:33 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:48:33 user nova-compute[73917]:     </video>
Aug 26 19:48:33 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:48:33 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:48:33 user nova-compute[73917]:     </rng>
Aug 26 19:48:33 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:48:33 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:48:33 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:48:33 user nova-compute[73917]:     </memballoon>
Aug 26 19:48:33 user nova-compute[73917]:   </devices>
Aug 26 19:48:33 user nova-compute[73917]: </domain>
Aug 26 19:48:33 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1355368441',display_name='tempest-TestVolumeBootPattern-server-1355368441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1355368441',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqOTuWaVQuR1bJ4mXv25/X0179C/SIJgYNBbfkXIuPGnpXFoY3qyn53WKpsBuWyeYwqkadyQdEa1ypBhwuuI/YSnnWyuuNyjACHQ3vbFr+8kYRNqgtXOUIeLTy7CgMupw==',key_name='tempest-TestVolumeBootPattern-1387621208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a6263f314fc43e8aa7a9e0b23f26162',ramdisk_id='',reservation_id='r-qwzlvtpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-534408973',owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:48:22Z,user_data=None,user_id='ed6fbe4e41ef4849934362d43ef97754',uuid=26bf9ef7-292c-45b4-a02c-dc3b075c5274,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37ab4546-3a47-4e0f-815a-db3528624a7b", "address": "fa:16:3e:e2:0a:ea", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ab4546-3a", "ovs_interfaceid": "37ab4546-3a47-4e0f-815a-db3528624a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converting VIF {"id": "37ab4546-3a47-4e0f-815a-db3528624a7b", "address": "fa:16:3e:e2:0a:ea", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ab4546-3a", "ovs_interfaceid": "37ab4546-3a47-4e0f-815a-db3528624a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0a:ea,bridge_name='br-int',has_traffic_filtering=True,id=37ab4546-3a47-4e0f-815a-db3528624a7b,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ab4546-3a') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG os_vif [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0a:ea,bridge_name='br-int',has_traffic_filtering=True,id=37ab4546-3a47-4e0f-815a-db3528624a7b,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ab4546-3a') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37ab4546-3a, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37ab4546-3a, col_values=(('external_ids', {'iface-id': '37ab4546-3a47-4e0f-815a-db3528624a7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:0a:ea', 'vm-uuid': '26bf9ef7-292c-45b4-a02c-dc3b075c5274'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:33 user nova-compute[73917]: INFO os_vif [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0a:ea,bridge_name='br-int',has_traffic_filtering=True,id=37ab4546-3a47-4e0f-815a-db3528624a7b,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ab4546-3a')
Aug 26 19:48:33 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:48:33 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] No VIF found with MAC fa:16:3e:e2:0a:ea, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:48:34 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:48:34 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:48:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:35 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:48:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-50eccccd-900a-468f-9848-7bb6e6a1767d req-1f5659c0-f465-4586-8631-84fdfafeeaf6 service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Received event network-vif-plugged-37ab4546-3a47-4e0f-815a-db3528624a7b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:48:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-50eccccd-900a-468f-9848-7bb6e6a1767d req-1f5659c0-f465-4586-8631-84fdfafeeaf6 service nova] Acquiring lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:48:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-50eccccd-900a-468f-9848-7bb6e6a1767d req-1f5659c0-f465-4586-8631-84fdfafeeaf6 service nova] Lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:48:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-50eccccd-900a-468f-9848-7bb6e6a1767d req-1f5659c0-f465-4586-8631-84fdfafeeaf6 service nova] Lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:48:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-50eccccd-900a-468f-9848-7bb6e6a1767d req-1f5659c0-f465-4586-8631-84fdfafeeaf6 service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] No waiting events found dispatching network-vif-plugged-37ab4546-3a47-4e0f-815a-db3528624a7b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:48:35 user nova-compute[73917]: WARNING nova.compute.manager [req-50eccccd-900a-468f-9848-7bb6e6a1767d req-1f5659c0-f465-4586-8631-84fdfafeeaf6 service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Received unexpected event network-vif-plugged-37ab4546-3a47-4e0f-815a-db3528624a7b for instance with vm_state building and task_state spawning.
Aug 26 19:48:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:37 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693079317.0546794, 26bf9ef7-292c-45b4-a02c-dc3b075c5274 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:48:37 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] VM Resumed (Lifecycle Event)
Aug 26 19:48:37 user nova-compute[73917]: DEBUG nova.compute.manager [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:48:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:48:37 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Instance spawned successfully.
Aug 26 19:48:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:48:37 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:48:37 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:48:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:48:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:48:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:48:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:48:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:48:37 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:48:37 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:48:37 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693079317.0560842, 26bf9ef7-292c-45b4-a02c-dc3b075c5274 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:48:37 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] VM Started (Lifecycle Event)
Aug 26 19:48:37 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:48:37 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:48:37 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:48:37 user nova-compute[73917]: INFO nova.compute.manager [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Took 5.08 seconds to spawn the instance on the hypervisor.
Aug 26 19:48:37 user nova-compute[73917]: DEBUG nova.compute.manager [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:48:37 user nova-compute[73917]: INFO nova.compute.manager [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Took 16.08 seconds to build instance.
Aug 26 19:48:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-72ff7256-e5ad-4478-9aba-d26fe1fe4a5e tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.178s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:48:37 user nova-compute[73917]: DEBUG nova.compute.manager [req-cdfe7ee4-44a4-4b63-b57c-fc736067ef51 req-f305fce9-bf23-4c58-a215-af511ea62417 service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Received event network-vif-plugged-37ab4546-3a47-4e0f-815a-db3528624a7b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:48:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cdfe7ee4-44a4-4b63-b57c-fc736067ef51 req-f305fce9-bf23-4c58-a215-af511ea62417 service nova] Acquiring lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:48:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cdfe7ee4-44a4-4b63-b57c-fc736067ef51 req-f305fce9-bf23-4c58-a215-af511ea62417 service nova] Lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:48:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cdfe7ee4-44a4-4b63-b57c-fc736067ef51 req-f305fce9-bf23-4c58-a215-af511ea62417 service nova] Lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:48:37 user nova-compute[73917]: DEBUG nova.compute.manager [req-cdfe7ee4-44a4-4b63-b57c-fc736067ef51 req-f305fce9-bf23-4c58-a215-af511ea62417 service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] No waiting events found dispatching network-vif-plugged-37ab4546-3a47-4e0f-815a-db3528624a7b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:48:37 user nova-compute[73917]: WARNING nova.compute.manager [req-cdfe7ee4-44a4-4b63-b57c-fc736067ef51 req-f305fce9-bf23-4c58-a215-af511ea62417 service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Received unexpected event network-vif-plugged-37ab4546-3a47-4e0f-815a-db3528624a7b for instance with vm_state active and task_state None.
Aug 26 19:48:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:42 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:48:42 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 19:48:42 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] There are 0 instances to clean {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 19:48:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:46 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:48:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:48:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:48:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:48:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:48:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:48:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:48:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:49:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:49:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:49:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:49:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:49:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:49:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:49:22 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:49:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:49:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:49:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-26bf9ef7-292c-45b4-a02c-dc3b075c5274" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:49:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-26bf9ef7-292c-45b4-a02c-dc3b075c5274" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:49:22 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:49:22 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid 26bf9ef7-292c-45b4-a02c-dc3b075c5274 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:49:22 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Updating instance_info_cache with network_info: [{"id": "37ab4546-3a47-4e0f-815a-db3528624a7b", "address": "fa:16:3e:e2:0a:ea", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ab4546-3a", "ovs_interfaceid": "37ab4546-3a47-4e0f-815a-db3528624a7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:49:22 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-26bf9ef7-292c-45b4-a02c-dc3b075c5274" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:49:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:49:23 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:49:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:49:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:49:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:49:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:49:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:49:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:49:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:49:25 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:49:27 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:49:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:49:31 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:49:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:49:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:49:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:49:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:49:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:49:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:49:33 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:49:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:49:33 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:49:33 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:49:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8780MB free_disk=25.144535064697266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:49:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:49:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:49:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 26bf9ef7-292c-45b4-a02c-dc3b075c5274 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:49:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:49:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:49:34 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:49:34 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:49:34 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:49:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:49:35 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:49:35 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:49:35 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:49:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:49:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:49:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:49:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:49:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:49:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:49:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:49:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:49:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:49:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:49:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:49:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:49:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:49:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:49:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:50:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:50:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:50:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:50:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-bc6d58b0-dd33-49d9-a805-254a9ef1a63d req-9a370e5e-2bf0-49c7-ba3f-c6255d22d1c7 service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Received event network-changed-37ab4546-3a47-4e0f-815a-db3528624a7b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:50:13 user nova-compute[73917]: DEBUG nova.compute.manager [req-bc6d58b0-dd33-49d9-a805-254a9ef1a63d req-9a370e5e-2bf0-49c7-ba3f-c6255d22d1c7 service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Refreshing instance network info cache due to event network-changed-37ab4546-3a47-4e0f-815a-db3528624a7b. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:50:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-bc6d58b0-dd33-49d9-a805-254a9ef1a63d req-9a370e5e-2bf0-49c7-ba3f-c6255d22d1c7 service nova] Acquiring lock "refresh_cache-26bf9ef7-292c-45b4-a02c-dc3b075c5274" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:50:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-bc6d58b0-dd33-49d9-a805-254a9ef1a63d req-9a370e5e-2bf0-49c7-ba3f-c6255d22d1c7 service nova] Acquired lock "refresh_cache-26bf9ef7-292c-45b4-a02c-dc3b075c5274" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:50:13 user nova-compute[73917]: DEBUG nova.network.neutron [req-bc6d58b0-dd33-49d9-a805-254a9ef1a63d req-9a370e5e-2bf0-49c7-ba3f-c6255d22d1c7 service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Refreshing network info cache for port 37ab4546-3a47-4e0f-815a-db3528624a7b {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:50:13 user nova-compute[73917]: DEBUG nova.network.neutron [req-bc6d58b0-dd33-49d9-a805-254a9ef1a63d req-9a370e5e-2bf0-49c7-ba3f-c6255d22d1c7 service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Updated VIF entry in instance network info cache for port 37ab4546-3a47-4e0f-815a-db3528624a7b. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:50:13 user nova-compute[73917]: DEBUG nova.network.neutron [req-bc6d58b0-dd33-49d9-a805-254a9ef1a63d req-9a370e5e-2bf0-49c7-ba3f-c6255d22d1c7 service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Updating instance_info_cache with network_info: [{"id": "37ab4546-3a47-4e0f-815a-db3528624a7b", "address": "fa:16:3e:e2:0a:ea", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ab4546-3a", "ovs_interfaceid": "37ab4546-3a47-4e0f-815a-db3528624a7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:50:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-bc6d58b0-dd33-49d9-a805-254a9ef1a63d req-9a370e5e-2bf0-49c7-ba3f-c6255d22d1c7 service nova] Releasing lock "refresh_cache-26bf9ef7-292c-45b4-a02c-dc3b075c5274" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:50:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:50:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:50:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:50:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:50:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:50:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:50:13 user nova-compute[73917]: INFO nova.compute.manager [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Terminating instance
Aug 26 19:50:13 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:50:14 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Instance destroyed successfully.
Aug 26 19:50:14 user nova-compute[73917]: DEBUG nova.objects.instance [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lazy-loading 'resources' on Instance uuid 26bf9ef7-292c-45b4-a02c-dc3b075c5274 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1355368441',display_name='tempest-TestVolumeBootPattern-server-1355368441',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1355368441',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqOTuWaVQuR1bJ4mXv25/X0179C/SIJgYNBbfkXIuPGnpXFoY3qyn53WKpsBuWyeYwqkadyQdEa1ypBhwuuI/YSnnWyuuNyjACHQ3vbFr+8kYRNqgtXOUIeLTy7CgMupw==',key_name='tempest-TestVolumeBootPattern-1387621208',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:48:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a6263f314fc43e8aa7a9e0b23f26162',ramdisk_id='',reservation_id='r-qwzlvtpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-534408973',owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:48:37Z,user_data=None,user_id='ed6fbe4e41ef4849934362d43ef97754',uuid=26bf9ef7-292c-45b4-a02c-dc3b075c5274,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37ab4546-3a47-4e0f-815a-db3528624a7b", "address": "fa:16:3e:e2:0a:ea", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ab4546-3a", "ovs_interfaceid": "37ab4546-3a47-4e0f-815a-db3528624a7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converting VIF {"id": "37ab4546-3a47-4e0f-815a-db3528624a7b", "address": "fa:16:3e:e2:0a:ea", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ab4546-3a", "ovs_interfaceid": "37ab4546-3a47-4e0f-815a-db3528624a7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:0a:ea,bridge_name='br-int',has_traffic_filtering=True,id=37ab4546-3a47-4e0f-815a-db3528624a7b,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ab4546-3a') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG os_vif [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:0a:ea,bridge_name='br-int',has_traffic_filtering=True,id=37ab4546-3a47-4e0f-815a-db3528624a7b,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ab4546-3a') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37ab4546-3a, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:50:14 user nova-compute[73917]: INFO os_vif [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:0a:ea,bridge_name='br-int',has_traffic_filtering=True,id=37ab4546-3a47-4e0f-815a-db3528624a7b,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ab4546-3a')
Aug 26 19:50:14 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEUroyPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:50:14 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:50:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1627f267-60e9-4873-90c5-7d3250664531]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cc930f-5a49-4403-b39f-068b1ea2e90d]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)
Aug 26 19:50:14 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)
Aug 26 19:50:14 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b985d9120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85'): ({'sdb'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Removing single pathed devices sdb {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39a72b5-6bd4-433c-b62e-3ef937fbcfe3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05b26dc-564d-4db4-99cc-e60822a1577d]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Flushing IO for device /dev/sdb {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a02737-be83-4bfb-9a24-de3c0ac218ff]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c977b2-18e8-42ac-a128-ff5a2c8954cc]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23962383362653765', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fb78377b', '/dev/disk/by-id/scsi-1SCST_BIOfb78377b-9b83be7ef6100583') {{(pid=85467) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2258119-ad7b-4428-bdbf-30fbfeea3065]: (4, None) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c76e00-0a4d-44d0-a574-a642e89c51b0]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:50:14 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[94091119-1a94-4720-99a5-80260c0d71e3]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85, portal: 172.16.0.220,3260]
Aug 26 19:50:15 user nova-compute[73917]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85, portal: 172.16.0.220,3260] successful.
Aug 26 19:50:15 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb646822-7fcd-44c6-b3c7-2479339bf6fb]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] <== disconnect_volume: return (295ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:50:15 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Deleting instance files /opt/stack/data/nova/instances/26bf9ef7-292c-45b4-a02c-dc3b075c5274_del
Aug 26 19:50:15 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Deletion of /opt/stack/data/nova/instances/26bf9ef7-292c-45b4-a02c-dc3b075c5274_del complete
Aug 26 19:50:15 user nova-compute[73917]: INFO nova.compute.manager [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 26 19:50:15 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-040425b1-f52f-4fd7-a060-b91e426b4244 req-661c59c7-58cd-471f-bcab-0d5c8c0b6220 service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Received event network-vif-unplugged-37ab4546-3a47-4e0f-815a-db3528624a7b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-040425b1-f52f-4fd7-a060-b91e426b4244 req-661c59c7-58cd-471f-bcab-0d5c8c0b6220 service nova] Acquiring lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-040425b1-f52f-4fd7-a060-b91e426b4244 req-661c59c7-58cd-471f-bcab-0d5c8c0b6220 service nova] Lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-040425b1-f52f-4fd7-a060-b91e426b4244 req-661c59c7-58cd-471f-bcab-0d5c8c0b6220 service nova] Lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-040425b1-f52f-4fd7-a060-b91e426b4244 req-661c59c7-58cd-471f-bcab-0d5c8c0b6220 service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] No waiting events found dispatching network-vif-unplugged-37ab4546-3a47-4e0f-815a-db3528624a7b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-040425b1-f52f-4fd7-a060-b91e426b4244 req-661c59c7-58cd-471f-bcab-0d5c8c0b6220 service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Received event network-vif-unplugged-37ab4546-3a47-4e0f-815a-db3528624a7b for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-040425b1-f52f-4fd7-a060-b91e426b4244 req-661c59c7-58cd-471f-bcab-0d5c8c0b6220 service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Received event network-vif-plugged-37ab4546-3a47-4e0f-815a-db3528624a7b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-040425b1-f52f-4fd7-a060-b91e426b4244 req-661c59c7-58cd-471f-bcab-0d5c8c0b6220 service nova] Acquiring lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-040425b1-f52f-4fd7-a060-b91e426b4244 req-661c59c7-58cd-471f-bcab-0d5c8c0b6220 service nova] Lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-040425b1-f52f-4fd7-a060-b91e426b4244 req-661c59c7-58cd-471f-bcab-0d5c8c0b6220 service nova] Lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:50:15 user nova-compute[73917]: DEBUG nova.compute.manager [req-040425b1-f52f-4fd7-a060-b91e426b4244 req-661c59c7-58cd-471f-bcab-0d5c8c0b6220 service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] No waiting events found dispatching network-vif-plugged-37ab4546-3a47-4e0f-815a-db3528624a7b {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:50:15 user nova-compute[73917]: WARNING nova.compute.manager [req-040425b1-f52f-4fd7-a060-b91e426b4244 req-661c59c7-58cd-471f-bcab-0d5c8c0b6220 service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Received unexpected event network-vif-plugged-37ab4546-3a47-4e0f-815a-db3528624a7b for instance with vm_state active and task_state deleting.
Aug 26 19:50:16 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:50:16 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Took 1.17 seconds to deallocate network for instance.
Aug 26 19:50:16 user nova-compute[73917]: DEBUG nova.compute.manager [req-b2684425-8c38-4607-b361-8de71d16e8dc req-792ae938-d93b-441c-952c-ce14eb3edd15 service nova] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Received event network-vif-deleted-37ab4546-3a47-4e0f-815a-db3528624a7b {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:50:17 user nova-compute[73917]: INFO nova.compute.manager [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Took 0.82 seconds to detach 1 volumes for instance.
Aug 26 19:50:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:50:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:50:17 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:50:17 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:50:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:50:17 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Deleted allocations for instance 26bf9ef7-292c-45b4-a02c-dc3b075c5274
Aug 26 19:50:17 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-1082e90a-9451-4c30-b62d-865b4d806123 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "26bf9ef7-292c-45b4-a02c-dc3b075c5274" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.400s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:50:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:50:23 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:50:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:50:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:50:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Didn't find any instances for network info cache update. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 19:50:23 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:50:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:50:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:50:25 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:50:28 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:50:29 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693079414.7005088, 26bf9ef7-292c-45b4-a02c-dc3b075c5274 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:50:29 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] VM Stopped (Lifecycle Event)
Aug 26 19:50:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-1bdfeb51-e925-4784-acb1-c95f11268758 None None] [instance: 26bf9ef7-292c-45b4-a02c-dc3b075c5274] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:50:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:50:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:50:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:50:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:50:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:50:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:50:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:50:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:50:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:50:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:50:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:50:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:50:33 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:50:33 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:50:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8904MB free_disk=25.143692016601562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:50:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:50:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:50:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:50:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:50:33 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:50:33 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:50:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:50:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:50:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:50:35 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:50:35 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:50:35 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:50:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:50:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:50:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:50:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:50:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:50:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:50:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:50:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:50:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:50:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:51:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "b59424cc-9500-4a91-b089-a43e53c1cbb7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:51:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "b59424cc-9500-4a91-b089-a43e53c1cbb7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:51:05 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:51:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:51:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:51:05 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:51:05 user nova-compute[73917]: INFO nova.compute.claims [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Claim successful on node user
Aug 26 19:51:06 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.182s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG nova.network.neutron [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:51:06 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:51:06 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:51:06 user nova-compute[73917]: INFO nova.virt.block_device [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Booting with volume 22b72135-dd05-40c9-980e-9e71448e7e85 at /dev/vda
Aug 26 19:51:06 user nova-compute[73917]: DEBUG nova.policy [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed6fbe4e41ef4849934362d43ef97754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6263f314fc43e8aa7a9e0b23f26162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG os_brick.utils [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc81c569-3fca-4375-8a52-676c2e858590]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9088f547-cd79-416a-99ea-ba5551c29ed2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a41391-f8b8-483f-a205-be9154d74c54]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f7fca7-64a7-4d63-ad8a-fce24ba9ae61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:51:06 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:51:06 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1823db-d507-43f1-99b6-7dc2ea30f839]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG os_brick.utils [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Updating existing volume attachment record: 6bbbbfa7-ea84-43a1-8228-bdb980710827 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:51:06 user nova-compute[73917]: DEBUG nova.network.neutron [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Successfully created port: e9937a2c-0a4e-428f-980b-fff93b698109 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:51:07 user nova-compute[73917]: DEBUG nova.network.neutron [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Successfully updated port: e9937a2c-0a4e-428f-980b-fff93b698109 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:51:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:51:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquired lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:51:07 user nova-compute[73917]: DEBUG nova.network.neutron [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:51:07 user nova-compute[73917]: DEBUG nova.compute.manager [req-02d474cd-078a-4420-9a2e-9f28dc77290f req-f7062a4e-f4e3-4c2c-b6f6-aaa19d5d4d2e service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Received event network-changed-e9937a2c-0a4e-428f-980b-fff93b698109 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:51:07 user nova-compute[73917]: DEBUG nova.compute.manager [req-02d474cd-078a-4420-9a2e-9f28dc77290f req-f7062a4e-f4e3-4c2c-b6f6-aaa19d5d4d2e service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Refreshing instance network info cache due to event network-changed-e9937a2c-0a4e-428f-980b-fff93b698109. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:51:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-02d474cd-078a-4420-9a2e-9f28dc77290f req-f7062a4e-f4e3-4c2c-b6f6-aaa19d5d4d2e service nova] Acquiring lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:51:07 user nova-compute[73917]: DEBUG nova.network.neutron [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:51:07 user nova-compute[73917]: DEBUG nova.network.neutron [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Updating instance_info_cache with network_info: [{"id": "e9937a2c-0a4e-428f-980b-fff93b698109", "address": "fa:16:3e:c9:8b:06", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9937a2c-0a", "ovs_interfaceid": "e9937a2c-0a4e-428f-980b-fff93b698109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:51:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Releasing lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:51:07 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Instance network_info: |[{"id": "e9937a2c-0a4e-428f-980b-fff93b698109", "address": "fa:16:3e:c9:8b:06", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9937a2c-0a", "ovs_interfaceid": "e9937a2c-0a4e-428f-980b-fff93b698109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:51:07 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-02d474cd-078a-4420-9a2e-9f28dc77290f req-f7062a4e-f4e3-4c2c-b6f6-aaa19d5d4d2e service nova] Acquired lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:51:07 user nova-compute[73917]: DEBUG nova.network.neutron [req-02d474cd-078a-4420-9a2e-9f28dc77290f req-f7062a4e-f4e3-4c2c-b6f6-aaa19d5d4d2e service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Refreshing network info cache for port e9937a2c-0a4e-428f-980b-fff93b698109 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:51:08 user nova-compute[73917]: DEBUG nova.network.neutron [req-02d474cd-078a-4420-9a2e-9f28dc77290f req-f7062a4e-f4e3-4c2c-b6f6-aaa19d5d4d2e service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Updated VIF entry in instance network info cache for port e9937a2c-0a4e-428f-980b-fff93b698109. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:51:08 user nova-compute[73917]: DEBUG nova.network.neutron [req-02d474cd-078a-4420-9a2e-9f28dc77290f req-f7062a4e-f4e3-4c2c-b6f6-aaa19d5d4d2e service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Updating instance_info_cache with network_info: [{"id": "e9937a2c-0a4e-428f-980b-fff93b698109", "address": "fa:16:3e:c9:8b:06", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9937a2c-0a", "ovs_interfaceid": "e9937a2c-0a4e-428f-980b-fff93b698109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:51:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-02d474cd-078a-4420-9a2e-9f28dc77290f req-f7062a4e-f4e3-4c2c-b6f6-aaa19d5d4d2e service nova] Releasing lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:51:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:51:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:51:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:51:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:51:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:51:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:51:16 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Creating image(s)
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Did not create local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Ensure instance console log exists: /opt/stack/data/nova/instances/b59424cc-9500-4a91-b089-a43e53c1cbb7/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Start _get_guest_xml network_info=[{"id": "e9937a2c-0a4e-428f-980b-fff93b698109", "address": "fa:16:3e:c9:8b:06", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9937a2c-0a", "ovs_interfaceid": "e9937a2c-0a4e-428f-980b-fff93b698109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEUroyPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b59424cc-9500-4a91-b089-a43e53c1cbb7', 'attached_at': '', 'detached_at': '', 'volume_id': '22b72135-dd05-40c9-980e-9e71448e7e85', 'serial': '22b72135-dd05-40c9-980e-9e71448e7e85'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '6bbbbfa7-ea84-43a1-8228-bdb980710827', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:51:16 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:51:16 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEUroyPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:51:16 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:51:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:51:16 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:51:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:51:16 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:51:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4d51da-92a9-4ed4-bb27-a3e600745526]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:51:16 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9ff7f4-2225-4ecc-9a11-18428f13b00f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85] added
Aug 26 19:51:16 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f3743a-6b66-46d2-92a8-381f93b99c8b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1913df-e9eb-4a8b-b08b-b0d40c19fc83]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gEUroyPQ {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gEUroyPQ" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77fee42-bc0c-4774-90b4-6cb9e673b750]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gEUroyPQ'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:51:16 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3551c9a1-f9ae-4b0c-970f-de8727ea92b2]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e02fdee-dd23-44b0-8c6b-8c1c520a91b2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 19:51:17 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 19:51:17 user nova-compute[73917]:  {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:51:17 user nova-compute[73917]: WARNING os_brick.initiator.connectors.iscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 19:51:17 user nova-compute[73917]: 
Aug 26 19:51:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02a8b98-2706-4283-9314-6e33b3969e5a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85, portal: 172.16.0.220,3260]
Aug 26 19:51:17 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85, portal: 172.16.0.220,3260] successful.
Aug 26 19:51:17 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e92cec-2188-450c-bcaa-f3d90c6c018b]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f75a48-befb-4b44-9dce-b43c89aca2a5]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)
Aug 26 19:51:17 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)
Aug 26 19:51:17 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c50cb0f-b8f3-4961-8496-d3189c0af916]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:51:17 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEUroyPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23962383362653765', 'path': '/dev/sdb'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962383362653765', 'path': '/dev/sdb'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:51:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1008885780',display_name='tempest-TestVolumeBootPattern-server-1008885780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1008885780',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqOTuWaVQuR1bJ4mXv25/X0179C/SIJgYNBbfkXIuPGnpXFoY3qyn53WKpsBuWyeYwqkadyQdEa1ypBhwuuI/YSnnWyuuNyjACHQ3vbFr+8kYRNqgtXOUIeLTy7CgMupw==',key_name='tempest-TestVolumeBootPattern-1387621208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a6263f314fc43e8aa7a9e0b23f26162',ramdisk_id='',reservation_id='r-pztzbotj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-534408973',owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:51:06Z,user_data=None,user_id='ed6fbe4e41ef4849934362d43ef97754',uuid=b59424cc-9500-4a91-b089-a43e53c1cbb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9937a2c-0a4e-428f-980b-fff93b698109", "address": "fa:16:3e:c9:8b:06", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9937a2c-0a", "ovs_interfaceid": "e9937a2c-0a4e-428f-980b-fff93b698109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converting VIF {"id": "e9937a2c-0a4e-428f-980b-fff93b698109", "address": "fa:16:3e:c9:8b:06", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9937a2c-0a", "ovs_interfaceid": "e9937a2c-0a4e-428f-980b-fff93b698109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:8b:06,bridge_name='br-int',has_traffic_filtering=True,id=e9937a2c-0a4e-428f-980b-fff93b698109,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9937a2c-0a') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG nova.objects.instance [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lazy-loading 'pci_devices' on Instance uuid b59424cc-9500-4a91-b089-a43e53c1cbb7 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:51:18 user nova-compute[73917]:   <uuid>b59424cc-9500-4a91-b089-a43e53c1cbb7</uuid>
Aug 26 19:51:18 user nova-compute[73917]:   <name>instance-00000033</name>
Aug 26 19:51:18 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:51:18 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:51:18 user nova-compute[73917]:   <metadata>
Aug 26 19:51:18 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:51:18 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:51:18 user nova-compute[73917]:       <nova:name>tempest-TestVolumeBootPattern-server-1008885780</nova:name>
Aug 26 19:51:18 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:51:16</nova:creationTime>
Aug 26 19:51:18 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:51:18 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:51:18 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:51:18 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:51:18 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:51:18 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:51:18 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:51:18 user nova-compute[73917]:       <nova:owner>
Aug 26 19:51:18 user nova-compute[73917]:         <nova:user uuid="ed6fbe4e41ef4849934362d43ef97754">tempest-TestVolumeBootPattern-534408973-project-member</nova:user>
Aug 26 19:51:18 user nova-compute[73917]:         <nova:project uuid="7a6263f314fc43e8aa7a9e0b23f26162">tempest-TestVolumeBootPattern-534408973</nova:project>
Aug 26 19:51:18 user nova-compute[73917]:       </nova:owner>
Aug 26 19:51:18 user nova-compute[73917]:       <nova:ports>
Aug 26 19:51:18 user nova-compute[73917]:         <nova:port uuid="e9937a2c-0a4e-428f-980b-fff93b698109">
Aug 26 19:51:18 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 19:51:18 user nova-compute[73917]:         </nova:port>
Aug 26 19:51:18 user nova-compute[73917]:       </nova:ports>
Aug 26 19:51:18 user nova-compute[73917]:     </nova:instance>
Aug 26 19:51:18 user nova-compute[73917]:   </metadata>
Aug 26 19:51:18 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:51:18 user nova-compute[73917]:     <system>
Aug 26 19:51:18 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:51:18 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:51:18 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:51:18 user nova-compute[73917]:       <entry name="serial">b59424cc-9500-4a91-b089-a43e53c1cbb7</entry>
Aug 26 19:51:18 user nova-compute[73917]:       <entry name="uuid">b59424cc-9500-4a91-b089-a43e53c1cbb7</entry>
Aug 26 19:51:18 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:51:18 user nova-compute[73917]:     </system>
Aug 26 19:51:18 user nova-compute[73917]:   </sysinfo>
Aug 26 19:51:18 user nova-compute[73917]:   <os>
Aug 26 19:51:18 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:51:18 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:51:18 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:51:18 user nova-compute[73917]:   </os>
Aug 26 19:51:18 user nova-compute[73917]:   <features>
Aug 26 19:51:18 user nova-compute[73917]:     <acpi/>
Aug 26 19:51:18 user nova-compute[73917]:     <apic/>
Aug 26 19:51:18 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:51:18 user nova-compute[73917]:   </features>
Aug 26 19:51:18 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:51:18 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:51:18 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:51:18 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:51:18 user nova-compute[73917]:   </clock>
Aug 26 19:51:18 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:51:18 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:51:18 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:51:18 user nova-compute[73917]:   </cpu>
Aug 26 19:51:18 user nova-compute[73917]:   <devices>
Aug 26 19:51:18 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:51:18 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:51:18 user nova-compute[73917]:       <source dev="/dev/sdb"/>
Aug 26 19:51:18 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:51:18 user nova-compute[73917]:       <serial>22b72135-dd05-40c9-980e-9e71448e7e85</serial>
Aug 26 19:51:18 user nova-compute[73917]:     </disk>
Aug 26 19:51:18 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:51:18 user nova-compute[73917]:       <mac address="fa:16:3e:c9:8b:06"/>
Aug 26 19:51:18 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:51:18 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:51:18 user nova-compute[73917]:       <target dev="tape9937a2c-0a"/>
Aug 26 19:51:18 user nova-compute[73917]:     </interface>
Aug 26 19:51:18 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:51:18 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/b59424cc-9500-4a91-b089-a43e53c1cbb7/console.log" append="off"/>
Aug 26 19:51:18 user nova-compute[73917]:     </serial>
Aug 26 19:51:18 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:51:18 user nova-compute[73917]:     <video>
Aug 26 19:51:18 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:51:18 user nova-compute[73917]:     </video>
Aug 26 19:51:18 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:51:18 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:51:18 user nova-compute[73917]:     </rng>
Aug 26 19:51:18 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:51:18 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:51:18 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:51:18 user nova-compute[73917]:     </memballoon>
Aug 26 19:51:18 user nova-compute[73917]:   </devices>
Aug 26 19:51:18 user nova-compute[73917]: </domain>
Aug 26 19:51:18 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:51:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1008885780',display_name='tempest-TestVolumeBootPattern-server-1008885780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1008885780',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqOTuWaVQuR1bJ4mXv25/X0179C/SIJgYNBbfkXIuPGnpXFoY3qyn53WKpsBuWyeYwqkadyQdEa1ypBhwuuI/YSnnWyuuNyjACHQ3vbFr+8kYRNqgtXOUIeLTy7CgMupw==',key_name='tempest-TestVolumeBootPattern-1387621208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a6263f314fc43e8aa7a9e0b23f26162',ramdisk_id='',reservation_id='r-pztzbotj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-534408973',owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:51:06Z,user_data=None,user_id='ed6fbe4e41ef4849934362d43ef97754',uuid=b59424cc-9500-4a91-b089-a43e53c1cbb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9937a2c-0a4e-428f-980b-fff93b698109", "address": "fa:16:3e:c9:8b:06", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9937a2c-0a", "ovs_interfaceid": "e9937a2c-0a4e-428f-980b-fff93b698109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converting VIF {"id": "e9937a2c-0a4e-428f-980b-fff93b698109", "address": "fa:16:3e:c9:8b:06", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9937a2c-0a", "ovs_interfaceid": "e9937a2c-0a4e-428f-980b-fff93b698109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:8b:06,bridge_name='br-int',has_traffic_filtering=True,id=e9937a2c-0a4e-428f-980b-fff93b698109,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9937a2c-0a') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG os_vif [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:8b:06,bridge_name='br-int',has_traffic_filtering=True,id=e9937a2c-0a4e-428f-980b-fff93b698109,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9937a2c-0a') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9937a2c-0a, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9937a2c-0a, col_values=(('external_ids', {'iface-id': 'e9937a2c-0a4e-428f-980b-fff93b698109', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:8b:06', 'vm-uuid': 'b59424cc-9500-4a91-b089-a43e53c1cbb7'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:18 user nova-compute[73917]: INFO os_vif [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:8b:06,bridge_name='br-int',has_traffic_filtering=True,id=e9937a2c-0a4e-428f-980b-fff93b698109,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9937a2c-0a')
Aug 26 19:51:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:51:18 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] No VIF found with MAC fa:16:3e:c9:8b:06, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:51:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:19 user nova-compute[73917]: DEBUG nova.compute.manager [req-cea2bc86-2c23-4bd4-843a-dc235cc0ae3d req-98d0d07a-30d8-483f-8b23-d42cc620f2a1 service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Received event network-vif-plugged-e9937a2c-0a4e-428f-980b-fff93b698109 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:51:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cea2bc86-2c23-4bd4-843a-dc235cc0ae3d req-98d0d07a-30d8-483f-8b23-d42cc620f2a1 service nova] Acquiring lock "b59424cc-9500-4a91-b089-a43e53c1cbb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:51:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cea2bc86-2c23-4bd4-843a-dc235cc0ae3d req-98d0d07a-30d8-483f-8b23-d42cc620f2a1 service nova] Lock "b59424cc-9500-4a91-b089-a43e53c1cbb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:51:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-cea2bc86-2c23-4bd4-843a-dc235cc0ae3d req-98d0d07a-30d8-483f-8b23-d42cc620f2a1 service nova] Lock "b59424cc-9500-4a91-b089-a43e53c1cbb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:51:19 user nova-compute[73917]: DEBUG nova.compute.manager [req-cea2bc86-2c23-4bd4-843a-dc235cc0ae3d req-98d0d07a-30d8-483f-8b23-d42cc620f2a1 service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] No waiting events found dispatching network-vif-plugged-e9937a2c-0a4e-428f-980b-fff93b698109 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:51:19 user nova-compute[73917]: WARNING nova.compute.manager [req-cea2bc86-2c23-4bd4-843a-dc235cc0ae3d req-98d0d07a-30d8-483f-8b23-d42cc620f2a1 service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Received unexpected event network-vif-plugged-e9937a2c-0a4e-428f-980b-fff93b698109 for instance with vm_state building and task_state spawning.
Aug 26 19:51:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:21 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693079481.63391, b59424cc-9500-4a91-b089-a43e53c1cbb7 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:51:21 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] VM Resumed (Lifecycle Event)
Aug 26 19:51:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:51:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:51:21 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Instance spawned successfully.
Aug 26 19:51:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:51:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:51:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:51:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:51:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:51:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:51:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:51:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:51:21 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:51:21 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:51:21 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693079481.6386867, b59424cc-9500-4a91-b089-a43e53c1cbb7 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:51:21 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] VM Started (Lifecycle Event)
Aug 26 19:51:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:51:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:51:21 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:51:21 user nova-compute[73917]: INFO nova.compute.manager [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Took 4.94 seconds to spawn the instance on the hypervisor.
Aug 26 19:51:21 user nova-compute[73917]: DEBUG nova.compute.manager [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:51:21 user nova-compute[73917]: INFO nova.compute.manager [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Took 15.99 seconds to build instance.
Aug 26 19:51:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-2795f60c-10f3-4565-a9f5-380140d6778a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "b59424cc-9500-4a91-b089-a43e53c1cbb7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.125s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:51:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-8baca56a-a7a9-405c-8e1f-2843e87f938d req-3db5f1a8-f252-40c2-9b4c-0cf50a32499d service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Received event network-vif-plugged-e9937a2c-0a4e-428f-980b-fff93b698109 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:51:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8baca56a-a7a9-405c-8e1f-2843e87f938d req-3db5f1a8-f252-40c2-9b4c-0cf50a32499d service nova] Acquiring lock "b59424cc-9500-4a91-b089-a43e53c1cbb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:51:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8baca56a-a7a9-405c-8e1f-2843e87f938d req-3db5f1a8-f252-40c2-9b4c-0cf50a32499d service nova] Lock "b59424cc-9500-4a91-b089-a43e53c1cbb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:51:21 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8baca56a-a7a9-405c-8e1f-2843e87f938d req-3db5f1a8-f252-40c2-9b4c-0cf50a32499d service nova] Lock "b59424cc-9500-4a91-b089-a43e53c1cbb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:51:21 user nova-compute[73917]: DEBUG nova.compute.manager [req-8baca56a-a7a9-405c-8e1f-2843e87f938d req-3db5f1a8-f252-40c2-9b4c-0cf50a32499d service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] No waiting events found dispatching network-vif-plugged-e9937a2c-0a4e-428f-980b-fff93b698109 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:51:21 user nova-compute[73917]: WARNING nova.compute.manager [req-8baca56a-a7a9-405c-8e1f-2843e87f938d req-3db5f1a8-f252-40c2-9b4c-0cf50a32499d service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Received unexpected event network-vif-plugged-e9937a2c-0a4e-428f-980b-fff93b698109 for instance with vm_state active and task_state None.
Aug 26 19:51:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:23 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:51:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:51:24 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:51:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:51:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:51:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:51:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:51:24 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:51:24 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid b59424cc-9500-4a91-b089-a43e53c1cbb7 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:51:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:24 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Updating instance_info_cache with network_info: [{"id": "e9937a2c-0a4e-428f-980b-fff93b698109", "address": "fa:16:3e:c9:8b:06", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9937a2c-0a", "ovs_interfaceid": "e9937a2c-0a4e-428f-980b-fff93b698109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:51:24 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:51:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:51:27 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:51:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:29 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:51:32 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:51:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:51:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:51:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:51:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:51:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:51:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:51:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:51:33 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:51:33 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:51:33 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:51:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8716MB free_disk=25.142070770263672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:51:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:51:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:51:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance b59424cc-9500-4a91-b089-a43e53c1cbb7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:51:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:51:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:51:33 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:51:33 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:51:34 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:51:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:51:36 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:51:36 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:51:37 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:51:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:51:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:51:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:51:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:51:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:51:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:51:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:52:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:52:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:52:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:52:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:52:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:52:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:52:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:52:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:52:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:52:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:52:23 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:52:23 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:52:26 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:52:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:52:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:52:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:52:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:52:26 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:52:26 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid b59424cc-9500-4a91-b089-a43e53c1cbb7 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:52:26 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Updating instance_info_cache with network_info: [{"id": "e9937a2c-0a4e-428f-980b-fff93b698109", "address": "fa:16:3e:c9:8b:06", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9937a2c-0a", "ovs_interfaceid": "e9937a2c-0a4e-428f-980b-fff93b698109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:52:26 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:52:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:52:27 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:52:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:52:31 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:52:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:52:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:52:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:52:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:52:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:52:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:52:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:52:33 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:52:33 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:52:33 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:52:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8804MB free_disk=25.141429901123047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:52:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:52:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:52:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance b59424cc-9500-4a91-b089-a43e53c1cbb7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:52:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:52:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:52:33 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:52:33 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:52:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:52:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:52:36 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:52:37 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:52:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:52:38 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:52:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:52:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:52:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:52:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:52:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:52:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:52:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:52:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:52:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:52:57 user nova-compute[73917]: DEBUG nova.compute.manager [req-b9224ec0-ee78-462e-95cd-b089b51983b1 req-7f9b4cf1-b13f-4c70-8e7d-e76921ba5b6a service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Received event network-changed-e9937a2c-0a4e-428f-980b-fff93b698109 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:52:57 user nova-compute[73917]: DEBUG nova.compute.manager [req-b9224ec0-ee78-462e-95cd-b089b51983b1 req-7f9b4cf1-b13f-4c70-8e7d-e76921ba5b6a service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Refreshing instance network info cache due to event network-changed-e9937a2c-0a4e-428f-980b-fff93b698109. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:52:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9224ec0-ee78-462e-95cd-b089b51983b1 req-7f9b4cf1-b13f-4c70-8e7d-e76921ba5b6a service nova] Acquiring lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:52:57 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9224ec0-ee78-462e-95cd-b089b51983b1 req-7f9b4cf1-b13f-4c70-8e7d-e76921ba5b6a service nova] Acquired lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:52:57 user nova-compute[73917]: DEBUG nova.network.neutron [req-b9224ec0-ee78-462e-95cd-b089b51983b1 req-7f9b4cf1-b13f-4c70-8e7d-e76921ba5b6a service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Refreshing network info cache for port e9937a2c-0a4e-428f-980b-fff93b698109 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:52:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:52:58 user nova-compute[73917]: DEBUG nova.network.neutron [req-b9224ec0-ee78-462e-95cd-b089b51983b1 req-7f9b4cf1-b13f-4c70-8e7d-e76921ba5b6a service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Updated VIF entry in instance network info cache for port e9937a2c-0a4e-428f-980b-fff93b698109. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:52:58 user nova-compute[73917]: DEBUG nova.network.neutron [req-b9224ec0-ee78-462e-95cd-b089b51983b1 req-7f9b4cf1-b13f-4c70-8e7d-e76921ba5b6a service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Updating instance_info_cache with network_info: [{"id": "e9937a2c-0a4e-428f-980b-fff93b698109", "address": "fa:16:3e:c9:8b:06", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9937a2c-0a", "ovs_interfaceid": "e9937a2c-0a4e-428f-980b-fff93b698109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:52:58 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-b9224ec0-ee78-462e-95cd-b089b51983b1 req-7f9b4cf1-b13f-4c70-8e7d-e76921ba5b6a service nova] Releasing lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:52:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "894fcf15-b074-4eec-ad92-af1ff0d18467" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:53:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "894fcf15-b074-4eec-ad92-af1ff0d18467" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:53:12 user nova-compute[73917]: DEBUG nova.compute.manager [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:53:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:53:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:53:12 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:53:12 user nova-compute[73917]: INFO nova.compute.claims [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Claim successful on node user
Aug 26 19:53:12 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:53:12 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:53:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:53:12 user nova-compute[73917]: DEBUG nova.compute.manager [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:53:12 user nova-compute[73917]: DEBUG nova.compute.manager [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:53:12 user nova-compute[73917]: DEBUG nova.network.neutron [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:53:12 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:53:12 user nova-compute[73917]: DEBUG nova.compute.manager [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:53:13 user nova-compute[73917]: INFO nova.virt.block_device [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Booting with volume 3a79e955-1722-4eb4-a611-a24db215ff6d at /dev/vda
Aug 26 19:53:13 user nova-compute[73917]: DEBUG nova.policy [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed6fbe4e41ef4849934362d43ef97754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6263f314fc43e8aa7a9e0b23f26162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG os_brick.utils [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[796c9dc7-c56f-43e2-8684-02dca4118a16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[56849fc9-06b4-40c7-9c1c-3be8b607f12a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ff0999-7152-4c74-8da2-00a5e343d6b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c6aac9-b81a-4721-bd44-5af5477709e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 19:53:13 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 19:53:13 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c38e76a-7e73-41f5-b597-1144ff8f5c76]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG os_brick.utils [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Updating existing volume attachment record: d69d6180-4f34-4798-993b-a6e0f9847892 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:13 user nova-compute[73917]: DEBUG nova.network.neutron [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Successfully created port: d06e0da4-66a9-4f6e-968d-919178dd845d {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:53:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:14 user nova-compute[73917]: DEBUG nova.network.neutron [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Successfully updated port: d06e0da4-66a9-4f6e-968d-919178dd845d {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:53:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "refresh_cache-894fcf15-b074-4eec-ad92-af1ff0d18467" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:53:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquired lock "refresh_cache-894fcf15-b074-4eec-ad92-af1ff0d18467" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:53:14 user nova-compute[73917]: DEBUG nova.network.neutron [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:53:14 user nova-compute[73917]: DEBUG nova.compute.manager [req-343eb97b-0ae1-4904-8712-a4b986977587 req-e0cfb14c-19d2-4f69-86f6-7d2a6bc0c084 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Received event network-changed-d06e0da4-66a9-4f6e-968d-919178dd845d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:53:14 user nova-compute[73917]: DEBUG nova.compute.manager [req-343eb97b-0ae1-4904-8712-a4b986977587 req-e0cfb14c-19d2-4f69-86f6-7d2a6bc0c084 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Refreshing instance network info cache due to event network-changed-d06e0da4-66a9-4f6e-968d-919178dd845d. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:53:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-343eb97b-0ae1-4904-8712-a4b986977587 req-e0cfb14c-19d2-4f69-86f6-7d2a6bc0c084 service nova] Acquiring lock "refresh_cache-894fcf15-b074-4eec-ad92-af1ff0d18467" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:53:14 user nova-compute[73917]: DEBUG nova.network.neutron [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:53:14 user nova-compute[73917]: DEBUG nova.network.neutron [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Updating instance_info_cache with network_info: [{"id": "d06e0da4-66a9-4f6e-968d-919178dd845d", "address": "fa:16:3e:f1:51:55", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06e0da4-66", "ovs_interfaceid": "d06e0da4-66a9-4f6e-968d-919178dd845d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:53:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Releasing lock "refresh_cache-894fcf15-b074-4eec-ad92-af1ff0d18467" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:53:14 user nova-compute[73917]: DEBUG nova.compute.manager [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Instance network_info: |[{"id": "d06e0da4-66a9-4f6e-968d-919178dd845d", "address": "fa:16:3e:f1:51:55", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06e0da4-66", "ovs_interfaceid": "d06e0da4-66a9-4f6e-968d-919178dd845d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:53:14 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-343eb97b-0ae1-4904-8712-a4b986977587 req-e0cfb14c-19d2-4f69-86f6-7d2a6bc0c084 service nova] Acquired lock "refresh_cache-894fcf15-b074-4eec-ad92-af1ff0d18467" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:53:14 user nova-compute[73917]: DEBUG nova.network.neutron [req-343eb97b-0ae1-4904-8712-a4b986977587 req-e0cfb14c-19d2-4f69-86f6-7d2a6bc0c084 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Refreshing network info cache for port d06e0da4-66a9-4f6e-968d-919178dd845d {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:53:15 user nova-compute[73917]: DEBUG nova.network.neutron [req-343eb97b-0ae1-4904-8712-a4b986977587 req-e0cfb14c-19d2-4f69-86f6-7d2a6bc0c084 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Updated VIF entry in instance network info cache for port d06e0da4-66a9-4f6e-968d-919178dd845d. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:53:15 user nova-compute[73917]: DEBUG nova.network.neutron [req-343eb97b-0ae1-4904-8712-a4b986977587 req-e0cfb14c-19d2-4f69-86f6-7d2a6bc0c084 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Updating instance_info_cache with network_info: [{"id": "d06e0da4-66a9-4f6e-968d-919178dd845d", "address": "fa:16:3e:f1:51:55", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06e0da4-66", "ovs_interfaceid": "d06e0da4-66a9-4f6e-968d-919178dd845d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:53:15 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-343eb97b-0ae1-4904-8712-a4b986977587 req-e0cfb14c-19d2-4f69-86f6-7d2a6bc0c084 service nova] Releasing lock "refresh_cache-894fcf15-b074-4eec-ad92-af1ff0d18467" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:53:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:53:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:53:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:53:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:53:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:24 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:53:24 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:53:27 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:53:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:53:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:53:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Skipping network cache update for instance because it is Building. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 19:53:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:53:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:53:27 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:53:27 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid b59424cc-9500-4a91-b089-a43e53c1cbb7 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:53:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:53:28 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Updating instance_info_cache with network_info: [{"id": "e9937a2c-0a4e-428f-980b-fff93b698109", "address": "fa:16:3e:c9:8b:06", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9937a2c-0a", "ovs_interfaceid": "e9937a2c-0a4e-428f-980b-fff93b698109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:53:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:53:28 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:53:29 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:53:29 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:53:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73917) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 19:53:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:53:30 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Creating image(s)
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Did not create local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Ensure instance console log exists: /opt/stack/data/nova/instances/894fcf15-b074-4eec-ad92-af1ff0d18467/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Start _get_guest_xml network_info=[{"id": "d06e0da4-66a9-4f6e-968d-919178dd845d", "address": "fa:16:3e:f1:51:55", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06e0da4-66", "ovs_interfaceid": "d06e0da4-66a9-4f6e-968d-919178dd845d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEfHIepc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '894fcf15-b074-4eec-ad92-af1ff0d18467', 'attached_at': '', 'detached_at': '', 'volume_id': '3a79e955-1722-4eb4-a611-a24db215ff6d', 'serial': '3a79e955-1722-4eb4-a611-a24db215ff6d'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'd69d6180-4f34-4798-993b-a6e0f9847892', 'device_type': 'disk', 'volume_type': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:53:30 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:53:30 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEfHIepc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:53:30 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:53:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:53:30 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:53:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:53:30 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 19:53:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3421ae22-5565-4dab-a0bc-34a6f5b6b07e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 19:53:30 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9e8f47-155f-4d16-8adf-e3ae9f186a89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d] added
Aug 26 19:53:30 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[541b4af9-98c1-4bc9-81fc-c25165b94c65]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:53:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6e078b-ddfe-4c55-9aaf-50613b362f7f]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEfHIepc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEfHIepc" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5989cfc-0fc8-44ed-8e74-215bfd9fa5e3]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aEfHIepc'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb3ada8-91ef-41fd-a792-ec4c491e1e92]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fb0a4d-5c74-454e-8b21-cbd00b92f9fa]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)
Aug 26 19:53:31 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)
Aug 26 19:53:31 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62ee8b0-dcae-4cda-9108-feccbdb5120f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d, portal: 172.16.0.220,3260]
Aug 26 19:53:31 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d, portal: 172.16.0.220,3260] successful.
Aug 26 19:53:31 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c90c36-ba6c-4c8f-919d-9c7bfd22e101]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c98687-3222-4060-aacc-c1eafc382356]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)
Aug 26 19:53:31 user nova-compute[73917]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d (non-flash)
Aug 26 19:53:31 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)
Aug 26 19:53:31 user nova-compute[73917]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d (non-flash)
Aug 26 19:53:31 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf8048c-45cf-491a-a347-44e471398b3f]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: None {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:53:31 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEfHIepc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26232326539383431', 'path': '/dev/sdc'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232326539383431', 'path': '/dev/sdc'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:53:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-500509996',display_name='tempest-TestVolumeBootPattern-server-500509996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-500509996',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqOTuWaVQuR1bJ4mXv25/X0179C/SIJgYNBbfkXIuPGnpXFoY3qyn53WKpsBuWyeYwqkadyQdEa1ypBhwuuI/YSnnWyuuNyjACHQ3vbFr+8kYRNqgtXOUIeLTy7CgMupw==',key_name='tempest-TestVolumeBootPattern-1387621208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a6263f314fc43e8aa7a9e0b23f26162',ramdisk_id='',reservation_id='r-hx8ccnw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-534408973',owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:53:13Z,user_data=None,user_id='ed6fbe4e41ef4849934362d43ef97754',uuid=894fcf15-b074-4eec-ad92-af1ff0d18467,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d06e0da4-66a9-4f6e-968d-919178dd845d", "address": "fa:16:3e:f1:51:55", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06e0da4-66", "ovs_interfaceid": "d06e0da4-66a9-4f6e-968d-919178dd845d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converting VIF {"id": "d06e0da4-66a9-4f6e-968d-919178dd845d", "address": "fa:16:3e:f1:51:55", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06e0da4-66", "ovs_interfaceid": "d06e0da4-66a9-4f6e-968d-919178dd845d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:51:55,bridge_name='br-int',has_traffic_filtering=True,id=d06e0da4-66a9-4f6e-968d-919178dd845d,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06e0da4-66') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG nova.objects.instance [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lazy-loading 'pci_devices' on Instance uuid 894fcf15-b074-4eec-ad92-af1ff0d18467 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:53:32 user nova-compute[73917]:   <uuid>894fcf15-b074-4eec-ad92-af1ff0d18467</uuid>
Aug 26 19:53:32 user nova-compute[73917]:   <name>instance-00000034</name>
Aug 26 19:53:32 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:53:32 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:53:32 user nova-compute[73917]:   <metadata>
Aug 26 19:53:32 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:53:32 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:53:32 user nova-compute[73917]:       <nova:name>tempest-TestVolumeBootPattern-server-500509996</nova:name>
Aug 26 19:53:32 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:53:30</nova:creationTime>
Aug 26 19:53:32 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:53:32 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:53:32 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:53:32 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:53:32 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:53:32 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:53:32 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:53:32 user nova-compute[73917]:       <nova:owner>
Aug 26 19:53:32 user nova-compute[73917]:         <nova:user uuid="ed6fbe4e41ef4849934362d43ef97754">tempest-TestVolumeBootPattern-534408973-project-member</nova:user>
Aug 26 19:53:32 user nova-compute[73917]:         <nova:project uuid="7a6263f314fc43e8aa7a9e0b23f26162">tempest-TestVolumeBootPattern-534408973</nova:project>
Aug 26 19:53:32 user nova-compute[73917]:       </nova:owner>
Aug 26 19:53:32 user nova-compute[73917]:       <nova:ports>
Aug 26 19:53:32 user nova-compute[73917]:         <nova:port uuid="d06e0da4-66a9-4f6e-968d-919178dd845d">
Aug 26 19:53:32 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 19:53:32 user nova-compute[73917]:         </nova:port>
Aug 26 19:53:32 user nova-compute[73917]:       </nova:ports>
Aug 26 19:53:32 user nova-compute[73917]:     </nova:instance>
Aug 26 19:53:32 user nova-compute[73917]:   </metadata>
Aug 26 19:53:32 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:53:32 user nova-compute[73917]:     <system>
Aug 26 19:53:32 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:53:32 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:53:32 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:53:32 user nova-compute[73917]:       <entry name="serial">894fcf15-b074-4eec-ad92-af1ff0d18467</entry>
Aug 26 19:53:32 user nova-compute[73917]:       <entry name="uuid">894fcf15-b074-4eec-ad92-af1ff0d18467</entry>
Aug 26 19:53:32 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:53:32 user nova-compute[73917]:     </system>
Aug 26 19:53:32 user nova-compute[73917]:   </sysinfo>
Aug 26 19:53:32 user nova-compute[73917]:   <os>
Aug 26 19:53:32 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:53:32 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:53:32 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:53:32 user nova-compute[73917]:   </os>
Aug 26 19:53:32 user nova-compute[73917]:   <features>
Aug 26 19:53:32 user nova-compute[73917]:     <acpi/>
Aug 26 19:53:32 user nova-compute[73917]:     <apic/>
Aug 26 19:53:32 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:53:32 user nova-compute[73917]:   </features>
Aug 26 19:53:32 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:53:32 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:53:32 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:53:32 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:53:32 user nova-compute[73917]:   </clock>
Aug 26 19:53:32 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:53:32 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:53:32 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:53:32 user nova-compute[73917]:   </cpu>
Aug 26 19:53:32 user nova-compute[73917]:   <devices>
Aug 26 19:53:32 user nova-compute[73917]:     <disk type="block" device="disk">
Aug 26 19:53:32 user nova-compute[73917]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 19:53:32 user nova-compute[73917]:       <source dev="/dev/sdc"/>
Aug 26 19:53:32 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:53:32 user nova-compute[73917]:       <serial>3a79e955-1722-4eb4-a611-a24db215ff6d</serial>
Aug 26 19:53:32 user nova-compute[73917]:     </disk>
Aug 26 19:53:32 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:53:32 user nova-compute[73917]:       <mac address="fa:16:3e:f1:51:55"/>
Aug 26 19:53:32 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:53:32 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:53:32 user nova-compute[73917]:       <target dev="tapd06e0da4-66"/>
Aug 26 19:53:32 user nova-compute[73917]:     </interface>
Aug 26 19:53:32 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:53:32 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/894fcf15-b074-4eec-ad92-af1ff0d18467/console.log" append="off"/>
Aug 26 19:53:32 user nova-compute[73917]:     </serial>
Aug 26 19:53:32 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:53:32 user nova-compute[73917]:     <video>
Aug 26 19:53:32 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:53:32 user nova-compute[73917]:     </video>
Aug 26 19:53:32 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:53:32 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:53:32 user nova-compute[73917]:     </rng>
Aug 26 19:53:32 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:53:32 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:53:32 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:53:32 user nova-compute[73917]:     </memballoon>
Aug 26 19:53:32 user nova-compute[73917]:   </devices>
Aug 26 19:53:32 user nova-compute[73917]: </domain>
Aug 26 19:53:32 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:53:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-500509996',display_name='tempest-TestVolumeBootPattern-server-500509996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-500509996',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqOTuWaVQuR1bJ4mXv25/X0179C/SIJgYNBbfkXIuPGnpXFoY3qyn53WKpsBuWyeYwqkadyQdEa1ypBhwuuI/YSnnWyuuNyjACHQ3vbFr+8kYRNqgtXOUIeLTy7CgMupw==',key_name='tempest-TestVolumeBootPattern-1387621208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a6263f314fc43e8aa7a9e0b23f26162',ramdisk_id='',reservation_id='r-hx8ccnw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-534408973',owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:53:13Z,user_data=None,user_id='ed6fbe4e41ef4849934362d43ef97754',uuid=894fcf15-b074-4eec-ad92-af1ff0d18467,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d06e0da4-66a9-4f6e-968d-919178dd845d", "address": "fa:16:3e:f1:51:55", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06e0da4-66", "ovs_interfaceid": "d06e0da4-66a9-4f6e-968d-919178dd845d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converting VIF {"id": "d06e0da4-66a9-4f6e-968d-919178dd845d", "address": "fa:16:3e:f1:51:55", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06e0da4-66", "ovs_interfaceid": "d06e0da4-66a9-4f6e-968d-919178dd845d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:51:55,bridge_name='br-int',has_traffic_filtering=True,id=d06e0da4-66a9-4f6e-968d-919178dd845d,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06e0da4-66') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG os_vif [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:51:55,bridge_name='br-int',has_traffic_filtering=True,id=d06e0da4-66a9-4f6e-968d-919178dd845d,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06e0da4-66') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd06e0da4-66, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd06e0da4-66, col_values=(('external_ids', {'iface-id': 'd06e0da4-66a9-4f6e-968d-919178dd845d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:51:55', 'vm-uuid': '894fcf15-b074-4eec-ad92-af1ff0d18467'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:32 user nova-compute[73917]: INFO os_vif [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:51:55,bridge_name='br-int',has_traffic_filtering=True,id=d06e0da4-66a9-4f6e-968d-919178dd845d,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06e0da4-66')
Aug 26 19:53:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:53:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] No VIF found with MAC fa:16:3e:f1:51:55, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:53:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:53:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:53:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:53:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:53:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:53:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:53:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-869ac187-a9ab-4e49-bdbd-1b4fbb025e34 req-fc1efecb-d553-4c8d-8f15-07631d63a410 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Received event network-vif-plugged-d06e0da4-66a9-4f6e-968d-919178dd845d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:53:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-869ac187-a9ab-4e49-bdbd-1b4fbb025e34 req-fc1efecb-d553-4c8d-8f15-07631d63a410 service nova] Acquiring lock "894fcf15-b074-4eec-ad92-af1ff0d18467-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:53:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-869ac187-a9ab-4e49-bdbd-1b4fbb025e34 req-fc1efecb-d553-4c8d-8f15-07631d63a410 service nova] Lock "894fcf15-b074-4eec-ad92-af1ff0d18467-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:53:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-869ac187-a9ab-4e49-bdbd-1b4fbb025e34 req-fc1efecb-d553-4c8d-8f15-07631d63a410 service nova] Lock "894fcf15-b074-4eec-ad92-af1ff0d18467-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:53:33 user nova-compute[73917]: DEBUG nova.compute.manager [req-869ac187-a9ab-4e49-bdbd-1b4fbb025e34 req-fc1efecb-d553-4c8d-8f15-07631d63a410 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] No waiting events found dispatching network-vif-plugged-d06e0da4-66a9-4f6e-968d-919178dd845d {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:53:33 user nova-compute[73917]: WARNING nova.compute.manager [req-869ac187-a9ab-4e49-bdbd-1b4fbb025e34 req-fc1efecb-d553-4c8d-8f15-07631d63a410 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Received unexpected event network-vif-plugged-d06e0da4-66a9-4f6e-968d-919178dd845d for instance with vm_state building and task_state spawning.
Aug 26 19:53:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:53:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:53:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:34 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:53:34 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:53:34 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8784MB free_disk=25.140121459960938GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:53:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:53:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:53:34 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance b59424cc-9500-4a91-b089-a43e53c1cbb7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:53:34 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 894fcf15-b074-4eec-ad92-af1ff0d18467 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:53:34 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:53:34 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:53:34 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing inventories for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 19:53:34 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating ProviderTree inventory for provider d90ad23a-e063-4f0d-8341-c34e0141d16a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 19:53:34 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating inventory in ProviderTree for provider d90ad23a-e063-4f0d-8341-c34e0141d16a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 19:53:34 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing aggregate associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, aggregates: None {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 19:53:34 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing trait associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 19:53:34 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:53:34 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:53:34 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:53:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:53:35 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693079615.6406825, 894fcf15-b074-4eec-ad92-af1ff0d18467 => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:53:35 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] VM Resumed (Lifecycle Event)
Aug 26 19:53:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:53:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:53:35 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Instance spawned successfully.
Aug 26 19:53:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:53:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:53:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:53:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:53:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:53:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:53:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:53:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:53:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:53:35 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:53:35 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693079615.6422942, 894fcf15-b074-4eec-ad92-af1ff0d18467 => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:53:35 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] VM Started (Lifecycle Event)
Aug 26 19:53:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:53:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:53:35 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:53:35 user nova-compute[73917]: INFO nova.compute.manager [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Took 4.91 seconds to spawn the instance on the hypervisor.
Aug 26 19:53:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:53:35 user nova-compute[73917]: INFO nova.compute.manager [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Took 23.34 seconds to build instance.
Aug 26 19:53:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-fe0c4e1d-0fde-4000-ba2b-71a4f1ade52a tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "894fcf15-b074-4eec-ad92-af1ff0d18467" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.452s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:53:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-d3541a56-2344-4109-afa5-99e713a11990 req-dd6dcdb0-3471-481b-9b9f-be7c270b2df6 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Received event network-vif-plugged-d06e0da4-66a9-4f6e-968d-919178dd845d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:53:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d3541a56-2344-4109-afa5-99e713a11990 req-dd6dcdb0-3471-481b-9b9f-be7c270b2df6 service nova] Acquiring lock "894fcf15-b074-4eec-ad92-af1ff0d18467-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:53:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d3541a56-2344-4109-afa5-99e713a11990 req-dd6dcdb0-3471-481b-9b9f-be7c270b2df6 service nova] Lock "894fcf15-b074-4eec-ad92-af1ff0d18467-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:53:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d3541a56-2344-4109-afa5-99e713a11990 req-dd6dcdb0-3471-481b-9b9f-be7c270b2df6 service nova] Lock "894fcf15-b074-4eec-ad92-af1ff0d18467-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:53:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-d3541a56-2344-4109-afa5-99e713a11990 req-dd6dcdb0-3471-481b-9b9f-be7c270b2df6 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] No waiting events found dispatching network-vif-plugged-d06e0da4-66a9-4f6e-968d-919178dd845d {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:53:35 user nova-compute[73917]: WARNING nova.compute.manager [req-d3541a56-2344-4109-afa5-99e713a11990 req-dd6dcdb0-3471-481b-9b9f-be7c270b2df6 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Received unexpected event network-vif-plugged-d06e0da4-66a9-4f6e-968d-919178dd845d for instance with vm_state active and task_state None.
Aug 26 19:53:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:37 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:53:37 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:53:39 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:53:39 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:53:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:53:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:54 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:53:54 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 19:53:54 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] There are 0 instances to clean {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 19:53:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:56 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:53:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:53:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:54:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:54:04 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:54:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:54:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:54:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:54:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:54:26 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:54:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:54:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:54:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:54:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:54:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:54:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:54:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:54:28 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:54:28 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:54:28 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:54:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:54:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:54:28 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:54:28 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid b59424cc-9500-4a91-b089-a43e53c1cbb7 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:54:28 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Updating instance_info_cache with network_info: [{"id": "e9937a2c-0a4e-428f-980b-fff93b698109", "address": "fa:16:3e:c9:8b:06", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9937a2c-0a", "ovs_interfaceid": "e9937a2c-0a4e-428f-980b-fff93b698109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:54:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:54:28 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:54:29 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:54:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:54:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:54:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:54:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:54:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:54:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:54:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:54:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:54:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:54:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:54:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:54:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:54:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:54:33 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:54:33 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:54:33 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:54:33 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:54:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8694MB free_disk=25.13896942138672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:54:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:54:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:54:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance b59424cc-9500-4a91-b089-a43e53c1cbb7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:54:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 894fcf15-b074-4eec-ad92-af1ff0d18467 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:54:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:54:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:54:33 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:54:33 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:54:33 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:54:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:54:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:54:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:54:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:54:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:54:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:54:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:54:37 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:54:40 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:54:41 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:54:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:54:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:54:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:54:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:54:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:54:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:54:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:54:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:54:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:54:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:54:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:54:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:54:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:54:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:54:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:54:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:54:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:54:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:54:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:54:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:54:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:54:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:54:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:54:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:55:01 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:55:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid b59424cc-9500-4a91-b089-a43e53c1cbb7 {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:55:01 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid 894fcf15-b074-4eec-ad92-af1ff0d18467 {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 19:55:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "b59424cc-9500-4a91-b089-a43e53c1cbb7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:55:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "b59424cc-9500-4a91-b089-a43e53c1cbb7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:55:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "894fcf15-b074-4eec-ad92-af1ff0d18467" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:55:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "894fcf15-b074-4eec-ad92-af1ff0d18467" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:55:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "b59424cc-9500-4a91-b089-a43e53c1cbb7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:55:01 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "894fcf15-b074-4eec-ad92-af1ff0d18467" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:55:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:55:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:55:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:55:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:55:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:55:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:55:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:55:04 user nova-compute[73917]: DEBUG nova.compute.manager [req-a2620274-c2d0-46c8-af2e-fe057ff1d674 req-0358b022-a601-47c3-8e59-771ad09be0a4 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Received event network-changed-d06e0da4-66a9-4f6e-968d-919178dd845d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:55:04 user nova-compute[73917]: DEBUG nova.compute.manager [req-a2620274-c2d0-46c8-af2e-fe057ff1d674 req-0358b022-a601-47c3-8e59-771ad09be0a4 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Refreshing instance network info cache due to event network-changed-d06e0da4-66a9-4f6e-968d-919178dd845d. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:55:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a2620274-c2d0-46c8-af2e-fe057ff1d674 req-0358b022-a601-47c3-8e59-771ad09be0a4 service nova] Acquiring lock "refresh_cache-894fcf15-b074-4eec-ad92-af1ff0d18467" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:55:04 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a2620274-c2d0-46c8-af2e-fe057ff1d674 req-0358b022-a601-47c3-8e59-771ad09be0a4 service nova] Acquired lock "refresh_cache-894fcf15-b074-4eec-ad92-af1ff0d18467" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:55:04 user nova-compute[73917]: DEBUG nova.network.neutron [req-a2620274-c2d0-46c8-af2e-fe057ff1d674 req-0358b022-a601-47c3-8e59-771ad09be0a4 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Refreshing network info cache for port d06e0da4-66a9-4f6e-968d-919178dd845d {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:55:05 user nova-compute[73917]: DEBUG nova.network.neutron [req-a2620274-c2d0-46c8-af2e-fe057ff1d674 req-0358b022-a601-47c3-8e59-771ad09be0a4 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Updated VIF entry in instance network info cache for port d06e0da4-66a9-4f6e-968d-919178dd845d. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:55:05 user nova-compute[73917]: DEBUG nova.network.neutron [req-a2620274-c2d0-46c8-af2e-fe057ff1d674 req-0358b022-a601-47c3-8e59-771ad09be0a4 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Updating instance_info_cache with network_info: [{"id": "d06e0da4-66a9-4f6e-968d-919178dd845d", "address": "fa:16:3e:f1:51:55", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06e0da4-66", "ovs_interfaceid": "d06e0da4-66a9-4f6e-968d-919178dd845d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:55:05 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a2620274-c2d0-46c8-af2e-fe057ff1d674 req-0358b022-a601-47c3-8e59-771ad09be0a4 service nova] Releasing lock "refresh_cache-894fcf15-b074-4eec-ad92-af1ff0d18467" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG nova.compute.manager [req-a504dd7c-406d-4107-9f13-866014ebd24d req-cf9ea425-254d-4c18-8ba6-92ccefcc3a84 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Received event network-changed-d06e0da4-66a9-4f6e-968d-919178dd845d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG nova.compute.manager [req-a504dd7c-406d-4107-9f13-866014ebd24d req-cf9ea425-254d-4c18-8ba6-92ccefcc3a84 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Refreshing instance network info cache due to event network-changed-d06e0da4-66a9-4f6e-968d-919178dd845d. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a504dd7c-406d-4107-9f13-866014ebd24d req-cf9ea425-254d-4c18-8ba6-92ccefcc3a84 service nova] Acquiring lock "refresh_cache-894fcf15-b074-4eec-ad92-af1ff0d18467" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a504dd7c-406d-4107-9f13-866014ebd24d req-cf9ea425-254d-4c18-8ba6-92ccefcc3a84 service nova] Acquired lock "refresh_cache-894fcf15-b074-4eec-ad92-af1ff0d18467" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG nova.network.neutron [req-a504dd7c-406d-4107-9f13-866014ebd24d req-cf9ea425-254d-4c18-8ba6-92ccefcc3a84 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Refreshing network info cache for port d06e0da4-66a9-4f6e-968d-919178dd845d {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "894fcf15-b074-4eec-ad92-af1ff0d18467" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "894fcf15-b074-4eec-ad92-af1ff0d18467" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "894fcf15-b074-4eec-ad92-af1ff0d18467-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "894fcf15-b074-4eec-ad92-af1ff0d18467-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "894fcf15-b074-4eec-ad92-af1ff0d18467-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:55:06 user nova-compute[73917]: INFO nova.compute.manager [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Terminating instance
Aug 26 19:55:06 user nova-compute[73917]: DEBUG nova.compute.manager [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG nova.compute.manager [req-d68fee63-ca9a-4bc3-8200-0b13022f20de req-8723804f-fbc5-4d6c-8b8f-2811549cf3d8 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Received event network-vif-unplugged-d06e0da4-66a9-4f6e-968d-919178dd845d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d68fee63-ca9a-4bc3-8200-0b13022f20de req-8723804f-fbc5-4d6c-8b8f-2811549cf3d8 service nova] Acquiring lock "894fcf15-b074-4eec-ad92-af1ff0d18467-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d68fee63-ca9a-4bc3-8200-0b13022f20de req-8723804f-fbc5-4d6c-8b8f-2811549cf3d8 service nova] Lock "894fcf15-b074-4eec-ad92-af1ff0d18467-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-d68fee63-ca9a-4bc3-8200-0b13022f20de req-8723804f-fbc5-4d6c-8b8f-2811549cf3d8 service nova] Lock "894fcf15-b074-4eec-ad92-af1ff0d18467-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG nova.compute.manager [req-d68fee63-ca9a-4bc3-8200-0b13022f20de req-8723804f-fbc5-4d6c-8b8f-2811549cf3d8 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] No waiting events found dispatching network-vif-unplugged-d06e0da4-66a9-4f6e-968d-919178dd845d {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG nova.compute.manager [req-d68fee63-ca9a-4bc3-8200-0b13022f20de req-8723804f-fbc5-4d6c-8b8f-2811549cf3d8 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Received event network-vif-unplugged-d06e0da4-66a9-4f6e-968d-919178dd845d for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG nova.network.neutron [req-a504dd7c-406d-4107-9f13-866014ebd24d req-cf9ea425-254d-4c18-8ba6-92ccefcc3a84 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Updated VIF entry in instance network info cache for port d06e0da4-66a9-4f6e-968d-919178dd845d. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG nova.network.neutron [req-a504dd7c-406d-4107-9f13-866014ebd24d req-cf9ea425-254d-4c18-8ba6-92ccefcc3a84 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Updating instance_info_cache with network_info: [{"id": "d06e0da4-66a9-4f6e-968d-919178dd845d", "address": "fa:16:3e:f1:51:55", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06e0da4-66", "ovs_interfaceid": "d06e0da4-66a9-4f6e-968d-919178dd845d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:55:06 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-a504dd7c-406d-4107-9f13-866014ebd24d req-cf9ea425-254d-4c18-8ba6-92ccefcc3a84 service nova] Releasing lock "refresh_cache-894fcf15-b074-4eec-ad92-af1ff0d18467" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:55:07 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Instance destroyed successfully.
Aug 26 19:55:07 user nova-compute[73917]: DEBUG nova.objects.instance [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lazy-loading 'resources' on Instance uuid 894fcf15-b074-4eec-ad92-af1ff0d18467 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:53:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-500509996',display_name='tempest-TestVolumeBootPattern-server-500509996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-500509996',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqOTuWaVQuR1bJ4mXv25/X0179C/SIJgYNBbfkXIuPGnpXFoY3qyn53WKpsBuWyeYwqkadyQdEa1ypBhwuuI/YSnnWyuuNyjACHQ3vbFr+8kYRNqgtXOUIeLTy7CgMupw==',key_name='tempest-TestVolumeBootPattern-1387621208',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:53:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a6263f314fc43e8aa7a9e0b23f26162',ramdisk_id='',reservation_id='r-hx8ccnw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-534408973',owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:53:36Z,user_data=None,user_id='ed6fbe4e41ef4849934362d43ef97754',uuid=894fcf15-b074-4eec-ad92-af1ff0d18467,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d06e0da4-66a9-4f6e-968d-919178dd845d", "address": "fa:16:3e:f1:51:55", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06e0da4-66", "ovs_interfaceid": "d06e0da4-66a9-4f6e-968d-919178dd845d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converting VIF {"id": "d06e0da4-66a9-4f6e-968d-919178dd845d", "address": "fa:16:3e:f1:51:55", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06e0da4-66", "ovs_interfaceid": "d06e0da4-66a9-4f6e-968d-919178dd845d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:51:55,bridge_name='br-int',has_traffic_filtering=True,id=d06e0da4-66a9-4f6e-968d-919178dd845d,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06e0da4-66') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG os_vif [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:51:55,bridge_name='br-int',has_traffic_filtering=True,id=d06e0da4-66a9-4f6e-968d-919178dd845d,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06e0da4-66') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd06e0da4-66, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:55:07 user nova-compute[73917]: INFO os_vif [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:51:55,bridge_name='br-int',has_traffic_filtering=True,id=d06e0da4-66a9-4f6e-968d-919178dd845d,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06e0da4-66')
Aug 26 19:55:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEfHIepc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:55:07 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:55:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[be310c84-71ca-424b-9dde-348876fb825e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf6ae9c-2975-4441-aece-5a06fefd7767]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)
Aug 26 19:55:07 user nova-compute[73917]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d (non-flash)
Aug 26 19:55:07 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)
Aug 26 19:55:07 user nova-compute[73917]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d (non-flash)
Aug 26 19:55:07 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b98521f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d'): ({'sdc'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Removing single pathed devices sdc {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7c0290-4f59-4b98-9b8e-c9bcf292fd5f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fc615a-1d7e-44a3-a910-6f8330b1b78d]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Flushing IO for device /dev/sdc {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d7567d-c0f6-4b08-b7cb-f6a52117342d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.067s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d32f3ea-4342-4bec-a741-0de6c9bdfc28]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] SCSI volumes sdc have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc449c28-2492-4f1d-b20f-072b58ab7546]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fe9f47-4cf0-424f-a7f9-5f1c2b06ebe9]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d, portal: 172.16.0.220,3260]
Aug 26 19:55:07 user nova-compute[73917]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d, portal: 172.16.0.220,3260] successful.
Aug 26 19:55:07 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a79e955-1722-4eb4-a611-a24db215ff6d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b829127-d2b1-416a-b8f4-b79399d1c4ee]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] <== disconnect_volume: return (312ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:55:07 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Deleting instance files /opt/stack/data/nova/instances/894fcf15-b074-4eec-ad92-af1ff0d18467_del
Aug 26 19:55:07 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Deletion of /opt/stack/data/nova/instances/894fcf15-b074-4eec-ad92-af1ff0d18467_del complete
Aug 26 19:55:07 user nova-compute[73917]: INFO nova.compute.manager [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 26 19:55:07 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:55:07 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:55:08 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:55:08 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Took 0.50 seconds to deallocate network for instance.
Aug 26 19:55:08 user nova-compute[73917]: INFO nova.compute.manager [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Took 0.77 seconds to detach 1 volumes for instance.
Aug 26 19:55:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:55:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:55:08 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:55:08 user nova-compute[73917]: DEBUG nova.compute.manager [req-8ab134d3-356e-4e50-8c02-9f85e952f5d3 req-cc9e299e-d29e-4b21-826f-62433a1be195 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Received event network-vif-plugged-d06e0da4-66a9-4f6e-968d-919178dd845d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:55:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8ab134d3-356e-4e50-8c02-9f85e952f5d3 req-cc9e299e-d29e-4b21-826f-62433a1be195 service nova] Acquiring lock "894fcf15-b074-4eec-ad92-af1ff0d18467-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:55:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8ab134d3-356e-4e50-8c02-9f85e952f5d3 req-cc9e299e-d29e-4b21-826f-62433a1be195 service nova] Lock "894fcf15-b074-4eec-ad92-af1ff0d18467-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:55:08 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8ab134d3-356e-4e50-8c02-9f85e952f5d3 req-cc9e299e-d29e-4b21-826f-62433a1be195 service nova] Lock "894fcf15-b074-4eec-ad92-af1ff0d18467-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:55:08 user nova-compute[73917]: DEBUG nova.compute.manager [req-8ab134d3-356e-4e50-8c02-9f85e952f5d3 req-cc9e299e-d29e-4b21-826f-62433a1be195 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] No waiting events found dispatching network-vif-plugged-d06e0da4-66a9-4f6e-968d-919178dd845d {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:55:08 user nova-compute[73917]: WARNING nova.compute.manager [req-8ab134d3-356e-4e50-8c02-9f85e952f5d3 req-cc9e299e-d29e-4b21-826f-62433a1be195 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Received unexpected event network-vif-plugged-d06e0da4-66a9-4f6e-968d-919178dd845d for instance with vm_state deleted and task_state None.
Aug 26 19:55:08 user nova-compute[73917]: DEBUG nova.compute.manager [req-8ab134d3-356e-4e50-8c02-9f85e952f5d3 req-cc9e299e-d29e-4b21-826f-62433a1be195 service nova] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Received event network-vif-deleted-d06e0da4-66a9-4f6e-968d-919178dd845d {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:55:08 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:55:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:55:09 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Deleted allocations for instance 894fcf15-b074-4eec-ad92-af1ff0d18467
Aug 26 19:55:09 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-0dacfd8f-3142-4d70-834a-84d7ced28d14 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "894fcf15-b074-4eec-ad92-af1ff0d18467" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.804s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:55:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:55:12 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:55:17 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:55:22 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693079707.0851896, 894fcf15-b074-4eec-ad92-af1ff0d18467 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:55:22 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] VM Stopped (Lifecycle Event)
Aug 26 19:55:22 user nova-compute[73917]: DEBUG nova.compute.manager [None req-5b9706c9-a2f7-4abb-8d84-9d2e413402bb None None] [instance: 894fcf15-b074-4eec-ad92-af1ff0d18467] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:55:22 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:55:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:55:27 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:55:27 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:55:29 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:55:30 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:55:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:55:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Didn't find any instances for network info cache update. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 19:55:32 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:55:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:55:34 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:55:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:55:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:55:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:55:34 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:55:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73917) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 19:55:34 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:55:34 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:55:34 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8796MB free_disk=25.138080596923828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:55:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:55:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:55:34 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance b59424cc-9500-4a91-b089-a43e53c1cbb7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:55:34 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:55:34 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:55:34 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:55:34 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:55:34 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:55:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:55:35 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:55:37 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:55:38 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:55:40 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:55:41 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:55:42 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:55:42 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:55:47 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:55:52 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:55:57 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:56:02 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:56:07 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:56:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:56:10 user nova-compute[73917]: DEBUG nova.compute.manager [req-27269886-7264-4ea5-ab50-f3cb45719943 req-74aa389c-7bc4-4ee8-9bf3-69dbad10da4d service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Received event network-changed-e9937a2c-0a4e-428f-980b-fff93b698109 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:56:10 user nova-compute[73917]: DEBUG nova.compute.manager [req-27269886-7264-4ea5-ab50-f3cb45719943 req-74aa389c-7bc4-4ee8-9bf3-69dbad10da4d service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Refreshing instance network info cache due to event network-changed-e9937a2c-0a4e-428f-980b-fff93b698109. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:56:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-27269886-7264-4ea5-ab50-f3cb45719943 req-74aa389c-7bc4-4ee8-9bf3-69dbad10da4d service nova] Acquiring lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:56:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-27269886-7264-4ea5-ab50-f3cb45719943 req-74aa389c-7bc4-4ee8-9bf3-69dbad10da4d service nova] Acquired lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:56:10 user nova-compute[73917]: DEBUG nova.network.neutron [req-27269886-7264-4ea5-ab50-f3cb45719943 req-74aa389c-7bc4-4ee8-9bf3-69dbad10da4d service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Refreshing network info cache for port e9937a2c-0a4e-428f-980b-fff93b698109 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:56:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "b59424cc-9500-4a91-b089-a43e53c1cbb7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:56:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "b59424cc-9500-4a91-b089-a43e53c1cbb7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:56:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "b59424cc-9500-4a91-b089-a43e53c1cbb7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:56:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "b59424cc-9500-4a91-b089-a43e53c1cbb7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:56:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "b59424cc-9500-4a91-b089-a43e53c1cbb7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:56:10 user nova-compute[73917]: INFO nova.compute.manager [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Terminating instance
Aug 26 19:56:10 user nova-compute[73917]: DEBUG nova.compute.manager [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 19:56:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:56:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:56:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:56:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:56:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:56:10 user nova-compute[73917]: DEBUG nova.network.neutron [req-27269886-7264-4ea5-ab50-f3cb45719943 req-74aa389c-7bc4-4ee8-9bf3-69dbad10da4d service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Updated VIF entry in instance network info cache for port e9937a2c-0a4e-428f-980b-fff93b698109. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:56:10 user nova-compute[73917]: DEBUG nova.network.neutron [req-27269886-7264-4ea5-ab50-f3cb45719943 req-74aa389c-7bc4-4ee8-9bf3-69dbad10da4d service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Updating instance_info_cache with network_info: [{"id": "e9937a2c-0a4e-428f-980b-fff93b698109", "address": "fa:16:3e:c9:8b:06", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9937a2c-0a", "ovs_interfaceid": "e9937a2c-0a4e-428f-980b-fff93b698109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:56:10 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-27269886-7264-4ea5-ab50-f3cb45719943 req-74aa389c-7bc4-4ee8-9bf3-69dbad10da4d service nova] Releasing lock "refresh_cache-b59424cc-9500-4a91-b089-a43e53c1cbb7" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:56:11 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Instance destroyed successfully.
Aug 26 19:56:11 user nova-compute[73917]: DEBUG nova.objects.instance [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lazy-loading 'resources' on Instance uuid b59424cc-9500-4a91-b089-a43e53c1cbb7 {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:51:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1008885780',display_name='tempest-TestVolumeBootPattern-server-1008885780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1008885780',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqOTuWaVQuR1bJ4mXv25/X0179C/SIJgYNBbfkXIuPGnpXFoY3qyn53WKpsBuWyeYwqkadyQdEa1ypBhwuuI/YSnnWyuuNyjACHQ3vbFr+8kYRNqgtXOUIeLTy7CgMupw==',key_name='tempest-TestVolumeBootPattern-1387621208',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:51:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a6263f314fc43e8aa7a9e0b23f26162',ramdisk_id='',reservation_id='r-pztzbotj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-534408973',owner_user_name='tempest-TestVolumeBootPattern-534408973-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:51:22Z,user_data=None,user_id='ed6fbe4e41ef4849934362d43ef97754',uuid=b59424cc-9500-4a91-b089-a43e53c1cbb7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9937a2c-0a4e-428f-980b-fff93b698109", "address": "fa:16:3e:c9:8b:06", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9937a2c-0a", "ovs_interfaceid": "e9937a2c-0a4e-428f-980b-fff93b698109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converting VIF {"id": "e9937a2c-0a4e-428f-980b-fff93b698109", "address": "fa:16:3e:c9:8b:06", "network": {"id": "55aef704-25d2-437d-a825-7a62f550321d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-628863893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6263f314fc43e8aa7a9e0b23f26162", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9937a2c-0a", "ovs_interfaceid": "e9937a2c-0a4e-428f-980b-fff93b698109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:8b:06,bridge_name='br-int',has_traffic_filtering=True,id=e9937a2c-0a4e-428f-980b-fff93b698109,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9937a2c-0a') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG os_vif [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:8b:06,bridge_name='br-int',has_traffic_filtering=True,id=e9937a2c-0a4e-428f-980b-fff93b698109,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9937a2c-0a') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9937a2c-0a, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:56:11 user nova-compute[73917]: INFO os_vif [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:8b:06,bridge_name='br-int',has_traffic_filtering=True,id=e9937a2c-0a4e-428f-980b-fff93b698109,network=Network(55aef704-25d2-437d-a825-7a62f550321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9937a2c-0a')
Aug 26 19:56:11 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEUroyPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 19:56:11 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 19:56:11 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[515f9aff-948b-4c9f-b9ce-564c2999799a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa9b954-a8df-44dc-a598-18c9fd043585]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)
Aug 26 19:56:11 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 (non-flash)
Aug 26 19:56:11 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b784ec160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85'): ({'sdb'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Removing single pathed devices sdb {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7747418d-182a-4a65-a792-4ea61ca108d0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[da148d82-fda5-4a4f-9b4d-3450332e02c2]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Flushing IO for device /dev/sdb {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5861e4-aa1f-4bb2-bdb1-065bdf62d6eb]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8710e20-4dc7-47b6-824e-771d0fe719d8]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23962383362653765', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fb78377b', '/dev/disk/by-id/scsi-1SCST_BIOfb78377b-9b83be7ef6100583') {{(pid=85467) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[11067b5d-7751-41de-b945-4a6272d0079f]: (4, None) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[498570e6-7c15-486f-9d29-0de1d334c836]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd0ef91-ae2c-402f-991a-3030dd52d026]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85, portal: 172.16.0.220,3260]
Aug 26 19:56:11 user nova-compute[73917]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85, portal: 172.16.0.220,3260] successful.
Aug 26 19:56:11 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b72135-dd05-40c9-980e-9e71448e7e85 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4a96ea-b8e8-42da-be60-d444d27bfb5d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] <== disconnect_volume: return (263ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 19:56:11 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Deleting instance files /opt/stack/data/nova/instances/b59424cc-9500-4a91-b089-a43e53c1cbb7_del
Aug 26 19:56:11 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Deletion of /opt/stack/data/nova/instances/b59424cc-9500-4a91-b089-a43e53c1cbb7_del complete
Aug 26 19:56:11 user nova-compute[73917]: INFO nova.compute.manager [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 26 19:56:11 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 19:56:11 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:56:11 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Took 0.51 seconds to deallocate network for instance.
Aug 26 19:56:12 user nova-compute[73917]: DEBUG nova.compute.manager [req-88ad6363-15e1-4331-ba31-dee3773aa572 req-87b201cf-df3d-4302-a8f3-a285cc00178b service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Received event network-vif-deleted-e9937a2c-0a4e-428f-980b-fff93b698109 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:56:12 user nova-compute[73917]: DEBUG nova.compute.manager [req-4dfc659f-f76e-40fa-a6a0-d9569432cf3b req-62fcf653-dfef-415c-9799-e3ae3744accd service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Received event network-vif-unplugged-e9937a2c-0a4e-428f-980b-fff93b698109 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:56:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4dfc659f-f76e-40fa-a6a0-d9569432cf3b req-62fcf653-dfef-415c-9799-e3ae3744accd service nova] Acquiring lock "b59424cc-9500-4a91-b089-a43e53c1cbb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:56:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4dfc659f-f76e-40fa-a6a0-d9569432cf3b req-62fcf653-dfef-415c-9799-e3ae3744accd service nova] Lock "b59424cc-9500-4a91-b089-a43e53c1cbb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:56:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4dfc659f-f76e-40fa-a6a0-d9569432cf3b req-62fcf653-dfef-415c-9799-e3ae3744accd service nova] Lock "b59424cc-9500-4a91-b089-a43e53c1cbb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:56:12 user nova-compute[73917]: DEBUG nova.compute.manager [req-4dfc659f-f76e-40fa-a6a0-d9569432cf3b req-62fcf653-dfef-415c-9799-e3ae3744accd service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] No waiting events found dispatching network-vif-unplugged-e9937a2c-0a4e-428f-980b-fff93b698109 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:56:12 user nova-compute[73917]: DEBUG nova.compute.manager [req-4dfc659f-f76e-40fa-a6a0-d9569432cf3b req-62fcf653-dfef-415c-9799-e3ae3744accd service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Received event network-vif-unplugged-e9937a2c-0a4e-428f-980b-fff93b698109 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 19:56:12 user nova-compute[73917]: DEBUG nova.compute.manager [req-4dfc659f-f76e-40fa-a6a0-d9569432cf3b req-62fcf653-dfef-415c-9799-e3ae3744accd service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Received event network-vif-plugged-e9937a2c-0a4e-428f-980b-fff93b698109 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:56:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4dfc659f-f76e-40fa-a6a0-d9569432cf3b req-62fcf653-dfef-415c-9799-e3ae3744accd service nova] Acquiring lock "b59424cc-9500-4a91-b089-a43e53c1cbb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:56:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4dfc659f-f76e-40fa-a6a0-d9569432cf3b req-62fcf653-dfef-415c-9799-e3ae3744accd service nova] Lock "b59424cc-9500-4a91-b089-a43e53c1cbb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:56:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-4dfc659f-f76e-40fa-a6a0-d9569432cf3b req-62fcf653-dfef-415c-9799-e3ae3744accd service nova] Lock "b59424cc-9500-4a91-b089-a43e53c1cbb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:56:12 user nova-compute[73917]: DEBUG nova.compute.manager [req-4dfc659f-f76e-40fa-a6a0-d9569432cf3b req-62fcf653-dfef-415c-9799-e3ae3744accd service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] No waiting events found dispatching network-vif-plugged-e9937a2c-0a4e-428f-980b-fff93b698109 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:56:12 user nova-compute[73917]: WARNING nova.compute.manager [req-4dfc659f-f76e-40fa-a6a0-d9569432cf3b req-62fcf653-dfef-415c-9799-e3ae3744accd service nova] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Received unexpected event network-vif-plugged-e9937a2c-0a4e-428f-980b-fff93b698109 for instance with vm_state active and task_state deleting.
Aug 26 19:56:12 user nova-compute[73917]: INFO nova.compute.manager [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Took 0.74 seconds to detach 1 volumes for instance.
Aug 26 19:56:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:56:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:56:12 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:56:12 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:56:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:56:13 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Deleted allocations for instance b59424cc-9500-4a91-b089-a43e53c1cbb7
Aug 26 19:56:13 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-ba75fda2-b294-47b1-af3a-361aa4872fc4 tempest-TestVolumeBootPattern-534408973 tempest-TestVolumeBootPattern-534408973-project-member] Lock "b59424cc-9500-4a91-b089-a43e53c1cbb7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.783s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:56:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:56:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:56:26 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693079771.0912817, b59424cc-9500-4a91-b089-a43e53c1cbb7 => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:56:26 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] VM Stopped (Lifecycle Event)
Aug 26 19:56:26 user nova-compute[73917]: DEBUG nova.compute.manager [None req-9d5ee39d-b676-41c9-817a-d1dd256844b3 None None] [instance: b59424cc-9500-4a91-b089-a43e53c1cbb7] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:56:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:56:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:56:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:56:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:56:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:56:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:56:29 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:56:29 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:56:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:56:30 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:56:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:56:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:56:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Didn't find any instances for network info cache update. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 19:56:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:56:34 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:56:35 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:56:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:56:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:56:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:56:35 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:56:35 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:56:35 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:56:35 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8935MB free_disk=25.13718032836914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:56:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:56:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:56:35 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:56:35 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:56:35 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:56:35 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:56:35 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:56:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:56:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:56:36 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:56:38 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:56:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:56:41 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:56:42 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:56:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:56:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:56:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:56:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:56:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:56:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:56:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:56:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:56:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:56:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:56:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:56:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:56:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:57:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:57:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:57:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:57:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:57:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:57:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:57:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:57:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:57:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:57:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:57:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:57:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:57:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:57:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:57:29 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:57:30 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:57:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:57:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:57:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Didn't find any instances for network info cache update. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 19:57:30 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:57:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:57:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:57:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:57:36 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:57:36 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:57:37 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:57:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:57:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:57:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:57:37 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:57:37 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:57:37 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:57:37 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8941MB free_disk=25.127567291259766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:57:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:57:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:57:37 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:57:37 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:57:37 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:57:37 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:57:37 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:57:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.120s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:57:40 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:57:40 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:57:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:57:41 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:57:43 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:57:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:57:51 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:57:56 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:58:01 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:58:06 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:58:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:58:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:58:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:58:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:58:11 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:16 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:58:21 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:27 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:30 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:58:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:58:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:58:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Didn't find any instances for network info cache update. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 19:58:30 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:58:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:58:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:31 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:31 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:58:34 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:58:34 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73917) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 19:58:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:36 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:58:36 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:58:36 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:39 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:58:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:58:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:58:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:58:39 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:58:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:39 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:58:39 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:58:39 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8640MB free_disk=25.12277603149414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:58:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:58:39 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:58:40 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:58:40 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:58:40 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing inventories for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 19:58:40 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating ProviderTree inventory for provider d90ad23a-e063-4f0d-8341-c34e0141d16a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 19:58:40 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating inventory in ProviderTree for provider d90ad23a-e063-4f0d-8341-c34e0141d16a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 19:58:40 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing aggregate associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, aggregates: None {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 19:58:40 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing trait associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 19:58:40 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:58:40 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:58:40 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:58:40 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:58:41 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:42 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:58:43 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:58:43 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:58:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:58:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:58:44 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Starting instance... {{(pid=73917) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 19:58:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:58:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:58:44 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73917) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 19:58:44 user nova-compute[73917]: INFO nova.compute.claims [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Claim successful on node user
Aug 26 19:58:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:44 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:58:44 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:58:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.253s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:58:44 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Start building networks asynchronously for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 19:58:44 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Allocating IP information in the background. {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 19:58:44 user nova-compute[73917]: DEBUG nova.network.neutron [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] allocate_for_instance() {{(pid=73917) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 19:58:44 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 19:58:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Start building block device mappings for instance. {{(pid=73917) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 19:58:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Start spawning the instance on the hypervisor. {{(pid=73917) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 19:58:45 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Creating instance directory {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 19:58:45 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Creating image(s)
Aug 26 19:58:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:58:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "/opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:58:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "/opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:58:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:58:45 user nova-compute[73917]: DEBUG nova.policy [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3991130d76bc41ec82f77334057d79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2867b47e685f410a9635dd60a921cc6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73917) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 19:58:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.204s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:58:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "4f37e989d3799e2557b7d801beb54130e96d26a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:58:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:58:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:58:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.205s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:58:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk 1073741824 {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:58:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2,backing_fmt=raw /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk 1073741824" returned: 0 in 0.064s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:58:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "4f37e989d3799e2557b7d801beb54130e96d26a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:58:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:58:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f37e989d3799e2557b7d801beb54130e96d26a2 --force-share --output=json" returned: 0 in 0.211s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:58:46 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk. size=1073741824 {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 19:58:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:58:46 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:46 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:58:46 user nova-compute[73917]: DEBUG nova.virt.disk.api [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Cannot resize image /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk to a smaller size. {{(pid=73917) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 19:58:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Created local disks {{(pid=73917) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 19:58:46 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Ensure instance console log exists: /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/console.log {{(pid=73917) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 19:58:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:58:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:58:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:58:46 user nova-compute[73917]: DEBUG nova.network.neutron [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Successfully created port: d88275bf-3bd9-43bc-96d3-eaf1b65f3705 {{(pid=73917) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG nova.network.neutron [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Successfully updated port: d88275bf-3bd9-43bc-96d3-eaf1b65f3705 {{(pid=73917) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquired lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG nova.network.neutron [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Building network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG nova.compute.manager [req-1af89420-ba78-420a-b376-9ed2980d87e0 req-5b43f700-bb5f-4b0d-80d8-5254754f074e service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Received event network-changed-d88275bf-3bd9-43bc-96d3-eaf1b65f3705 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG nova.compute.manager [req-1af89420-ba78-420a-b376-9ed2980d87e0 req-5b43f700-bb5f-4b0d-80d8-5254754f074e service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Refreshing instance network info cache due to event network-changed-d88275bf-3bd9-43bc-96d3-eaf1b65f3705. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1af89420-ba78-420a-b376-9ed2980d87e0 req-5b43f700-bb5f-4b0d-80d8-5254754f074e service nova] Acquiring lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG nova.network.neutron [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Instance cache missing network info. {{(pid=73917) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG nova.network.neutron [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updating instance_info_cache with network_info: [{"id": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "address": "fa:16:3e:65:59:c2", "network": {"id": "f05abe25-637f-4c1c-8157-461cd7ca3f5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1637595303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2867b47e685f410a9635dd60a921cc6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88275bf-3b", "ovs_interfaceid": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Releasing lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Instance network_info: |[{"id": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "address": "fa:16:3e:65:59:c2", "network": {"id": "f05abe25-637f-4c1c-8157-461cd7ca3f5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1637595303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2867b47e685f410a9635dd60a921cc6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88275bf-3b", "ovs_interfaceid": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73917) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1af89420-ba78-420a-b376-9ed2980d87e0 req-5b43f700-bb5f-4b0d-80d8-5254754f074e service nova] Acquired lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG nova.network.neutron [req-1af89420-ba78-420a-b376-9ed2980d87e0 req-5b43f700-bb5f-4b0d-80d8-5254754f074e service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Refreshing network info cache for port d88275bf-3bd9-43bc-96d3-eaf1b65f3705 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Start _get_guest_xml network_info=[{"id": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "address": "fa:16:3e:65:59:c2", "network": {"id": "f05abe25-637f-4c1c-8157-461cd7ca3f5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1637595303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2867b47e685f410a9635dd60a921cc6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88275bf-3b", "ovs_interfaceid": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '7a0152a1-b7ea-410d-a483-7d6785711f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 19:58:47 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:58:47 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:58:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] CPU controller missing on host. {{(pid=73917) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.host [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] CPU controller found on host. {{(pid=73917) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73917) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T19:03:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T19:03:13Z,direct_url=<?>,disk_format='qcow2',id=7a0152a1-b7ea-410d-a483-7d6785711f32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='4f48ef7195434beeafa4341e0e7018ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T19:03:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Flavor limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 19:58:47 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Image limits 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Flavor pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Image pref 0:0:0 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Got 1 possible topologies {{(pid=73917) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG nova.virt.hardware [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73917) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:58:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2066860557',display_name='tempest-SnapshotDataIntegrityTests-server-2066860557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2066860557',id=53,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnxeKqwU6bpm63Ko/5mxMzLSidqHzdVrJaO9X+8AYp06rtLE7Xi8Bw7K7ypVQlVtwN8zxk6xDAyOg1e+j4Tc3jlGzIfxuvfba9ov0NHa1jk9p+iiTypLCr0iVal75W4pw==',key_name='tempest-keypair-714542191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2867b47e685f410a9635dd60a921cc6d',ramdisk_id='',reservation_id='r-lvnotd7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1073781911',owner_user_name='tempest-SnapshotDataIntegrityTests-1073781911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:58:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3991130d76bc41ec82f77334057d79a5',uuid=9ffed053-f186-45a6-8a78-c95d5e2de9fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "address": "fa:16:3e:65:59:c2", "network": {"id": "f05abe25-637f-4c1c-8157-461cd7ca3f5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1637595303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2867b47e685f410a9635dd60a921cc6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88275bf-3b", "ovs_interfaceid": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73917) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Converting VIF {"id": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "address": "fa:16:3e:65:59:c2", "network": {"id": "f05abe25-637f-4c1c-8157-461cd7ca3f5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1637595303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2867b47e685f410a9635dd60a921cc6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88275bf-3b", "ovs_interfaceid": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:59:c2,bridge_name='br-int',has_traffic_filtering=True,id=d88275bf-3bd9-43bc-96d3-eaf1b65f3705,network=Network(f05abe25-637f-4c1c-8157-461cd7ca3f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd88275bf-3b') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG nova.objects.instance [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] End _get_guest_xml xml=<domain type="kvm">
Aug 26 19:58:48 user nova-compute[73917]:   <uuid>9ffed053-f186-45a6-8a78-c95d5e2de9fc</uuid>
Aug 26 19:58:48 user nova-compute[73917]:   <name>instance-00000035</name>
Aug 26 19:58:48 user nova-compute[73917]:   <memory>524288</memory>
Aug 26 19:58:48 user nova-compute[73917]:   <vcpu>1</vcpu>
Aug 26 19:58:48 user nova-compute[73917]:   <metadata>
Aug 26 19:58:48 user nova-compute[73917]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 19:58:48 user nova-compute[73917]:       <nova:package version="0.0.0"/>
Aug 26 19:58:48 user nova-compute[73917]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2066860557</nova:name>
Aug 26 19:58:48 user nova-compute[73917]:       <nova:creationTime>2023-08-26 19:58:47</nova:creationTime>
Aug 26 19:58:48 user nova-compute[73917]:       <nova:flavor name="m1.tiny">
Aug 26 19:58:48 user nova-compute[73917]:         <nova:memory>512</nova:memory>
Aug 26 19:58:48 user nova-compute[73917]:         <nova:disk>1</nova:disk>
Aug 26 19:58:48 user nova-compute[73917]:         <nova:swap>0</nova:swap>
Aug 26 19:58:48 user nova-compute[73917]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 19:58:48 user nova-compute[73917]:         <nova:vcpus>1</nova:vcpus>
Aug 26 19:58:48 user nova-compute[73917]:       </nova:flavor>
Aug 26 19:58:48 user nova-compute[73917]:       <nova:owner>
Aug 26 19:58:48 user nova-compute[73917]:         <nova:user uuid="3991130d76bc41ec82f77334057d79a5">tempest-SnapshotDataIntegrityTests-1073781911-project-member</nova:user>
Aug 26 19:58:48 user nova-compute[73917]:         <nova:project uuid="2867b47e685f410a9635dd60a921cc6d">tempest-SnapshotDataIntegrityTests-1073781911</nova:project>
Aug 26 19:58:48 user nova-compute[73917]:       </nova:owner>
Aug 26 19:58:48 user nova-compute[73917]:       <nova:root type="image" uuid="7a0152a1-b7ea-410d-a483-7d6785711f32"/>
Aug 26 19:58:48 user nova-compute[73917]:       <nova:ports>
Aug 26 19:58:48 user nova-compute[73917]:         <nova:port uuid="d88275bf-3bd9-43bc-96d3-eaf1b65f3705">
Aug 26 19:58:48 user nova-compute[73917]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 19:58:48 user nova-compute[73917]:         </nova:port>
Aug 26 19:58:48 user nova-compute[73917]:       </nova:ports>
Aug 26 19:58:48 user nova-compute[73917]:     </nova:instance>
Aug 26 19:58:48 user nova-compute[73917]:   </metadata>
Aug 26 19:58:48 user nova-compute[73917]:   <sysinfo type="smbios">
Aug 26 19:58:48 user nova-compute[73917]:     <system>
Aug 26 19:58:48 user nova-compute[73917]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 19:58:48 user nova-compute[73917]:       <entry name="product">OpenStack Nova</entry>
Aug 26 19:58:48 user nova-compute[73917]:       <entry name="version">0.0.0</entry>
Aug 26 19:58:48 user nova-compute[73917]:       <entry name="serial">9ffed053-f186-45a6-8a78-c95d5e2de9fc</entry>
Aug 26 19:58:48 user nova-compute[73917]:       <entry name="uuid">9ffed053-f186-45a6-8a78-c95d5e2de9fc</entry>
Aug 26 19:58:48 user nova-compute[73917]:       <entry name="family">Virtual Machine</entry>
Aug 26 19:58:48 user nova-compute[73917]:     </system>
Aug 26 19:58:48 user nova-compute[73917]:   </sysinfo>
Aug 26 19:58:48 user nova-compute[73917]:   <os>
Aug 26 19:58:48 user nova-compute[73917]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 19:58:48 user nova-compute[73917]:     <boot dev="hd"/>
Aug 26 19:58:48 user nova-compute[73917]:     <smbios mode="sysinfo"/>
Aug 26 19:58:48 user nova-compute[73917]:   </os>
Aug 26 19:58:48 user nova-compute[73917]:   <features>
Aug 26 19:58:48 user nova-compute[73917]:     <acpi/>
Aug 26 19:58:48 user nova-compute[73917]:     <apic/>
Aug 26 19:58:48 user nova-compute[73917]:     <vmcoreinfo/>
Aug 26 19:58:48 user nova-compute[73917]:   </features>
Aug 26 19:58:48 user nova-compute[73917]:   <clock offset="utc">
Aug 26 19:58:48 user nova-compute[73917]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 19:58:48 user nova-compute[73917]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 19:58:48 user nova-compute[73917]:     <timer name="hpet" present="no"/>
Aug 26 19:58:48 user nova-compute[73917]:   </clock>
Aug 26 19:58:48 user nova-compute[73917]:   <cpu mode="custom" match="exact">
Aug 26 19:58:48 user nova-compute[73917]:     <model>Nehalem</model>
Aug 26 19:58:48 user nova-compute[73917]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 19:58:48 user nova-compute[73917]:   </cpu>
Aug 26 19:58:48 user nova-compute[73917]:   <devices>
Aug 26 19:58:48 user nova-compute[73917]:     <disk type="file" device="disk">
Aug 26 19:58:48 user nova-compute[73917]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 19:58:48 user nova-compute[73917]:       <source file="/opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk"/>
Aug 26 19:58:48 user nova-compute[73917]:       <target dev="vda" bus="virtio"/>
Aug 26 19:58:48 user nova-compute[73917]:     </disk>
Aug 26 19:58:48 user nova-compute[73917]:     <interface type="ethernet">
Aug 26 19:58:48 user nova-compute[73917]:       <mac address="fa:16:3e:65:59:c2"/>
Aug 26 19:58:48 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:58:48 user nova-compute[73917]:       <mtu size="1442"/>
Aug 26 19:58:48 user nova-compute[73917]:       <target dev="tapd88275bf-3b"/>
Aug 26 19:58:48 user nova-compute[73917]:     </interface>
Aug 26 19:58:48 user nova-compute[73917]:     <serial type="pty">
Aug 26 19:58:48 user nova-compute[73917]:       <log file="/opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/console.log" append="off"/>
Aug 26 19:58:48 user nova-compute[73917]:     </serial>
Aug 26 19:58:48 user nova-compute[73917]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 19:58:48 user nova-compute[73917]:     <video>
Aug 26 19:58:48 user nova-compute[73917]:       <model type="virtio"/>
Aug 26 19:58:48 user nova-compute[73917]:     </video>
Aug 26 19:58:48 user nova-compute[73917]:     <rng model="virtio">
Aug 26 19:58:48 user nova-compute[73917]:       <backend model="random">/dev/urandom</backend>
Aug 26 19:58:48 user nova-compute[73917]:     </rng>
Aug 26 19:58:48 user nova-compute[73917]:     <controller type="usb" index="0" model="none"/>
Aug 26 19:58:48 user nova-compute[73917]:     <memballoon model="virtio">
Aug 26 19:58:48 user nova-compute[73917]:       <stats period="10"/>
Aug 26 19:58:48 user nova-compute[73917]:     </memballoon>
Aug 26 19:58:48 user nova-compute[73917]:   </devices>
Aug 26 19:58:48 user nova-compute[73917]: </domain>
Aug 26 19:58:48 user nova-compute[73917]:  {{(pid=73917) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:58:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2066860557',display_name='tempest-SnapshotDataIntegrityTests-server-2066860557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2066860557',id=53,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnxeKqwU6bpm63Ko/5mxMzLSidqHzdVrJaO9X+8AYp06rtLE7Xi8Bw7K7ypVQlVtwN8zxk6xDAyOg1e+j4Tc3jlGzIfxuvfba9ov0NHa1jk9p+iiTypLCr0iVal75W4pw==',key_name='tempest-keypair-714542191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2867b47e685f410a9635dd60a921cc6d',ramdisk_id='',reservation_id='r-lvnotd7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1073781911',owner_user_name='tempest-SnapshotDataIntegrityTests-1073781911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T19:58:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3991130d76bc41ec82f77334057d79a5',uuid=9ffed053-f186-45a6-8a78-c95d5e2de9fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "address": "fa:16:3e:65:59:c2", "network": {"id": "f05abe25-637f-4c1c-8157-461cd7ca3f5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1637595303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2867b47e685f410a9635dd60a921cc6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88275bf-3b", "ovs_interfaceid": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Converting VIF {"id": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "address": "fa:16:3e:65:59:c2", "network": {"id": "f05abe25-637f-4c1c-8157-461cd7ca3f5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1637595303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2867b47e685f410a9635dd60a921cc6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88275bf-3b", "ovs_interfaceid": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:59:c2,bridge_name='br-int',has_traffic_filtering=True,id=d88275bf-3bd9-43bc-96d3-eaf1b65f3705,network=Network(f05abe25-637f-4c1c-8157-461cd7ca3f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd88275bf-3b') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG os_vif [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:59:c2,bridge_name='br-int',has_traffic_filtering=True,id=d88275bf-3bd9-43bc-96d3-eaf1b65f3705,network=Network(f05abe25-637f-4c1c-8157-461cd7ca3f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd88275bf-3b') {{(pid=73917) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd88275bf-3b, may_exist=True, interface_attrs={}) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd88275bf-3b, col_values=(('external_ids', {'iface-id': 'd88275bf-3bd9-43bc-96d3-eaf1b65f3705', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:59:c2', 'vm-uuid': '9ffed053-f186-45a6-8a78-c95d5e2de9fc'}),), if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:48 user nova-compute[73917]: INFO os_vif [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:59:c2,bridge_name='br-int',has_traffic_filtering=True,id=d88275bf-3bd9-43bc-96d3-eaf1b65f3705,network=Network(f05abe25-637f-4c1c-8157-461cd7ca3f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd88275bf-3b')
Aug 26 19:58:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] No VIF found with MAC fa:16:3e:65:59:c2, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG nova.network.neutron [req-1af89420-ba78-420a-b376-9ed2980d87e0 req-5b43f700-bb5f-4b0d-80d8-5254754f074e service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updated VIF entry in instance network info cache for port d88275bf-3bd9-43bc-96d3-eaf1b65f3705. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG nova.network.neutron [req-1af89420-ba78-420a-b376-9ed2980d87e0 req-5b43f700-bb5f-4b0d-80d8-5254754f074e service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updating instance_info_cache with network_info: [{"id": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "address": "fa:16:3e:65:59:c2", "network": {"id": "f05abe25-637f-4c1c-8157-461cd7ca3f5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1637595303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2867b47e685f410a9635dd60a921cc6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88275bf-3b", "ovs_interfaceid": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:58:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-1af89420-ba78-420a-b376-9ed2980d87e0 req-5b43f700-bb5f-4b0d-80d8-5254754f074e service nova] Releasing lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:58:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:49 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:49 user nova-compute[73917]: DEBUG nova.compute.manager [req-bfa5ba7f-eccb-46b8-93e5-24c6de9f413a req-5d0c42d8-5e48-49b9-8e72-caf7623262cb service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Received event network-vif-plugged-d88275bf-3bd9-43bc-96d3-eaf1b65f3705 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:58:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-bfa5ba7f-eccb-46b8-93e5-24c6de9f413a req-5d0c42d8-5e48-49b9-8e72-caf7623262cb service nova] Acquiring lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:58:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-bfa5ba7f-eccb-46b8-93e5-24c6de9f413a req-5d0c42d8-5e48-49b9-8e72-caf7623262cb service nova] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:58:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-bfa5ba7f-eccb-46b8-93e5-24c6de9f413a req-5d0c42d8-5e48-49b9-8e72-caf7623262cb service nova] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:58:49 user nova-compute[73917]: DEBUG nova.compute.manager [req-bfa5ba7f-eccb-46b8-93e5-24c6de9f413a req-5d0c42d8-5e48-49b9-8e72-caf7623262cb service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] No waiting events found dispatching network-vif-plugged-d88275bf-3bd9-43bc-96d3-eaf1b65f3705 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:58:49 user nova-compute[73917]: WARNING nova.compute.manager [req-bfa5ba7f-eccb-46b8-93e5-24c6de9f413a req-5d0c42d8-5e48-49b9-8e72-caf7623262cb service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Received unexpected event network-vif-plugged-d88275bf-3bd9-43bc-96d3-eaf1b65f3705 for instance with vm_state building and task_state spawning.
Aug 26 19:58:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-545b6d6e-db56-40e1-b7a8-817a58a29e46 req-b6fb8f66-8b6e-4682-afc3-89c7ec7f9643 service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Received event network-vif-plugged-d88275bf-3bd9-43bc-96d3-eaf1b65f3705 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 19:58:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-545b6d6e-db56-40e1-b7a8-817a58a29e46 req-b6fb8f66-8b6e-4682-afc3-89c7ec7f9643 service nova] Acquiring lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:58:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-545b6d6e-db56-40e1-b7a8-817a58a29e46 req-b6fb8f66-8b6e-4682-afc3-89c7ec7f9643 service nova] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:58:51 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-545b6d6e-db56-40e1-b7a8-817a58a29e46 req-b6fb8f66-8b6e-4682-afc3-89c7ec7f9643 service nova] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:58:51 user nova-compute[73917]: DEBUG nova.compute.manager [req-545b6d6e-db56-40e1-b7a8-817a58a29e46 req-b6fb8f66-8b6e-4682-afc3-89c7ec7f9643 service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] No waiting events found dispatching network-vif-plugged-d88275bf-3bd9-43bc-96d3-eaf1b65f3705 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 19:58:51 user nova-compute[73917]: WARNING nova.compute.manager [req-545b6d6e-db56-40e1-b7a8-817a58a29e46 req-b6fb8f66-8b6e-4682-afc3-89c7ec7f9643 service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Received unexpected event network-vif-plugged-d88275bf-3bd9-43bc-96d3-eaf1b65f3705 for instance with vm_state building and task_state spawning.
Aug 26 19:58:51 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693079931.9926503, 9ffed053-f186-45a6-8a78-c95d5e2de9fc => Resumed> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:58:51 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] VM Resumed (Lifecycle Event)
Aug 26 19:58:51 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Instance event wait completed in 0 seconds for  {{(pid=73917) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 19:58:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Guest created on hypervisor {{(pid=73917) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 19:58:52 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Instance spawned successfully.
Aug 26 19:58:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 19:58:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:58:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:58:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Found default for hw_cdrom_bus of ide {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:58:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Found default for hw_disk_bus of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:58:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Found default for hw_input_bus of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:58:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Found default for hw_pointer_model of None {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:58:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Found default for hw_video_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:58:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Found default for hw_vif_model of virtio {{(pid=73917) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 19:58:52 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:58:52 user nova-compute[73917]: DEBUG nova.virt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Emitting event <LifecycleEvent: 1693079931.9938369, 9ffed053-f186-45a6-8a78-c95d5e2de9fc => Started> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 19:58:52 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] VM Started (Lifecycle Event)
Aug 26 19:58:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:58:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73917) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 19:58:52 user nova-compute[73917]: INFO nova.compute.manager [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 19:58:52 user nova-compute[73917]: INFO nova.compute.manager [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Took 6.80 seconds to spawn the instance on the hypervisor.
Aug 26 19:58:52 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 19:58:52 user nova-compute[73917]: INFO nova.compute.manager [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Took 7.86 seconds to build instance.
Aug 26 19:58:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d3a66ec5-7316-4e80-9918-937b9c54846e tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.999s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:58:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:58:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:59:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:59:05 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:59:05 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 19:59:05 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] There are 0 instances to clean {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 19:59:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:59:09 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:59:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:59:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:59:14 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:59:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:59:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:59:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:59:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:59:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:59:30 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:59:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 19:59:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 19:59:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 19:59:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 19:59:30 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 19:59:30 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 19:59:30 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updating instance_info_cache with network_info: [{"id": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "address": "fa:16:3e:65:59:c2", "network": {"id": "f05abe25-637f-4c1c-8157-461cd7ca3f5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1637595303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2867b47e685f410a9635dd60a921cc6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88275bf-3b", "ovs_interfaceid": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 19:59:30 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 19:59:30 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 19:59:31 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:59:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 19:59:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 19:59:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:59:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 19:59:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:59:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 19:59:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:59:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:59:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:59:36 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:59:36 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:59:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:59:41 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:59:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:59:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:59:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:59:41 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 19:59:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:59:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:59:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 19:59:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 19:59:42 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:59:42 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 19:59:42 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8561MB free_disk=25.081912994384766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 19:59:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 19:59:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 19:59:42 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 19:59:42 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 19:59:42 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 19:59:42 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 19:59:42 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 19:59:42 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 19:59:42 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 19:59:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:59:43 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:59:43 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:59:43 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:59:44 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 19:59:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:59:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 19:59:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:00:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:00:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:00:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:00:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:00:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:00:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:00:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:00:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 20:00:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 20:00:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 20:00:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:00:31 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:00:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:00:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 20:00:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:00:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:00:31 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:00:31 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:00:31 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updating instance_info_cache with network_info: [{"id": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "address": "fa:16:3e:65:59:c2", "network": {"id": "f05abe25-637f-4c1c-8157-461cd7ca3f5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1637595303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2867b47e685f410a9635dd60a921cc6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88275bf-3b", "ovs_interfaceid": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:00:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:00:31 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:00:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:00:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:00:33 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:00:34 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:00:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-8a097d6f-2b58-4678-bc01-c0d0a409b414 req-56a1f2d3-991f-4221-ac6e-1fbd70dcea1a service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Received event network-changed-d88275bf-3bd9-43bc-96d3-eaf1b65f3705 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:00:35 user nova-compute[73917]: DEBUG nova.compute.manager [req-8a097d6f-2b58-4678-bc01-c0d0a409b414 req-56a1f2d3-991f-4221-ac6e-1fbd70dcea1a service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Refreshing instance network info cache due to event network-changed-d88275bf-3bd9-43bc-96d3-eaf1b65f3705. {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:00:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8a097d6f-2b58-4678-bc01-c0d0a409b414 req-56a1f2d3-991f-4221-ac6e-1fbd70dcea1a service nova] Acquiring lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:00:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8a097d6f-2b58-4678-bc01-c0d0a409b414 req-56a1f2d3-991f-4221-ac6e-1fbd70dcea1a service nova] Acquired lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:00:35 user nova-compute[73917]: DEBUG nova.network.neutron [req-8a097d6f-2b58-4678-bc01-c0d0a409b414 req-56a1f2d3-991f-4221-ac6e-1fbd70dcea1a service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Refreshing network info cache for port d88275bf-3bd9-43bc-96d3-eaf1b65f3705 {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:00:35 user nova-compute[73917]: DEBUG nova.network.neutron [req-8a097d6f-2b58-4678-bc01-c0d0a409b414 req-56a1f2d3-991f-4221-ac6e-1fbd70dcea1a service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updated VIF entry in instance network info cache for port d88275bf-3bd9-43bc-96d3-eaf1b65f3705. {{(pid=73917) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:00:35 user nova-compute[73917]: DEBUG nova.network.neutron [req-8a097d6f-2b58-4678-bc01-c0d0a409b414 req-56a1f2d3-991f-4221-ac6e-1fbd70dcea1a service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updating instance_info_cache with network_info: [{"id": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "address": "fa:16:3e:65:59:c2", "network": {"id": "f05abe25-637f-4c1c-8157-461cd7ca3f5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1637595303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2867b47e685f410a9635dd60a921cc6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88275bf-3b", "ovs_interfaceid": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:00:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-8a097d6f-2b58-4678-bc01-c0d0a409b414 req-56a1f2d3-991f-4221-ac6e-1fbd70dcea1a service nova] Releasing lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:00:36 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:00:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:00:38 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:00:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:00:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG nova.objects.instance [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lazy-loading 'flavor' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:00:41 user nova-compute[73917]: INFO nova.compute.manager [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Attaching volume 923846f7-0eb6-4bbe-84d7-b35a6feac502 to /dev/vdb
Aug 26 20:00:41 user nova-compute[73917]: DEBUG os_brick.utils [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[688bcd6a-0fe2-4231-81e4-6efc8f06229e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[739aca23-4ddc-4493-a866-05aa2f30b5a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d4645a-b912-49a9-b40a-7ea0b826ebac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[98072c57-65f8-4520-bf05-755ea9931320]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:00:41 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:00:41 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b2298f-66af-44da-971f-c4ba81e25d57]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG os_brick.utils [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:00:41 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updating existing volume attachment record: 19be3a4c-0ef9-4797-a22d-3190165e9b46 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:00:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:00:43 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:00:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:00:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:00:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:00:43 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:00:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:00:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:00:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:00:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:00:44 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:00:44 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:00:44 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8792MB free_disk=25.079486846923828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:00:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:00:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:00:44 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:00:44 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:00:44 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:00:44 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:00:44 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:00:44 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:00:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.391s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:00:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:00:45 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:00:45 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:00:45 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:00:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dEAeRVlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:00:51 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:00:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:00:51 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:00:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:00:51 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:00:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93e557d-f30d-4111-b48e-fc7b9a064122]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:00:51 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30184c8-fad8-4531-93b7-f45edcb5c62c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502] added
Aug 26 20:00:51 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e10f8d8-2d27-471a-a0d8-e8b100414c48]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b45fd54-c228-4b96-8058-3150dd8e3d42]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dEAeRVlY {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dEAeRVlY" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cda8b8-6570-4d59-ba81-9cb3ad3f5e29]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dEAeRVlY'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:00:51 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e17bde-583a-4605-bda8-f838a9288f51]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c82d8c-6b60-4913-95c3-fb20da69c8d4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 20:00:52 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 20:00:52 user nova-compute[73917]:  {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:00:52 user nova-compute[73917]: WARNING os_brick.initiator.connectors.iscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 20:00:52 user nova-compute[73917]: 
Aug 26 20:00:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08dfe6f-e4c4-49d3-a285-558c75823617]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502, portal: 172.16.0.220,3260]
Aug 26 20:00:52 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502, portal: 172.16.0.220,3260] successful.
Aug 26 20:00:52 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e7e55b-2a58-4a82-9e44-55d41b0db8ce]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78bd8f0-6219-464b-9800-e6a72bef3baa]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 (non-flash)
Aug 26 20:00:52 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 (non-flash)
Aug 26 20:00:52 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd03fbd-2cb0-4603-bea0-72069abf9100]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:00:52 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:00:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:00:53 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:00:53 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dEAeRVlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:00:53 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:00:53 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26664626235653165', 'path': '/dev/sdb'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:00:53 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664626235653165', 'path': '/dev/sdb'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:00:53 user nova-compute[73917]: DEBUG nova.objects.instance [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lazy-loading 'flavor' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:00:53 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 20:00:53 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:00:53 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 20:00:53 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:00:53 user nova-compute[73917]:   <serial>923846f7-0eb6-4bbe-84d7-b35a6feac502</serial>
Aug 26 20:00:53 user nova-compute[73917]: </disk>
Aug 26 20:00:53 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:00:53 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:00:53 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:00:53 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] No VIF found with MAC fa:16:3e:65:59:c2, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:00:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c101175e-7597-43ac-a712-fa13536e4adb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.472s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:00:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:00:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:00:59 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:01:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:01:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:01:09 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:01:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:01:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:01:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:01:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:01:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:01:25 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:01:25 user nova-compute[73917]: INFO nova.compute.manager [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Detaching volume 923846f7-0eb6-4bbe-84d7-b35a6feac502
Aug 26 20:01:25 user nova-compute[73917]: INFO nova.virt.block_device [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Attempting to driver detach volume 923846f7-0eb6-4bbe-84d7-b35a6feac502 from mountpoint /dev/vdb
Aug 26 20:01:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Attempting to detach device vdb from instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:01:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:01:25 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:01:25 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 20:01:25 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:01:25 user nova-compute[73917]:   <serial>923846f7-0eb6-4bbe-84d7-b35a6feac502</serial>
Aug 26 20:01:25 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:01:25 user nova-compute[73917]: </disk>
Aug 26 20:01:25 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:01:25 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Successfully detached device vdb from instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc from the persistent domain config.
Aug 26 20:01:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:01:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:01:25 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:01:25 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 20:01:25 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:01:25 user nova-compute[73917]:   <serial>923846f7-0eb6-4bbe-84d7-b35a6feac502</serial>
Aug 26 20:01:25 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:01:25 user nova-compute[73917]: </disk>
Aug 26 20:01:25 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:01:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693080085.9489846, 9ffed053-f186-45a6-8a78-c95d5e2de9fc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:01:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:01:25 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Successfully detached device vdb from instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc from the live domain config.
Aug 26 20:01:25 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:01:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dEAeRVlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:01:25 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:01:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:01:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:01:25 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:01:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:01:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:01:25 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e393b467-1a7b-4a4f-ac55-6d666925620f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:01:25 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8498109-016a-4c26-b741-200e6c76de10]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 (non-flash)
Aug 26 20:01:26 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 (non-flash)
Aug 26 20:01:26 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b785de290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502'): ({'sdb'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Removing single pathed devices sdb {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf15c85-a8cc-4210-bea1-f22649d7575e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cb2876-ea00-43cf-9283-2f0d5506dd7b]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Flushing IO for device /dev/sdb {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f811870-7b40-4dad-b15f-78eb0bb55eff]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[800bc61e-7094-4695-ac59-08eeec464699]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf38c8ef-c693-441e-9864-5d259036431f]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cbfeac-ac89-41c1-82b7-58811e8cadb7]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502, portal: 172.16.0.220,3260]
Aug 26 20:01:26 user nova-compute[73917]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502, portal: 172.16.0.220,3260] successful.
Aug 26 20:01:26 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923846f7-0eb6-4bbe-84d7-b35a6feac502 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2812be37-fb45-4ffc-8155-2424afbc9057]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] <== disconnect_volume: return (267ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:01:26 user nova-compute[73917]: DEBUG nova.objects.instance [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lazy-loading 'flavor' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:01:27 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-c7aa8b02-86f0-440d-9eee-51c48431d042 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.599s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:01:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:01:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:01:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:01:33 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:01:33 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 20:01:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:01:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:01:33 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:01:33 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:01:33 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updating instance_info_cache with network_info: [{"id": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "address": "fa:16:3e:65:59:c2", "network": {"id": "f05abe25-637f-4c1c-8157-461cd7ca3f5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1637595303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2867b47e685f410a9635dd60a921cc6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88275bf-3b", "ovs_interfaceid": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:01:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:01:33 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:01:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:01:33 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:01:34 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:01:36 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:01:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:01:40 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:01:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:01:44 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:01:45 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:01:45 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:01:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:01:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:01:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:01:45 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:01:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:01:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:01:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:01:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:01:46 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:01:46 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:01:46 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8782MB free_disk=25.078262329101562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:01:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:01:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:01:46 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:01:46 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:01:46 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:01:46 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:01:46 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:01:46 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:01:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:01:47 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:01:47 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:01:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:01:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:01:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:02:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:02:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:02:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:02:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:02:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:02:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:02:19 user nova-compute[73917]: DEBUG nova.objects.instance [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lazy-loading 'flavor' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:02:19 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:02:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:02:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:02:19 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:02:19 user nova-compute[73917]: INFO nova.compute.manager [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Attaching volume 75f8ed24-915b-4ec3-81a7-86b3ece042aa to /dev/vdb
Aug 26 20:02:19 user nova-compute[73917]: DEBUG os_brick.utils [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:02:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3290090e-09d5-49c9-ab43-9965845cd7da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.050s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5ebafc-4e38-4792-823d-495636025be5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d7c067-5ef4-4269-83bb-ae808753a2f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:19 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[694cd78d-3a41-4650-8bc8-6bf66f3e91c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:19 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:02:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:02:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:20 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:02:20 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:02:20 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2946a0-ac3d-43ca-a6cf-232b84f11119]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:02:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:02:20 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:02:20 user nova-compute[73917]: DEBUG os_brick.utils [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:02:20 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updating existing volume attachment record: 301a0042-a826-4df9-b30a-d4659cddb3ab {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:02:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:02:24 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:02:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThtQBgNu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:02:30 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:02:30 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:02:30 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d371add-0c67-451a-a722-125bd37e6736]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:02:30 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[640c46bc-e9a2-45bc-8fe6-63f809ad3659]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa] added
Aug 26 20:02:30 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[758b3400-0b15-4312-83ce-540eaf734ee6]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba18684d-f057-4836-a969-13a489b0bd37]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ThtQBgNu {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ThtQBgNu" returned: 0 in 0.031s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f2f512-3fce-43ff-ad77-7cce2dcef8c1]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ThtQBgNu'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e427fe5d-8a7a-43c3-9448-fff70c9ddd7d]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9b8a31-2790-4829-9f7a-f1d24027a7ea]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 20:02:30 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 20:02:30 user nova-compute[73917]:  {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:02:30 user nova-compute[73917]: WARNING os_brick.initiator.connectors.iscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 20:02:30 user nova-compute[73917]: 
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[151f67c5-705c-4ddb-bccd-fd80d65b1f82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa, portal: 172.16.0.220,3260]
Aug 26 20:02:30 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa, portal: 172.16.0.220,3260] successful.
Aug 26 20:02:30 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b895f12e-a5fb-4c57-b48c-97a1621a0a45]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfc2a66-94ae-4fd6-bc9e-8f7d53095e13]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa (non-flash)
Aug 26 20:02:30 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa (non-flash)
Aug 26 20:02:30 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c9b456-cade-44e6-a217-30f0b642c1e5]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:30 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:02:31 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:02:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThtQBgNu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:02:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:02:31 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23662356663383263', 'path': '/dev/sdb'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:02:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662356663383263', 'path': '/dev/sdb'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:02:31 user nova-compute[73917]: DEBUG nova.objects.instance [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lazy-loading 'flavor' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:02:31 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 20:02:31 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:02:31 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 20:02:31 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:02:31 user nova-compute[73917]:   <serial>75f8ed24-915b-4ec3-81a7-86b3ece042aa</serial>
Aug 26 20:02:31 user nova-compute[73917]: </disk>
Aug 26 20:02:31 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:02:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:02:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:02:32 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] No VIF found with MAC fa:16:3e:65:59:c2, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:02:32 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-a2e43cee-6c6f-48fb-a9b3-e72b65518292 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.430s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:02:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:02:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:02:33 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:02:33 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 20:02:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:02:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:02:33 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:02:33 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:02:33 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updating instance_info_cache with network_info: [{"id": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "address": "fa:16:3e:65:59:c2", "network": {"id": "f05abe25-637f-4c1c-8157-461cd7ca3f5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1637595303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2867b47e685f410a9635dd60a921cc6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88275bf-3b", "ovs_interfaceid": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:02:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:02:33 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:02:34 user nova-compute[73917]: INFO nova.compute.manager [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Detaching volume 75f8ed24-915b-4ec3-81a7-86b3ece042aa
Aug 26 20:02:34 user nova-compute[73917]: INFO nova.virt.block_device [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Attempting to driver detach volume 75f8ed24-915b-4ec3-81a7-86b3ece042aa from mountpoint /dev/vdb
Aug 26 20:02:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Attempting to detach device vdb from instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:02:34 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:02:34 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 20:02:34 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:02:34 user nova-compute[73917]:   <serial>75f8ed24-915b-4ec3-81a7-86b3ece042aa</serial>
Aug 26 20:02:34 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:02:34 user nova-compute[73917]: </disk>
Aug 26 20:02:34 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:02:34 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Successfully detached device vdb from instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc from the persistent domain config.
Aug 26 20:02:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:02:34 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:02:34 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 20:02:34 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:02:34 user nova-compute[73917]:   <serial>75f8ed24-915b-4ec3-81a7-86b3ece042aa</serial>
Aug 26 20:02:34 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:02:34 user nova-compute[73917]: </disk>
Aug 26 20:02:34 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693080154.8793828, 9ffed053-f186-45a6-8a78-c95d5e2de9fc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:02:34 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Successfully detached device vdb from instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc from the live domain config.
Aug 26 20:02:34 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThtQBgNu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:02:34 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:02:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea44d88-3f32-4192-93b8-a736ba5a0c8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc47cfc-12b0-477c-9427-e871ad29af34]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa (non-flash)
Aug 26 20:02:34 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa (non-flash)
Aug 26 20:02:34 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b786435b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa'): ({'sdb'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Removing single pathed devices sdb {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c23d827-9de7-4968-9ee6-14ce2de41142]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:34 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd317a2-be19-4b67-9508-c7f65fab8e38]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Flushing IO for device /dev/sdb {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a26f2b-1810-4873-916a-f4e16c04ca7c]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab54c084-c38f-42df-927e-97d2546f3d0c]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44910f8-103b-411b-b9d2-e6a726321433]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ddf9e9-6899-42df-a266-defc369d2ed1]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa, portal: 172.16.0.220,3260]
Aug 26 20:02:35 user nova-compute[73917]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa, portal: 172.16.0.220,3260] successful.
Aug 26 20:02:35 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f8ed24-915b-4ec3-81a7-86b3ece042aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c24d141-0ff5-4840-b4dd-8fafcf4723a2]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] <== disconnect_volume: return (295ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:02:35 user nova-compute[73917]: DEBUG nova.objects.instance [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lazy-loading 'flavor' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:02:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-695eda1c-4896-4e9d-bafd-723f2d2f9a93 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.656s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:02:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:02:38 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:02:40 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:02:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:02:44 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:02:45 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:02:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:02:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:02:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:02:45 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:02:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:02:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:02:46 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:02:46 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:02:46 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8779MB free_disk=25.07721710205078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:02:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:02:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:02:46 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:02:46 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:02:46 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:02:46 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:02:46 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:02:46 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:02:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:02:47 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:02:47 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:02:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:02:48 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:02:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:02:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:03:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:03:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:03:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:03:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:03:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG nova.objects.instance [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lazy-loading 'flavor' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:03:28 user nova-compute[73917]: INFO nova.compute.manager [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Attaching volume 343d6e9f-0c56-4be8-b0c4-72d68449749e to /dev/vdb
Aug 26 20:03:28 user nova-compute[73917]: DEBUG os_brick.utils [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[febc8e43-0cf3-43ce-ba6f-8fd48218ba6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[065fbfc6-ef22-4250-8fe1-b80cd6e2217e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[35363db6-0792-45b4-98a0-1e1f55e2e1c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[693c4fd6-232c-4632-8fce-728c05fcde02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:03:28 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:03:28 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba45d09-94ae-491e-8751-951fdcbe10c7]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG os_brick.utils [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:03:28 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updating existing volume attachment record: b67b8a13-b715-4969-8fee-76273f1ce411 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:03:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:03:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:03:33 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:03:33 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:03:33 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 20:03:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:03:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:03:33 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:03:33 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:03:33 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updating instance_info_cache with network_info: [{"id": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "address": "fa:16:3e:65:59:c2", "network": {"id": "f05abe25-637f-4c1c-8157-461cd7ca3f5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1637595303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2867b47e685f410a9635dd60a921cc6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88275bf-3b", "ovs_interfaceid": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:03:33 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:03:33 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:03:34 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:03:34 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73917) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 20:03:35 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:03:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:03:36 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:03:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMuglKtO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:03:39 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:03:39 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:03:39 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fdcb53-2006-477b-a241-50aa2ed120b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:03:39 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7e2b67-7a9d-493d-88e3-4623d3a61149]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e] added
Aug 26 20:03:39 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c4bef0-a9fb-427d-83eb-e0c1e3c0c4f8]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[04873d43-8efc-43fb-b31a-9169c3709f93]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mMuglKtO {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mMuglKtO" returned: 0 in 0.024s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[01777ca4-1413-4d81-9774-b51e05c9d366]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mMuglKtO'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc1c94d-4165-4add-adea-60e7ffc16b2e]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[29542531-f88d-4a1c-8acd-baa184d35289]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 20:03:39 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 20:03:39 user nova-compute[73917]:  {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:03:39 user nova-compute[73917]: WARNING os_brick.initiator.connectors.iscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 20:03:39 user nova-compute[73917]: 
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[75729c19-c313-486c-bce7-c10f162016ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e, portal: 172.16.0.220,3260]
Aug 26 20:03:39 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e, portal: 172.16.0.220,3260] successful.
Aug 26 20:03:39 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c012332-79ac-4bca-a288-e5b5ab27c74c]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5defdbf0-5af2-4614-af41-5fe371754704]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e (non-flash)
Aug 26 20:03:39 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e (non-flash)
Aug 26 20:03:39 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1c40c2-a0fe-4562-ad45-541d61d95410]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:03:39 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMuglKtO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:03:40 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:03:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:03:40 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26133306634306638', 'path': '/dev/sdb'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:03:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133306634306638', 'path': '/dev/sdb'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:03:40 user nova-compute[73917]: DEBUG nova.objects.instance [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lazy-loading 'flavor' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:03:40 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 20:03:40 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:03:40 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 20:03:40 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:03:40 user nova-compute[73917]:   <serial>343d6e9f-0c56-4be8-b0c4-72d68449749e</serial>
Aug 26 20:03:40 user nova-compute[73917]: </disk>
Aug 26 20:03:40 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:03:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:03:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:03:41 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] No VIF found with MAC fa:16:3e:65:59:c2, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:03:41 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-beab85df-67cd-485e-b3b9-cde2655628a9 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.600s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:03:43 user nova-compute[73917]: INFO nova.compute.manager [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Detaching volume 343d6e9f-0c56-4be8-b0c4-72d68449749e
Aug 26 20:03:43 user nova-compute[73917]: INFO nova.virt.block_device [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Attempting to driver detach volume 343d6e9f-0c56-4be8-b0c4-72d68449749e from mountpoint /dev/vdb
Aug 26 20:03:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Attempting to detach device vdb from instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:03:43 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:03:43 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 20:03:43 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:03:43 user nova-compute[73917]:   <serial>343d6e9f-0c56-4be8-b0c4-72d68449749e</serial>
Aug 26 20:03:43 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:03:43 user nova-compute[73917]: </disk>
Aug 26 20:03:43 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:03:43 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Successfully detached device vdb from instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc from the persistent domain config.
Aug 26 20:03:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:03:43 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:03:43 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 20:03:43 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:03:43 user nova-compute[73917]:   <serial>343d6e9f-0c56-4be8-b0c4-72d68449749e</serial>
Aug 26 20:03:43 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:03:43 user nova-compute[73917]: </disk>
Aug 26 20:03:43 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693080223.8202417, 9ffed053-f186-45a6-8a78-c95d5e2de9fc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:03:43 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Successfully detached device vdb from instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc from the live domain config.
Aug 26 20:03:43 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMuglKtO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:03:43 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:03:43 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[98796efb-7f32-4eca-a1c7-89d4bd5f93c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca5ccc0-19f0-4852-9d5d-c130a7d2f52e]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e (non-flash)
Aug 26 20:03:43 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e (non-flash)
Aug 26 20:03:43 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b78566170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e'): ({'sdb'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Removing single pathed devices sdb {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7799bbe-62a8-4c42-88d2-e63c9aeb18e4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be3abdc-4d45-4388-a78e-054cfdb98ce7]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Flushing IO for device /dev/sdb {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[da907e21-8d77-46ab-be9c-41a79129f8c4]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c033890-66d2-4da9-ab2f-d4f606e071dc]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:03:43 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:03:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:03:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9beac12f-8fb7-4f26-9c98-7647e0ffab7a]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:03:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8c4ea4-d9c3-4032-8ccd-085234cb482e]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e, portal: 172.16.0.220,3260]
Aug 26 20:03:44 user nova-compute[73917]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e, portal: 172.16.0.220,3260] successful.
Aug 26 20:03:44 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:03:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:44 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:343d6e9f-0c56-4be8-b0c4-72d68449749e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:44 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[947a0de1-cf57-4455-9225-0a423940bd60]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:03:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:03:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:03:44 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] <== disconnect_volume: return (258ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:03:44 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:03:44 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:03:44 user nova-compute[73917]: DEBUG nova.objects.instance [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lazy-loading 'flavor' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:03:44 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-5654755f-d505-4663-b358-cf0160888157 tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.612s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:03:45 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:03:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:03:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:03:45 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:03:45 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:03:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:03:45 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:03:46 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:03:46 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:03:46 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8762MB free_disk=25.07625961303711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:03:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:03:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:03:46 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:03:46 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:03:46 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:03:46 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing inventories for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 20:03:46 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating ProviderTree inventory for provider d90ad23a-e063-4f0d-8341-c34e0141d16a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 20:03:46 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Updating inventory in ProviderTree for provider d90ad23a-e063-4f0d-8341-c34e0141d16a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 20:03:46 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing aggregate associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, aggregates: None {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 20:03:46 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Refreshing trait associations for resource provider d90ad23a-e063-4f0d-8341-c34e0141d16a, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=73917) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 20:03:46 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:03:46 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:03:46 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:03:46 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:03:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:03:48 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:03:48 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:03:48 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:03:48 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:03:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:03:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:04:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:04:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:04:08 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:04:10 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:04:10 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Cleaning up deleted instances {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 20:04:10 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] There are 0 instances to clean {{(pid=73917) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 20:04:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:04:13 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:04:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:04:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:04:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:04:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:04:35 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:04:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:04:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 20:04:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:04:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:04:35 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:04:35 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:04:35 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updating instance_info_cache with network_info: [{"id": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "address": "fa:16:3e:65:59:c2", "network": {"id": "f05abe25-637f-4c1c-8157-461cd7ca3f5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1637595303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2867b47e685f410a9635dd60a921cc6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88275bf-3b", "ovs_interfaceid": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:04:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:04:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:04:36 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:04:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG nova.objects.instance [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lazy-loading 'flavor' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:04:37 user nova-compute[73917]: INFO nova.compute.manager [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Attaching volume 96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f to /dev/vdb
Aug 26 20:04:37 user nova-compute[73917]: DEBUG os_brick.utils [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b82670-5693-42bd-aa79-f5bb45076a89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5c229555a192\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b13f61-c391-476e-8687-58c8e64f71ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89ab71b-a285-4f7f-8a78-a3d15149c0b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8457983c-0f41-477e-82d8-28602f9bed9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Running cmd (subprocess): nvme version {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] 'nvme version' failed. Not Retrying. {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] nvme not present on system {{(pid=73917) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:04:37 user nova-compute[73917]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:04:37 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[73944277-ab18-4a1a-9b3f-378cded4e2f8]: (4, '') {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73917) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.lightos [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] LIGHTOS: no hostnqn found. {{(pid=73917) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG os_brick.utils [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5c229555a192', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:04:37 user nova-compute[73917]: DEBUG nova.virt.block_device [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updating existing volume attachment record: fe9ae152-d9f5-4f39-9ee6-88e53dc2d8e0 {{(pid=73917) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:04:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:04:39 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:04:41 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:04:41 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:04:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:04:47 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:04:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:04:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:04:47 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:04:47 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:04:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:47 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Calling os-brick to attach iSCSI Volume {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SLiaODNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:04:48 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:04:48 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:04:48 user nova-compute[73917]: INFO os_brick.initiator.connectors.iscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:04:48 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:04:48 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:04:48 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8776MB free_disk=25.075523376464844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef218da-6df8-44df-8371-4ae52c9351ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:04:48 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 --interface default --op new {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeae5203-6623-48b3-b7e6-082e59a215a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f] added\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f] added
Aug 26 20:04:48 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b5fb47-aece-45a6-bfed-8d2687454c40]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af08b94-c4a3-487c-8265-de0b7e1427f6]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SLiaODNg {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SLiaODNg" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0b9504-9074-4f38-ae05-f948415b7d39]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SLiaODNg'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4fabe7-f15e-4e2f-81e9-2d5c6be7a1c8]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[133f4782-c60e-4fba-aeec-0408d35e966a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 20:04:48 user nova-compute[73917]:  {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 20:04:48 user nova-compute[73917]:  {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:04:48 user nova-compute[73917]: WARNING os_brick.initiator.connectors.iscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 20:04:48 user nova-compute[73917]: 
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 --login {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ac2d1f-3e93-406f-a3d5-ba91504e54ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f, portal: 172.16.0.220,3260]
Aug 26 20:04:48 user nova-compute[73917]: Login to [iface: default, target: iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f, portal: 172.16.0.220,3260] successful.
Aug 26 20:04:48 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb15cc6b-b7f7-4628-9c1c-978fb21cafce]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7028d9f-83e8-40a6-b2b6-146cd3873bd9]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f (non-flash)
Aug 26 20:04:48 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f (non-flash)
Aug 26 20:04:48 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Connected to 172.16.0.220:3260 {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=73917) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73917) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7685e8c-6cd0-4b29-80c5-4ed7f452f0a3]: (4, ('- - 0', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73917) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:04:48 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SLiaODNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73917) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:04:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:04:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:04:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:04:49 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:04:49 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26565363135616462', 'path': '/dev/sdb'} {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:04:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565363135616462', 'path': '/dev/sdb'} {{(pid=73917) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:04:49 user nova-compute[73917]: DEBUG nova.objects.instance [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lazy-loading 'flavor' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:04:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 20:04:49 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:04:49 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 20:04:49 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:04:49 user nova-compute[73917]:   <serial>96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f</serial>
Aug 26 20:04:49 user nova-compute[73917]: </disk>
Aug 26 20:04:49 user nova-compute[73917]:  {{(pid=73917) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:04:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] No BDM found with device name vda, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:04:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73917) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:04:49 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] No VIF found with MAC fa:16:3e:65:59:c2, not building metadata {{(pid=73917) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:04:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-6198e216-29e1-4fa8-a806-2e0a92dc697c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.516s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:04:52 user nova-compute[73917]: INFO nova.compute.manager [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Detaching volume 96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f
Aug 26 20:04:52 user nova-compute[73917]: INFO nova.virt.block_device [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Attempting to driver detach volume 96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f from mountpoint /dev/vdb
Aug 26 20:04:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Attempting to detach device vdb from instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc from the persistent domain config. {{(pid=73917) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:04:52 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:04:52 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 20:04:52 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:04:52 user nova-compute[73917]:   <serial>96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f</serial>
Aug 26 20:04:52 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:04:52 user nova-compute[73917]: </disk>
Aug 26 20:04:52 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:04:52 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Successfully detached device vdb from instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc from the persistent domain config.
Aug 26 20:04:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc from the live domain config. {{(pid=73917) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.guest [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:04:52 user nova-compute[73917]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:04:52 user nova-compute[73917]:   <source dev="/dev/sdb"/>
Aug 26 20:04:52 user nova-compute[73917]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:04:52 user nova-compute[73917]:   <serial>96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f</serial>
Aug 26 20:04:52 user nova-compute[73917]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:04:52 user nova-compute[73917]: </disk>
Aug 26 20:04:52 user nova-compute[73917]:  {{(pid=73917) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-af31c668-a62d-4fa5-b41e-ca9bed00ec4f None None] Received event <DeviceRemovedEvent: 1693080292.6125178, 9ffed053-f186-45a6-8a78-c95d5e2de9fc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73917) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.driver [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:04:52 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Successfully detached device vdb from instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc from the live domain config.
Aug 26 20:04:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] calling os-brick to detach iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6ba81166b0>, {'target_iqns': ['iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SLiaODNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:04:52 user nova-compute[73917]: WARNING os_brick.initiator.connectors.base [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:04:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f', 0)] {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[230c9d42-3c58-4765-b2a7-d8a6c34e2834]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0aa28b-9cf4-43b1-9148-bdb994073cae]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f (non-flash)\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f (non-flash)
Aug 26 20:04:52 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f (non-flash)
Aug 26 20:04:52 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6b786aec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f'): ({'sdb'}, set())}) {{(pid=73917) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Removing single pathed devices sdb {{(pid=73917) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb2c663-94ac-4675-828c-6b20c67f80e0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55f9418-274d-4481-b235-06135f16da14]: (4, ('ok\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Flushing IO for device /dev/sdb {{(pid=73917) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e56550c-3870-46c7-b745-e95bf87bf355]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73917) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e710bc9-d5a8-4a82-9d07-a80cd8b8cb96]: (4, ('1', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG os_brick.initiator.linuxscsi [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] SCSI volumes sdb have been removed. {{(pid=73917) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f')] {{(pid=73917) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2234cef7-308f-49e0-b63c-6e4d7f4391ae]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 --logout {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[63eca950-c2cb-4cc9-9887-5553bf67a9d9]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f, portal: 172.16.0.220,3260]
Aug 26 20:04:52 user nova-compute[73917]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f, portal: 172.16.0.220,3260] successful.
Aug 26 20:04:52 user nova-compute[73917]:  stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 --op delete {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96eb6ef8-96f9-4bb5-a9a0-dbe7d586872f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85467) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG oslo.privsep.daemon [-] privsep: reply[915e0a47-4ea6-4592-ab5b-fadb9330f993]: (4, ('', '')) {{(pid=85467) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73917) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.base [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] <== disconnect_volume: return (252ms) None {{(pid=73917) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:04:52 user nova-compute[73917]: DEBUG nova.virt.libvirt.volume.iscsi [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Disconnected iSCSI Volume {{(pid=73917) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:04:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:04:53 user nova-compute[73917]: DEBUG nova.objects.instance [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lazy-loading 'flavor' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:04:53 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-510bb3ca-ea09-48aa-822b-6121adf721cb tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.671s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:04:54 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:04:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:05:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:05:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:05:12 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:05:12 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Triggering sync for uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:05:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:05:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:05:12 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:05:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:05:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:05:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:05:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:05:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:05:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:05:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 20:05:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 20:05:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 20:05:33 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:05:35 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:05:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:05:35 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 20:05:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:05:35 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquired lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:05:35 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Forcefully refreshing network info cache for instance {{(pid=73917) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:05:35 user nova-compute[73917]: DEBUG nova.objects.instance [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lazy-loading 'info_cache' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:05:36 user nova-compute[73917]: DEBUG nova.network.neutron [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updating instance_info_cache with network_info: [{"id": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "address": "fa:16:3e:65:59:c2", "network": {"id": "f05abe25-637f-4c1c-8157-461cd7ca3f5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1637595303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2867b47e685f410a9635dd60a921cc6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88275bf-3b", "ovs_interfaceid": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:05:36 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Releasing lock "refresh_cache-9ffed053-f186-45a6-8a78-c95d5e2de9fc" {{(pid=73917) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:05:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updated the network info_cache for instance {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:05:36 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:05:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:05:38 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:05:38 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:05:41 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:05:43 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:05:43 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:05:48 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:05:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:05:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:05:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:05:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:05:49 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:05:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:05:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:05:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:05:49 user nova-compute[73917]: DEBUG oslo_concurrency.processutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73917) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:05:50 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:05:50 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:05:50 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8783MB free_disk=25.0589599609375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:05:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:05:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:05:50 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73917) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:05:50 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:05:50 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:05:50 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:05:50 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:05:50 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:05:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:05:51 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:05:51 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:05:51 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:05:51 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:05:53 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:05:58 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:06:03 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:06:08 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:06:13 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:06:18 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:06:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:06:28 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:06:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:06:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:06:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:06:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:06:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:06:29 user nova-compute[73917]: INFO nova.compute.manager [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Terminating instance
Aug 26 20:06:29 user nova-compute[73917]: DEBUG nova.compute.manager [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Start destroying the instance on the hypervisor. {{(pid=73917) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:06:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:06:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:06:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:06:29 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:06:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-be27dfbc-f7b1-457b-a4c3-a786aca958b3 req-47a523b3-9633-41a1-8ee8-7dc14819376e service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Received event network-vif-unplugged-d88275bf-3bd9-43bc-96d3-eaf1b65f3705 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:06:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-be27dfbc-f7b1-457b-a4c3-a786aca958b3 req-47a523b3-9633-41a1-8ee8-7dc14819376e service nova] Acquiring lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:06:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-be27dfbc-f7b1-457b-a4c3-a786aca958b3 req-47a523b3-9633-41a1-8ee8-7dc14819376e service nova] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:06:29 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-be27dfbc-f7b1-457b-a4c3-a786aca958b3 req-47a523b3-9633-41a1-8ee8-7dc14819376e service nova] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:06:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-be27dfbc-f7b1-457b-a4c3-a786aca958b3 req-47a523b3-9633-41a1-8ee8-7dc14819376e service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] No waiting events found dispatching network-vif-unplugged-d88275bf-3bd9-43bc-96d3-eaf1b65f3705 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:06:29 user nova-compute[73917]: DEBUG nova.compute.manager [req-be27dfbc-f7b1-457b-a4c3-a786aca958b3 req-47a523b3-9633-41a1-8ee8-7dc14819376e service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Received event network-vif-unplugged-d88275bf-3bd9-43bc-96d3-eaf1b65f3705 for instance with task_state deleting. {{(pid=73917) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:06:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:06:30 user nova-compute[73917]: INFO nova.virt.libvirt.driver [-] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Instance destroyed successfully.
Aug 26 20:06:30 user nova-compute[73917]: DEBUG nova.objects.instance [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lazy-loading 'resources' on Instance uuid 9ffed053-f186-45a6-8a78-c95d5e2de9fc {{(pid=73917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:06:30 user nova-compute[73917]: DEBUG nova.virt.libvirt.vif [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T19:58:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2066860557',display_name='tempest-SnapshotDataIntegrityTests-server-2066860557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2066860557',id=53,image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnxeKqwU6bpm63Ko/5mxMzLSidqHzdVrJaO9X+8AYp06rtLE7Xi8Bw7K7ypVQlVtwN8zxk6xDAyOg1e+j4Tc3jlGzIfxuvfba9ov0NHa1jk9p+iiTypLCr0iVal75W4pw==',key_name='tempest-keypair-714542191',keypairs=<?>,launch_index=0,launched_at=2023-08-26T19:58:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2867b47e685f410a9635dd60a921cc6d',ramdisk_id='',reservation_id='r-lvnotd7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a0152a1-b7ea-410d-a483-7d6785711f32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1073781911',owner_user_name='tempest-SnapshotDataIntegrityTests-1073781911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T19:58:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3991130d76bc41ec82f77334057d79a5',uuid=9ffed053-f186-45a6-8a78-c95d5e2de9fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "address": "fa:16:3e:65:59:c2", "network": {"id": "f05abe25-637f-4c1c-8157-461cd7ca3f5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1637595303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2867b47e685f410a9635dd60a921cc6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88275bf-3b", "ovs_interfaceid": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:06:30 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Converting VIF {"id": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "address": "fa:16:3e:65:59:c2", "network": {"id": "f05abe25-637f-4c1c-8157-461cd7ca3f5f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1637595303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2867b47e685f410a9635dd60a921cc6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88275bf-3b", "ovs_interfaceid": "d88275bf-3bd9-43bc-96d3-eaf1b65f3705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:06:30 user nova-compute[73917]: DEBUG nova.network.os_vif_util [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:59:c2,bridge_name='br-int',has_traffic_filtering=True,id=d88275bf-3bd9-43bc-96d3-eaf1b65f3705,network=Network(f05abe25-637f-4c1c-8157-461cd7ca3f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd88275bf-3b') {{(pid=73917) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:06:30 user nova-compute[73917]: DEBUG os_vif [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:59:c2,bridge_name='br-int',has_traffic_filtering=True,id=d88275bf-3bd9-43bc-96d3-eaf1b65f3705,network=Network(f05abe25-637f-4c1c-8157-461cd7ca3f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd88275bf-3b') {{(pid=73917) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:06:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:06:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd88275bf-3b, bridge=br-int, if_exists=True) {{(pid=73917) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:06:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:06:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:06:30 user nova-compute[73917]: INFO os_vif [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:59:c2,bridge_name='br-int',has_traffic_filtering=True,id=d88275bf-3bd9-43bc-96d3-eaf1b65f3705,network=Network(f05abe25-637f-4c1c-8157-461cd7ca3f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd88275bf-3b')
Aug 26 20:06:30 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Deleting instance files /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc_del
Aug 26 20:06:30 user nova-compute[73917]: INFO nova.virt.libvirt.driver [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Deletion of /opt/stack/data/nova/instances/9ffed053-f186-45a6-8a78-c95d5e2de9fc_del complete
Aug 26 20:06:30 user nova-compute[73917]: INFO nova.compute.manager [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 20:06:30 user nova-compute[73917]: DEBUG oslo.service.loopingcall [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73917) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:06:30 user nova-compute[73917]: DEBUG nova.compute.manager [-] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Deallocating network for instance {{(pid=73917) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:06:30 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] deallocate_for_instance() {{(pid=73917) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:06:31 user nova-compute[73917]: DEBUG nova.network.neutron [-] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Updating instance_info_cache with network_info: [] {{(pid=73917) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:06:31 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Took 1.31 seconds to deallocate network for instance.
Aug 26 20:06:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:06:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:06:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-7e9661e1-e3af-420b-b9ae-9dcf182f2c2a req-dfaf2f1a-dcb7-4eb5-9a81-3e8ec7c13c26 service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Received event network-vif-deleted-d88275bf-3bd9-43bc-96d3-eaf1b65f3705 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:06:31 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:06:31 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:06:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:06:31 user nova-compute[73917]: INFO nova.scheduler.client.report [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Deleted allocations for instance 9ffed053-f186-45a6-8a78-c95d5e2de9fc
Aug 26 20:06:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-d53cb940-e863-4aa5-ac15-004a3666c61c tempest-SnapshotDataIntegrityTests-1073781911 tempest-SnapshotDataIntegrityTests-1073781911-project-member] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.495s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:06:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-e174d10b-ad14-401c-877b-b71c4adc0b72 req-e4fb8844-93a3-4bec-921f-061eaf449891 service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Received event network-vif-plugged-d88275bf-3bd9-43bc-96d3-eaf1b65f3705 {{(pid=73917) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:06:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e174d10b-ad14-401c-877b-b71c4adc0b72 req-e4fb8844-93a3-4bec-921f-061eaf449891 service nova] Acquiring lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:06:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e174d10b-ad14-401c-877b-b71c4adc0b72 req-e4fb8844-93a3-4bec-921f-061eaf449891 service nova] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:06:31 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [req-e174d10b-ad14-401c-877b-b71c4adc0b72 req-e4fb8844-93a3-4bec-921f-061eaf449891 service nova] Lock "9ffed053-f186-45a6-8a78-c95d5e2de9fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:06:31 user nova-compute[73917]: DEBUG nova.compute.manager [req-e174d10b-ad14-401c-877b-b71c4adc0b72 req-e4fb8844-93a3-4bec-921f-061eaf449891 service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] No waiting events found dispatching network-vif-plugged-d88275bf-3bd9-43bc-96d3-eaf1b65f3705 {{(pid=73917) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:06:31 user nova-compute[73917]: WARNING nova.compute.manager [req-e174d10b-ad14-401c-877b-b71c4adc0b72 req-e4fb8844-93a3-4bec-921f-061eaf449891 service nova] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Received unexpected event network-vif-plugged-d88275bf-3bd9-43bc-96d3-eaf1b65f3705 for instance with vm_state deleted and task_state None.
Aug 26 20:06:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:06:36 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:06:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:06:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 20:06:36 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Didn't find any instances for network info cache update. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 20:06:38 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:06:38 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:06:39 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:06:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:06:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:06:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 20:06:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 20:06:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 20:06:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:06:43 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:06:45 user nova-compute[73917]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693080390.20301, 9ffed053-f186-45a6-8a78-c95d5e2de9fc => Stopped> {{(pid=73917) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:06:45 user nova-compute[73917]: INFO nova.compute.manager [-] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] VM Stopped (Lifecycle Event)
Aug 26 20:06:45 user nova-compute[73917]: DEBUG nova.compute.manager [None req-48fdff4a-6f06-419a-a8ac-42e60e839b89 None None] [instance: 9ffed053-f186-45a6-8a78-c95d5e2de9fc] Checking state {{(pid=73917) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:06:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:06:45 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:06:49 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:06:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:06:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:06:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:06:49 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:06:49 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:06:49 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:06:49 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=8910MB free_disk=25.086105346679688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:06:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:06:49 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:06:49 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:06:49 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:06:49 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:06:49 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:06:50 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:06:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:06:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:06:52 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:06:52 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:06:52 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:06:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:06:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:06:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 20:06:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 20:06:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 20:06:55 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:07:00 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 20:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 20:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 20:07:05 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:07:10 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:07:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:07:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:07:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73917) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 20:07:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 20:07:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73917) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 20:07:15 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:07:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:07:20 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:07:23 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:07:25 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:07:26 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:07:30 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:07:35 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:07:38 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:07:38 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Starting heal instance info cache {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:07:38 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Rebuilding the list of instances to heal {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 20:07:38 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Didn't find any instances for network info cache update. {{(pid=73917) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 20:07:38 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:07:38 user nova-compute[73917]: DEBUG nova.compute.manager [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73917) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:07:40 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:07:40 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:07:45 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:07:45 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:07:47 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:07:50 user nova-compute[73917]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73917) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:07:50 user nova-compute[73917]: DEBUG oslo_service.periodic_task [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73917) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:07:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:07:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:07:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:07:50 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Auditing locally available compute resources for user (node: user) {{(pid=73917) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:07:50 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:07:50 user nova-compute[73917]: WARNING nova.virt.libvirt.driver [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:07:50 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Hypervisor/Node resource view: name=user free_ram=9017MB free_disk=25.021900177001953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=73917) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:07:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:07:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:07:50 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:07:50 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73917) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:07:50 user nova-compute[73917]: DEBUG nova.compute.provider_tree [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed in ProviderTree for provider: d90ad23a-e063-4f0d-8341-c34e0141d16a {{(pid=73917) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:07:50 user nova-compute[73917]: DEBUG nova.scheduler.client.report [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Inventory has not changed for provider d90ad23a-e063-4f0d-8341-c34e0141d16a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73917) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:07:50 user nova-compute[73917]: DEBUG nova.compute.resource_tracker [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Compute_service record updated for user:user {{(pid=73917) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:07:50 user nova-compute[73917]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc81-bf99-49b1-b0ce-598599d23484 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=73917) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}